-- Logs begin at Sun 2022-09-11 07:53:43 UTC, end at Sun 2022-09-11 09:05:48 UTC. -- Sep 11 08:24:07.737686 dv-cinder-856941-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 11 08:24:07.747101 dv-cinder-856941-2-smb devstack@keystone.service[81638]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 11 08:24:07.749150 dv-cinder-856941-2-smb devstack@keystone.service[81638]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 11 08:24:07 2022] *** Sep 11 08:24:07.749150 dv-cinder-856941-2-smb devstack@keystone.service[81638]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 11 08:24:07.749150 dv-cinder-856941-2-smb devstack@keystone.service[81638]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 11 08:24:07.749150 dv-cinder-856941-2-smb devstack@keystone.service[81638]: nodename: dv-cinder-856941-2-smb Sep 11 08:24:07.749150 dv-cinder-856941-2-smb devstack@keystone.service[81638]: machine: x86_64 Sep 11 08:24:07.749150 dv-cinder-856941-2-smb devstack@keystone.service[81638]: clock source: unix Sep 11 08:24:07.749150 dv-cinder-856941-2-smb devstack@keystone.service[81638]: pcre jit disabled Sep 11 08:24:07.749150 dv-cinder-856941-2-smb devstack@keystone.service[81638]: detected number of CPU cores: 4 Sep 11 08:24:07.749150 dv-cinder-856941-2-smb devstack@keystone.service[81638]: current working directory: / Sep 11 08:24:07.749150 dv-cinder-856941-2-smb devstack@keystone.service[81638]: detected binary path: /usr/bin/uwsgi-core Sep 11 08:24:07.749693 dv-cinder-856941-2-smb devstack@keystone.service[81638]: your processes number limit is 47680 Sep 11 08:24:07.749693 dv-cinder-856941-2-smb devstack@keystone.service[81638]: your memory page size is 4096 bytes Sep 11 08:24:07.749693 dv-cinder-856941-2-smb devstack@keystone.service[81638]: detected max file descriptor number: 2048 Sep 11 08:24:07.749693 dv-cinder-856941-2-smb devstack@keystone.service[81638]: lock engine: pthread robust mutexes Sep 11 08:24:07.749693 dv-cinder-856941-2-smb devstack@keystone.service[81638]: thunder lock: enabled Sep 11 08:24:07.749693 dv-cinder-856941-2-smb devstack@keystone.service[81638]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 11 08:24:07.749693 dv-cinder-856941-2-smb devstack@keystone.service[81638]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 11 08:24:07.788712 dv-cinder-856941-2-smb devstack@keystone.service[81638]: Python main interpreter initialized at 0x5555caff59c0 Sep 11 08:24:07.788712 dv-cinder-856941-2-smb devstack@keystone.service[81638]: python threads support enabled Sep 11 08:24:07.788712 dv-cinder-856941-2-smb devstack@keystone.service[81638]: your server socket listen backlog is limited to 100 connections Sep 11 08:24:07.788712 dv-cinder-856941-2-smb devstack@keystone.service[81638]: your mercy for graceful operations on workers is 90 seconds Sep 11 08:24:07.789073 dv-cinder-856941-2-smb devstack@keystone.service[81638]: mapped 403077 bytes (393 KB) for 2 cores Sep 11 08:24:07.789149 dv-cinder-856941-2-smb devstack@keystone.service[81638]: *** Operational MODE: preforking *** Sep 11 08:24:07.789399 dv-cinder-856941-2-smb devstack@keystone.service[81638]: *** uWSGI is running in multiple interpreter mode *** Sep 11 08:24:07.789399 dv-cinder-856941-2-smb devstack@keystone.service[81638]: spawned uWSGI master process (pid: 81638) Sep 11 08:24:07.789611 dv-cinder-856941-2-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 11 08:24:07.791123 dv-cinder-856941-2-smb devstack@keystone.service[81638]: spawned uWSGI worker 1 (pid: 81644, cores: 1) Sep 11 08:24:07.791123 dv-cinder-856941-2-smb devstack@keystone.service[81638]: spawned uWSGI worker 2 (pid: 81645, cores: 1) Sep 11 08:24:07.792659 dv-cinder-856941-2-smb devstack@keystone.service[81638]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 11 08:24:12.220214 dv-cinder-856941-2-smb devstack@keystone.service[81645]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 08:24:12.220214 dv-cinder-856941-2-smb devstack@keystone.service[81645]: from cryptography.utils import int_from_bytes Sep 11 08:24:12.221065 dv-cinder-856941-2-smb devstack@keystone.service[81645]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 08:24:12.221065 dv-cinder-856941-2-smb devstack@keystone.service[81645]: from cryptography.utils import int_from_bytes Sep 11 08:24:12.221455 dv-cinder-856941-2-smb devstack@keystone.service[81644]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 08:24:12.221455 dv-cinder-856941-2-smb devstack@keystone.service[81644]: from cryptography.utils import int_from_bytes Sep 11 08:24:12.222010 dv-cinder-856941-2-smb devstack@keystone.service[81644]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 08:24:12.222010 dv-cinder-856941-2-smb devstack@keystone.service[81644]: from cryptography.utils import int_from_bytes Sep 11 08:24:12.274884 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 08:24:12.275093 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 08:24:12.275183 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 08:24:12.275293 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 08:24:12.275366 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] command line args: [] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 08:24:12.275431 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] command line args: [] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 08:24:12.275547 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 08:24:12.275680 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 08:24:12.275768 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ================================================================================ {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 08:24:12.275851 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ================================================================================ {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 08:24:12.275979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] admin_token = **** {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.276085 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] admin_token = **** {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.276235 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] config_dir = [] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.276321 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] config_dir = [] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.276428 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.276514 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.276617 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] config_source = [] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.276696 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] config_source = [] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.276802 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] debug = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.276887 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] debug = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.277009 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.277302 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.277399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.277466 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.277530 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.277589 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.277775 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.277898 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.278008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.278113 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.278239 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] list_limit = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.278356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] list_limit = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.278461 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] log_config_append = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.278564 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] log_config_append = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.278669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.278780 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.278878 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] log_dir = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.278980 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] log_dir = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.279083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] log_file = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.279180 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] log_file = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.279318 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.279445 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.279536 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.279662 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.279785 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.279905 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.280028 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.280153 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.280278 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.280402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.280519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.280643 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.280767 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.280884 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.280998 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.281113 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.281227 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.281351 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.281457 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.281569 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.281688 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.281802 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.281916 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.282040 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.282161 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.282275 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.282388 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.282526 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.282653 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.282789 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.282906 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.283028 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.283212 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] publish_errors = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.283355 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] publish_errors = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.283487 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.283604 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.283710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.283809 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.283904 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.284052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.284167 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.284333 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.284500 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.284620 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.284736 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] standard_threads = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.284849 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] standard_threads = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.284962 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.285087 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.285209 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.285330 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.285445 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.285559 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.285672 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] use_journal = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.285793 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] use_journal = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.285915 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] use_json = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.285915 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] use_stderr = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.286129 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] use_json = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.286249 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] use_syslog = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.286363 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] use_stderr = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.286363 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] use_syslog = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.286702 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.286817 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:24:12.286931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.287044 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.287168 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.287314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.287454 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.287575 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.287697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.287831 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.287966 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.287966 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.288206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.288338 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.288453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.288578 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.288695 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.288821 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.288936 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.289050 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.289164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.289290 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.289420 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.289588 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.290226 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.290352 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.290457 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.290588 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.290712 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.290837 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.290952 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.291088 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.291207 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.291361 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.291494 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.291611 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.291736 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.291857 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.291979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.292102 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.292225 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.292346 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.292472 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.292627 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.292764 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.292889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.293093 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.293236 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.293369 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.293486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.293600 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.293723 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.293847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.293963 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.293963 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.294184 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.294302 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.294416 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.294416 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.294644 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.294764 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.294884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.294884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.295096 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.295224 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.295355 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.295482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.295598 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.295712 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.295831 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.295956 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.296071 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.296192 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.296305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.296418 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.296531 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.296656 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.296779 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.296913 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.297034 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.297185 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.297310 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.297435 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.297551 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.297667 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.297765 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.297860 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.297956 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.298064 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.298163 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.298268 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.298433 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.298596 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.298772 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.298944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.299100 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.299300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.299478 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.299654 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.299843 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.300033 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.300195 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.300349 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.300498 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.300645 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.300804 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.300954 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.301114 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.301260 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.301418 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.301553 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.301711 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.301861 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.302016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.302164 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.302296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.302437 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.302582 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.302732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.302904 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.303058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.303182 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.303381 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.303528 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.307512 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.307658 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.307751 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.307827 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.307909 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.307982 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.308062 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.308147 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.308221 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.308293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.308363 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.308435 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.308505 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.308585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.308664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.308736 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.308807 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.308878 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.308948 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.309098 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.309175 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.309247 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.309317 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.309388 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.309515 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.309601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.309676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.309746 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.309823 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.309895 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.309966 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.310050 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.310142 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.310280 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.310382 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.310463 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.310536 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.310608 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.310692 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.310772 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.310845 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.310918 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.310989 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.311059 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.311138 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.311212 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.311342 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.311429 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.311514 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.311597 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.311679 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.311753 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.311824 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.311902 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.311974 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.312046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.312125 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.312198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.312270 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.312341 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.312412 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.312483 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.312561 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.312635 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.312707 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.312784 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.312856 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.312928 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.313007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.313081 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.313152 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.313223 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.313300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.313300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.313437 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.313437 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.313567 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.313567 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.313695 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.313695 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.313830 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.313830 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.313961 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.313961 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.314094 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.314166 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.314249 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.314322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.314393 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.314393 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] auth.external = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.314520 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.314628 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.314711 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.314711 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.314946 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.315027 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] auth.external = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.315100 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.315100 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] auth.password = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.315229 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.315370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] auth.token = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.315483 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.315567 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.315640 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.315713 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.315785 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] auth.password = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.315864 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.315950 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] auth.token = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.316025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.316103 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.316176 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.316260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.316334 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.316415 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.316489 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.316561 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.316632 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] credential.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.316703 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.316776 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.316855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.316929 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.317001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.317084 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.317164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] credential.caching = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.317237 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.317317 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.317392 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.317544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.317625 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.317746 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.317837 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.317914 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.317985 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.318113 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.318190 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.318263 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.318411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.318497 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.318572 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.318645 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.318716 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.318787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.318867 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.318942 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.319014 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.319086 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.319157 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.319228 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.319394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] federation.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.319478 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.319550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.319671 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.319748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.319821 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.319901 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.319976 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] federation.caching = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.320047 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.320118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.320189 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.320261 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.320344 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.320418 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.320490 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.320561 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.320632 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.320704 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.320784 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.320858 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.320930 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.320930 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.321059 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.321131 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.321272 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.321356 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.321429 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.321500 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.321572 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.321645 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.321726 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.321801 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.321873 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] identity.caching = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.322025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.322109 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.322257 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.322347 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.322494 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.322575 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.322773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.322853 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.323028 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.323129 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.323271 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.323355 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.323513 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.323592 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.323745 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.323841 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.323990 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.324071 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.324232 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.324311 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.324473 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.324561 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.324710 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.324791 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.324954 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.325036 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.325205 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.325286 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.325446 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.325533 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.325682 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.325762 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.325913 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.325996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.326148 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.326229 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.326378 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.326458 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.326613 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.326702 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.326853 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.326935 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.327091 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.327172 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.327362 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.327705 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.327858 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.327937 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.328103 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.328184 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.328346 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.328428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.328579 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.328658 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.328824 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.328902 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.329067 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.329163 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.329335 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.329447 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.329584 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.329672 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.329809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.329901 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.330046 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.330127 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.330280 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.330370 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.330525 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.330607 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.330759 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.330838 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.331005 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.331136 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.331300 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.331419 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.331510 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.331671 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.331752 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.331903 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.332128 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.332210 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.332376 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.332455 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.332625 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.332707 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.332864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.332945 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.333098 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.333177 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.333337 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.333417 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.333570 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.333652 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.333811 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.333893 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.334054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.334133 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.334291 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.334372 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.334528 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.334607 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.334774 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.334853 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.335043 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.335136 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.335314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.335400 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.335548 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.335627 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.339918 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.340023 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.340138 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.340218 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.340291 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.340364 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.340451 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.340527 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.340642 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.340720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.340792 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.340864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.340945 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.341021 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.341101 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.341174 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.341246 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.341318 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.341401 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.341475 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.341548 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.341621 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.341693 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.341766 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.341846 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.341921 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.341992 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.342064 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.342144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.342218 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.342299 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.342373 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.342445 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.342517 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.342588 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.342735 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.342812 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.342885 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.342957 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.343033 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.343093 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.343172 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.343327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.343407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.343480 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.343552 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.343623 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.343708 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.343782 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.343855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.343927 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.343998 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.344070 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.344153 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.344228 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.344301 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.344372 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] resource.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.344543 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.344622 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.344704 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.344780 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.344852 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.344931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.345005 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.345077 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.345156 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] resource.caching = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.345231 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.345303 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.345375 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.345446 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.345518 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.345601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.345676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.345748 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.345819 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.345891 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.345963 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] role.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.346086 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.346167 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] role.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.346229 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.346287 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.346358 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.346430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.346510 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.346584 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.346657 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] role.caching = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.346728 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.346800 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] role.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.346871 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.346951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.347025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.347097 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.347168 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.347240 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.347332 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.347418 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.347552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.347635 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.347786 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.347892 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.348031 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.348148 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.348278 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.348403 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.348524 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.348659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.348770 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.348899 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.349152 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.349233 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.349408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.349489 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.349662 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.349745 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.349908 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.349998 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.350155 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.350338 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.350428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.350583 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.350664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.350842 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.350923 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.351098 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.351187 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.351381 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.351504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.351627 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.351707 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.351860 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.351954 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.352678 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.352762 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.352939 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.353019 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.353187 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.353277 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.353427 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.353508 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.353667 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.353748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.353906 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.353995 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.354141 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.354228 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.354378 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] token.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.354459 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.354615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.354704 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.354862 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.354943 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.355099 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.355179 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.355357 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.355453 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.355602 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] token.caching = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.355684 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.355843 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.355922 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.356087 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.356175 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.356327 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.356407 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.356570 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.356650 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.356807 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.356896 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.357047 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.357128 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.357281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.357362 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.357529 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.357655 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.357788 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.357916 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.358018 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.358116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.358264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.358396 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.358525 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.358643 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.358767 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.358885 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.connection = **** {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.359000 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.359116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.359263 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.359398 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.359528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.359644 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.359760 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.359877 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.359992 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.360183 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.connection = **** {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.360303 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.360419 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.360537 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.360653 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.360769 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.360894 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.361012 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.361129 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.361244 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.361360 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.361476 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.361585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.361703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.361820 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.361936 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.362052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.362168 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.362292 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.362409 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.362526 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.362643 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.362760 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.362876 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.363000 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.363117 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.363117 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 08:24:12.363389 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.363389 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.363607 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.363736 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.363978 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.364223 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:24:12.364398 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 08:24:12.393168 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.393392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.393503 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.393611 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.393695 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.393847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.402698 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.402943 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.439814 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.440039 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.446476 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.446713 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.505787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.505964 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.566154 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.566377 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.566548 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.566790 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.734073 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.734271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.734382 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.734536 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.734654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.734739 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.734817 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.734893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.734968 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.735060 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.735140 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.735273 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.759515 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.759679 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.759768 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.759903 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.759992 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.760069 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.760144 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.760218 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.760302 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.760433 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.760520 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.760647 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.760731 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.760859 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.771953 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.772411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.784874 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.785098 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.793046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.793046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.793046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.793046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.793046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.794389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.794624 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.794847 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.795073 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.795324 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.795588 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.795806 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 08:24:12.811410 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.811622 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 11 08:24:12.811972 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.812115 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.812223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 11 08:24:12.812330 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 11 08:24:12.812442 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.812677 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.812756 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.812879 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 11 08:24:12.812971 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.813164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.813245 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.813428 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.813689 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.813951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.823737 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.824021 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.824273 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.824359 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.824562 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.824663 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.824835 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.825119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.832476 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:12.832679 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:12.835702 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:12.835872 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:12.836006 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.836090 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.836294 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.836451 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.836585 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.836669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.836879 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.836961 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.837140 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.837232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.837412 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.837496 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.837688 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.837769 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.837956 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.838236 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.838327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.838509 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.838590 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.838869 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.862018 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.863790 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.863977 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:12.863977 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.865141 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:12.865444 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.869522 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:12.869824 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.870114 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.871175 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:12.871521 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.871812 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.876855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:12.877160 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.879007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:12.879345 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.883971 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:12.884294 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.884582 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.884864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.885144 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.885423 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.885696 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.885966 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.887413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:12.887742 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.890416 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.890416 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.890416 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.890416 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.890416 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.890416 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.901935 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.902225 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.905987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.906214 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:12.906303 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.909514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.909874 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.910339 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:12.919091 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.919232 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:12.919348 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.919428 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:12.919502 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:12.920428 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.920739 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.921025 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.921318 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.921602 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.921717 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:12.921898 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.925079 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.925389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.925689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.925980 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.926275 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.926581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.938103 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:12.938398 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.938663 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.938923 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.943320 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:12.943670 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.943944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.944209 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.945792 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.947919 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.949438 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.949719 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.951836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.952756 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:12.953044 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.953335 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.953617 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.953700 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.954004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.955397 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.955679 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.958467 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:12.958753 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.959040 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.959361 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.964832 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.965086 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:12.965376 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.965659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.965948 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.966330 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.966614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.966893 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.971340 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:12.971603 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.971889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.972175 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.972560 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.972847 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.973132 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.982149 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:12.985063 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:12.987952 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.989063 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:12.989421 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.990863 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:12.991151 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.991576 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.992020 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:12.995711 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.997208 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.998667 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.998764 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:12.999036 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:12.999472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.000152 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:13.002980 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.003405 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.003693 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.003973 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.005866 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.011072 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:13.011072 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.011382 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.011581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.011864 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.012345 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:13.012648 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.012928 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.019751 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:13.019851 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:13.020034 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.020134 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.020313 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.020430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.020589 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.020861 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.021133 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.021405 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.021701 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.021968 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.022237 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.022517 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.022781 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.023046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.023339 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.028417 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 08:24:13.028708 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.028995 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.029277 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.029556 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.029835 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.030128 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.030413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.030694 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.030977 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.031272 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.031549 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.031827 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.032167 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 08:24:13.058234 dv-cinder-856941-2-smb devstack@keystone.service[81645]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5555caff59c0 pid: 81645 (default app) Sep 11 08:24:13.061641 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce0642-765e-4aa1-a23e-86a8d382b968 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:13.061928 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce0642-765e-4aa1-a23e-86a8d382b968 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:13.062202 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce0642-765e-4aa1-a23e-86a8d382b968 None None] PATH_INFO: `/v3` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:13.066348 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Sun Sep 11 08:24:13 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:13.067698 dv-cinder-856941-2-smb devstack@keystone.service[81644]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5555caff59c0 pid: 81644 (default app) Sep 11 08:24:21.277453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165451a8-f410-4a76-b40c-33c5fbde5c8a None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:21.278063 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165451a8-f410-4a76-b40c-33c5fbde5c8a None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:21.278063 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165451a8-f410-4a76-b40c-33c5fbde5c8a None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:21.279339 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:24:21.286876 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822665a-b402-4282-8a34-85aa59849053 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:21.287463 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822665a-b402-4282-8a34-85aa59849053 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:21.287463 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822665a-b402-4282-8a34-85aa59849053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:21.360218 dv-cinder-856941-2-smb devstack@keystone.service[81644]: INFO dbcounter [None req-d822665a-b402-4282-8a34-85aa59849053 None None] Registered counter for database keystone Sep 11 08:24:21.381509 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG oslo_db.sqlalchemy.engines [None req-d822665a-b402-4282-8a34-85aa59849053 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81644) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 08:24:21.388000 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writer thread running {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 08:24:21.571189 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG passlib.handlers.bcrypt [None req-d822665a-b402-4282-8a34-85aa59849053 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81644) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 11 08:24:21.571526 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG passlib.handlers.bcrypt [None req-d822665a-b402-4282-8a34-85aa59849053 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81644) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 11 08:24:21.629844 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-d822665a-b402-4282-8a34-85aa59849053 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:24:21.631494 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d822665a-b402-4282-8a34-85aa59849053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:24:21.760117 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1/3] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:24:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 476 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 11 08:24:22.063553 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165451a8-f410-4a76-b40c-33c5fbde5c8a None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:22.133136 dv-cinder-856941-2-smb devstack@keystone.service[81645]: INFO dbcounter [None req-165451a8-f410-4a76-b40c-33c5fbde5c8a None None] Registered counter for database keystone Sep 11 08:24:22.153101 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG oslo_db.sqlalchemy.engines [None req-165451a8-f410-4a76-b40c-33c5fbde5c8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81645) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 08:24:22.161005 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writer thread running {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 08:24:22.280005 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165451a8-f410-4a76-b40c-33c5fbde5c8a None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:22.284626 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0051335-0193-49da-844f-dda5c961cee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:22.285259 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0051335-0193-49da-844f-dda5c961cee9 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:22.285543 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0051335-0193-49da-844f-dda5c961cee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:22.285819 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0051335-0193-49da-844f-dda5c961cee9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:22.294530 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0051335-0193-49da-844f-dda5c961cee9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:22.346704 dv-cinder-856941-2-smb devstack@keystone.service[81645]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f0051335-0193-49da-844f-dda5c961cee9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 11 08:24:22.346981 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0051335-0193-49da-844f-dda5c961cee9 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:22.356944 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 3/4] 10.222.0.26 () {58 vars in 1324 bytes} [Sun Sep 11 08:24:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 08:24:22.363065 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822665a-b402-4282-8a34-85aa59849053 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:22.378446 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822665a-b402-4282-8a34-85aa59849053 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:22.382954 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345dce3-85d0-4160-bee9-72c31a4756c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:22.384121 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345dce3-85d0-4160-bee9-72c31a4756c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:22.384405 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345dce3-85d0-4160-bee9-72c31a4756c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:22.384678 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345dce3-85d0-4160-bee9-72c31a4756c3 admin admin] PATH_INFO: `/v3/projects/10a12f84e22947cf95a2bfc7124d42aa` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:22.386740 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2345dce3-85d0-4160-bee9-72c31a4756c3 admin admin] RBAC: Authorizing `identity:get_project(project_id=10a12f84e22947cf95a2bfc7124d42aa)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:22.438913 dv-cinder-856941-2-smb devstack@keystone.service[81644]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2345dce3-85d0-4160-bee9-72c31a4756c3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 11 08:24:22.439277 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2345dce3-85d0-4160-bee9-72c31a4756c3 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:22.443825 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 2/5] 10.222.0.26 () {56 vars in 1207 bytes} [Sun Sep 11 08:24:22 2022] GET /identity/v3/projects/10a12f84e22947cf95a2bfc7124d42aa => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:24.594270 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c869238-1956-48ae-b565-44a5f6f94ddd None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:24.594822 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c869238-1956-48ae-b565-44a5f6f94ddd None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:24.594822 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c869238-1956-48ae-b565-44a5f6f94ddd None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:24.598933 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 4/6] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:24:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:24:24.605065 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116bfb2-66d3-4298-9128-7f24d340ecb5 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:24.605494 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116bfb2-66d3-4298-9128-7f24d340ecb5 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:24.605620 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116bfb2-66d3-4298-9128-7f24d340ecb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:24.625344 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-7116bfb2-66d3-4298-9128-7f24d340ecb5 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:24:24.626866 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7116bfb2-66d3-4298-9128-7f24d340ecb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:24:24.634785 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 3/7] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:24:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 11 08:24:24.899727 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c869238-1956-48ae-b565-44a5f6f94ddd None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:24.912475 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c869238-1956-48ae-b565-44a5f6f94ddd None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:24.916757 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5194b-7a49-4a61-8b7d-f8df67b286f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:24.917372 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5194b-7a49-4a61-8b7d-f8df67b286f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:24.917659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5194b-7a49-4a61-8b7d-f8df67b286f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:24.917939 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5194b-7a49-4a61-8b7d-f8df67b286f8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:24.925558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5194b-7a49-4a61-8b7d-f8df67b286f8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:24.927371 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5194b-7a49-4a61-8b7d-f8df67b286f8 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:24.936075 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 5/8] 10.222.0.26 () {58 vars in 1324 bytes} [Sun Sep 11 08:24:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 08:24:24.941550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116bfb2-66d3-4298-9128-7f24d340ecb5 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:24.951338 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116bfb2-66d3-4298-9128-7f24d340ecb5 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:24.956040 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9ac3e-b77f-4e55-b2cd-d995cc2c994b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:24.956673 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9ac3e-b77f-4e55-b2cd-d995cc2c994b admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:24.956949 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9ac3e-b77f-4e55-b2cd-d995cc2c994b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:24.957222 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9ac3e-b77f-4e55-b2cd-d995cc2c994b admin admin] PATH_INFO: `/v3/users/3488db0374224de0980821b4dd705941` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:24.958551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9ac3e-b77f-4e55-b2cd-d995cc2c994b admin admin] RBAC: Authorizing `identity:get_user(user_id=3488db0374224de0980821b4dd705941)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:24.960433 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9ac3e-b77f-4e55-b2cd-d995cc2c994b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:24.961983 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 4/9] 10.222.0.26 () {56 vars in 1198 bytes} [Sun Sep 11 08:24:24 2022] GET /identity/v3/users/3488db0374224de0980821b4dd705941 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:27.226835 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31720bae-9eca-43cb-8a18-d3e958ab276e None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:27.227424 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31720bae-9eca-43cb-8a18-d3e958ab276e None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:27.227424 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31720bae-9eca-43cb-8a18-d3e958ab276e None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:27.229031 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:24:27.234937 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a3c8e-6a75-4fd0-9e33-20b1d56a782b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:27.235411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a3c8e-6a75-4fd0-9e33-20b1d56a782b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:27.235657 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a3c8e-6a75-4fd0-9e33-20b1d56a782b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:27.254178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-5c4a3c8e-6a75-4fd0-9e33-20b1d56a782b None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:24:27.255402 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5c4a3c8e-6a75-4fd0-9e33-20b1d56a782b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:24:27.268797 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5264e-d3b5-461f-bcf7-b6195e411bbe None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:27.269086 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5264e-d3b5-461f-bcf7-b6195e411bbe None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:27.269369 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5264e-d3b5-461f-bcf7-b6195e411bbe None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:27.270769 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 7/11] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:24:27.276997 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617f82e-757a-4883-b3b5-83b31c132a3f None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:27.277383 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617f82e-757a-4883-b3b5-83b31c132a3f None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:27.277736 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617f82e-757a-4883-b3b5-83b31c132a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:27.321487 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG passlib.handlers.bcrypt [None req-f617f82e-757a-4883-b3b5-83b31c132a3f None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81645) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 11 08:24:27.321865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG passlib.handlers.bcrypt [None req-f617f82e-757a-4883-b3b5-83b31c132a3f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81645) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 11 08:24:27.349917 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 5/12] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:24:27.371877 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-f617f82e-757a-4883-b3b5-83b31c132a3f None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:24:27.373484 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f617f82e-757a-4883-b3b5-83b31c132a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:24:27.476136 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 8/13] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 08:24:27.613695 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a3c8e-6a75-4fd0-9e33-20b1d56a782b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:27.637646 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:27.720242 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a3c8e-6a75-4fd0-9e33-20b1d56a782b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:27.753722 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617f82e-757a-4883-b3b5-83b31c132a3f None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:27.756568 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eeff55-a5a4-4aa8-b46f-a338ce012a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:27.758110 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eeff55-a5a4-4aa8-b46f-a338ce012a3d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:27.758398 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eeff55-a5a4-4aa8-b46f-a338ce012a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:27.758674 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eeff55-a5a4-4aa8-b46f-a338ce012a3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:27.771056 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eeff55-a5a4-4aa8-b46f-a338ce012a3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:24:27.780412 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-c1eeff55-a5a4-4aa8-b46f-a338ce012a3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:24:27.780412 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:24:27.780412 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:24:27.780412 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:24:27.780412 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:24:27.780412 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:24:27.780412 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:24:27.780412 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:24:27.780412 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:24:27.780412 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:24:27.780412 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:24:27.780412 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:24:27.780412 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:24:27.780412 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:24:27.780412 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:24:27.780412 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:24:27.781787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:24:27.781787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:24:27.781787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:24:27.781787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:24:27.781787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:24:27.781787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:24:27.781787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:24:27.781787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:24:27.781787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:24:27.781787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:24:27.781787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:24:27.781787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:24:27.781787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:24:27.781787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:24:27.781787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:24:27.781787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:24:27.782682 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:24:27.782682 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:24:27.782682 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:24:27.782682 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:24:27.782682 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:24:27.782682 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:24:27.782682 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:24:27.782682 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:24:27.782682 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:24:27.782682 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:24:27.782682 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:24:27.782682 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:24:27.782682 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 6/14] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:24:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:24:27.787795 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eeff55-a5a4-4aa8-b46f-a338ce012a3d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:27.859216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617f82e-757a-4883-b3b5-83b31c132a3f None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:27.861721 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:27.877415 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:27.895488 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eeff55-a5a4-4aa8-b46f-a338ce012a3d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:27.901371 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace14d10-99cb-4cee-9dd0-9460c3b98f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:27.902350 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace14d10-99cb-4cee-9dd0-9460c3b98f9c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:27.902645 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace14d10-99cb-4cee-9dd0-9460c3b98f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:27.902934 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace14d10-99cb-4cee-9dd0-9460c3b98f9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:27.936474 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34c7ab-dad4-418c-89c1-d615006b1d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:27.937102 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34c7ab-dad4-418c-89c1-d615006b1d4f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:27.937382 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34c7ab-dad4-418c-89c1-d615006b1d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:27.937658 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34c7ab-dad4-418c-89c1-d615006b1d4f None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:27.938346 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34c7ab-dad4-418c-89c1-d615006b1d4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:24:27.938652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34c7ab-dad4-418c-89c1-d615006b1d4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:27.940103 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34c7ab-dad4-418c-89c1-d615006b1d4f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:27.953574 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 7/15] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:24:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:24:27.959277 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34c7ab-dad4-418c-89c1-d615006b1d4f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:27.978295 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace14d10-99cb-4cee-9dd0-9460c3b98f9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:27.980398 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace14d10-99cb-4cee-9dd0-9460c3b98f9c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:28.099944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34c7ab-dad4-418c-89c1-d615006b1d4f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:28.106940 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 9/16] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:24:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 08:24:28.112819 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace14d10-99cb-4cee-9dd0-9460c3b98f9c None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:28.115768 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:28.146365 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d479d51-1b05-496f-b4cb-c6548a54262b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:28.147430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d479d51-1b05-496f-b4cb-c6548a54262b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:28.147941 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d479d51-1b05-496f-b4cb-c6548a54262b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:28.148362 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d479d51-1b05-496f-b4cb-c6548a54262b None admin] PATH_INFO: `/v3/users/3488db0374224de0980821b4dd705941` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:28.150402 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d479d51-1b05-496f-b4cb-c6548a54262b None admin] RBAC: Authorizing `identity:get_user(user_id=3488db0374224de0980821b4dd705941)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:28.153673 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d479d51-1b05-496f-b4cb-c6548a54262b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:28.161128 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 8/17] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:24:27 2022] GET /identity/v3/users/3488db0374224de0980821b4dd705941 => generated 247 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:24:28.162591 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d479d51-1b05-496f-b4cb-c6548a54262b None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:28.182255 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:28.223022 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace14d10-99cb-4cee-9dd0-9460c3b98f9c None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:28.262895 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081a825-7f87-425f-bf3e-17630a5fa374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:28.263985 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081a825-7f87-425f-bf3e-17630a5fa374 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:28.264145 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081a825-7f87-425f-bf3e-17630a5fa374 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:28.264337 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081a825-7f87-425f-bf3e-17630a5fa374 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:28.285392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b081a825-7f87-425f-bf3e-17630a5fa374 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:28.286908 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b081a825-7f87-425f-bf3e-17630a5fa374 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:28.292809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d479d51-1b05-496f-b4cb-c6548a54262b None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:28.307293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-b081a825-7f87-425f-bf3e-17630a5fa374 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:24:28.307293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:24:28.307293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:24:28.307293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:24:28.307293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:24:28.307293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:24:28.307293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:24:28.307293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:24:28.307293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:24:28.307293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:24:28.307293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:24:28.307293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:24:28.307293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:24:28.307293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:24:28.307293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:24:28.307293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:24:28.308314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:24:28.308314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:24:28.308314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:24:28.308314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:24:28.308314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:24:28.308314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:24:28.308314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:24:28.308314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:24:28.308314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:24:28.308314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:24:28.308314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:24:28.308314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:24:28.308314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:24:28.308314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:24:28.308314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:24:28.308314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:24:28.308314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:24:28.309121 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:24:28.309121 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:24:28.309121 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:24:28.309121 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 10/18] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:24:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:24:28.314439 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081a825-7f87-425f-bf3e-17630a5fa374 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:28.336999 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301048d1-4aa8-4555-853d-c4c967b64dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:28.337998 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301048d1-4aa8-4555-853d-c4c967b64dce None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:28.339047 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301048d1-4aa8-4555-853d-c4c967b64dce None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:28.339544 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301048d1-4aa8-4555-853d-c4c967b64dce None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:28.341372 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301048d1-4aa8-4555-853d-c4c967b64dce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:28.343761 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301048d1-4aa8-4555-853d-c4c967b64dce None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:28.346429 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 9/19] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:24:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:24:28.352410 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301048d1-4aa8-4555-853d-c4c967b64dce None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:28.388260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:28.444968 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081a825-7f87-425f-bf3e-17630a5fa374 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:28.446297 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:28.468316 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301048d1-4aa8-4555-853d-c4c967b64dce None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:28.487991 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8296e-d867-40dd-823a-992c8c4a528e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:28.488687 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8296e-d867-40dd-823a-992c8c4a528e None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:28.488969 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8296e-d867-40dd-823a-992c8c4a528e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:28.489256 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8296e-d867-40dd-823a-992c8c4a528e None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:28.489930 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8296e-d867-40dd-823a-992c8c4a528e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:24:28.490231 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8296e-d867-40dd-823a-992c8c4a528e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:28.491711 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8296e-d867-40dd-823a-992c8c4a528e None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:28.507691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38147e49-3344-4f60-bc3b-6d1d4cc3c525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:28.508419 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38147e49-3344-4f60-bc3b-6d1d4cc3c525 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:28.508730 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38147e49-3344-4f60-bc3b-6d1d4cc3c525 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:28.509001 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38147e49-3344-4f60-bc3b-6d1d4cc3c525 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:28.509762 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38147e49-3344-4f60-bc3b-6d1d4cc3c525 None admin] RBAC: Adding query filter params (role.id=d12af9f1dfb344cd8a6a493e165030ba, scope.domain.id=default, user.id=3488db0374224de0980821b4dd705941) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:24:28.510078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38147e49-3344-4f60-bc3b-6d1d4cc3c525 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:28.512100 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 11/20] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:24:28.512270 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38147e49-3344-4f60-bc3b-6d1d4cc3c525 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:28.520797 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 10/21] 10.222.0.26 () {56 vars in 1322 bytes} [Sun Sep 11 08:24:28 2022] GET /identity/v3/role_assignments?user.id=3488db0374224de0980821b4dd705941&scope.domain.id=default&role.id=d12af9f1dfb344cd8a6a493e165030ba => generated 233 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:24:32.412678 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cfe14-2ff1-4391-8688-e93d1ba4b01c None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:32.414189 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cfe14-2ff1-4391-8688-e93d1ba4b01c None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:32.414928 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cfe14-2ff1-4391-8688-e93d1ba4b01c None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:32.418329 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 12/22] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:24:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:24:32.427706 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ae2df-3aaf-408e-8a7a-b381b0a455fb None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:32.429138 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ae2df-3aaf-408e-8a7a-b381b0a455fb None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:32.429866 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ae2df-3aaf-408e-8a7a-b381b0a455fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:32.489086 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-fc9ae2df-3aaf-408e-8a7a-b381b0a455fb None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:24:32.491814 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-fc9ae2df-3aaf-408e-8a7a-b381b0a455fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:24:32.539757 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c76981-f2c6-466f-ad28-a0963d3818a1 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:32.540769 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c76981-f2c6-466f-ad28-a0963d3818a1 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:32.542317 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c76981-f2c6-466f-ad28-a0963d3818a1 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:32.550136 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 13/23] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:24:32 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:24:32.576441 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b71a1-a004-4964-ace3-27f524245a10 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:32.581700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b71a1-a004-4964-ace3-27f524245a10 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:32.582719 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b71a1-a004-4964-ace3-27f524245a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:32.639553 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-6b0b71a1-a004-4964-ace3-27f524245a10 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:24:32.641563 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6b0b71a1-a004-4964-ace3-27f524245a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:24:32.668574 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 11/24] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:24:32.786008 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 14/25] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:24:33.043209 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fece01-2ef1-4fd2-aab2-68dc08e031fe None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:33.043608 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fece01-2ef1-4fd2-aab2-68dc08e031fe None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:33.043800 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fece01-2ef1-4fd2-aab2-68dc08e031fe None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:33.045372 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 12/26] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:24:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:24:33.051358 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9674f-e4ee-4975-8596-0ea24e490664 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:33.051680 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9674f-e4ee-4975-8596-0ea24e490664 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:33.051929 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9674f-e4ee-4975-8596-0ea24e490664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:33.088124 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-37b9674f-e4ee-4975-8596-0ea24e490664 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:24:33.090264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-37b9674f-e4ee-4975-8596-0ea24e490664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:24:33.174713 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:33.206693 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 15/27] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:24:33.284061 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fece01-2ef1-4fd2-aab2-68dc08e031fe None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:33.362931 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9674f-e4ee-4975-8596-0ea24e490664 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:33.405378 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:33.470062 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fece01-2ef1-4fd2-aab2-68dc08e031fe None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:33.557449 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538639e-c168-48de-b603-42d259527b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:33.558134 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538639e-c168-48de-b603-42d259527b92 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:33.558423 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538639e-c168-48de-b603-42d259527b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:33.558703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538639e-c168-48de-b603-42d259527b92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:33.596522 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538639e-c168-48de-b603-42d259527b92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:24:33.606710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-1538639e-c168-48de-b603-42d259527b92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:24:33.606710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:24:33.606710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:24:33.606710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:24:33.606710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:24:33.606710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:24:33.606710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:24:33.606710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:24:33.606710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:24:33.606710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:24:33.606710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:24:33.606710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:24:33.606710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:24:33.606710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:24:33.606710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:24:33.606710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:24:33.608464 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:24:33.608464 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:24:33.608464 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:24:33.608464 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:24:33.608464 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:24:33.608464 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:24:33.608464 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:24:33.608464 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:24:33.608464 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:24:33.608464 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:24:33.608464 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:24:33.608464 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:24:33.608464 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:24:33.608464 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:24:33.608464 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:24:33.608464 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:24:33.609857 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:24:33.609857 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:24:33.609857 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:24:33.609857 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:24:33.609857 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:24:33.609857 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:24:33.609857 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:24:33.609857 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:24:33.609857 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:24:33.609857 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:24:33.609857 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:24:33.609857 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:24:33.609857 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 13/28] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:24:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:24:33.609857 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18c185-89bc-43e3-ae8c-dbb60c0e48d4 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:33.611051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18c185-89bc-43e3-ae8c-dbb60c0e48d4 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:33.611051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18c185-89bc-43e3-ae8c-dbb60c0e48d4 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:33.616670 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 14/29] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:24:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:24:33.617500 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18c185-89bc-43e3-ae8c-dbb60c0e48d4 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:33.632039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9674f-e4ee-4975-8596-0ea24e490664 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:33.680569 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0621a9b-a51e-4d09-b140-37f765bee226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:33.682252 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0621a9b-a51e-4d09-b140-37f765bee226 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:33.683029 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0621a9b-a51e-4d09-b140-37f765bee226 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:33.683651 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0621a9b-a51e-4d09-b140-37f765bee226 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:33.700992 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0621a9b-a51e-4d09-b140-37f765bee226 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:33.703554 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0621a9b-a51e-4d09-b140-37f765bee226 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:33.722738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-d0621a9b-a51e-4d09-b140-37f765bee226 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:24:33.722738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:24:33.722738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:24:33.722738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:24:33.722738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:24:33.722738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:24:33.722738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:24:33.722738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:24:33.722738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:24:33.722738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:24:33.722738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:24:33.722738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:24:33.722738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:24:33.722738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:24:33.722738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:24:33.722738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:24:33.723689 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:24:33.723689 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:24:33.723689 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:24:33.723689 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:24:33.723689 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:24:33.723689 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:24:33.723689 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:24:33.723689 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:24:33.723689 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:24:33.723689 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:24:33.723689 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:24:33.723689 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:24:33.723689 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:24:33.723689 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:24:33.723689 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:24:33.723689 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:24:33.723689 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:24:33.724512 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:24:33.724512 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:24:33.724512 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:24:33.726480 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 16/30] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:24:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:24:33.728338 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3535d8-d290-4598-b424-d2899fc6c5c4 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:33.729809 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3535d8-d290-4598-b424-d2899fc6c5c4 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:33.730393 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3535d8-d290-4598-b424-d2899fc6c5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:33.752351 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-6a3535d8-d290-4598-b424-d2899fc6c5c4 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:24:33.754152 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6a3535d8-d290-4598-b424-d2899fc6c5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:24:33.786784 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:33.839100 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18c185-89bc-43e3-ae8c-dbb60c0e48d4 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:33.860983 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 17/31] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:24:33.862241 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3535d8-d290-4598-b424-d2899fc6c5c4 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:33.941315 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1858fc-508e-4543-a2bb-030facd04a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:33.942658 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1858fc-508e-4543-a2bb-030facd04a49 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:33.943196 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1858fc-508e-4543-a2bb-030facd04a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:33.943751 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1858fc-508e-4543-a2bb-030facd04a49 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:33.945213 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1858fc-508e-4543-a2bb-030facd04a49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:24:33.945779 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1858fc-508e-4543-a2bb-030facd04a49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:33.948181 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1858fc-508e-4543-a2bb-030facd04a49 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:33.955303 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:33.977030 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 15/32] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:24:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:33.978528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1858fc-508e-4543-a2bb-030facd04a49 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:33.999447 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3535d8-d290-4598-b424-d2899fc6c5c4 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:34.067364 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f122318-4111-4323-9db3-f476225ded1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:34.068204 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f122318-4111-4323-9db3-f476225ded1e None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:34.068565 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f122318-4111-4323-9db3-f476225ded1e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:34.068921 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f122318-4111-4323-9db3-f476225ded1e None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:34.069720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f122318-4111-4323-9db3-f476225ded1e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:34.071389 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f122318-4111-4323-9db3-f476225ded1e None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:34.112222 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1858fc-508e-4543-a2bb-030facd04a49 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:34.154224 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3ec02-fc9a-454f-baf1-562aae134b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:34.154909 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3ec02-fc9a-454f-baf1-562aae134b76 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:34.155202 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3ec02-fc9a-454f-baf1-562aae134b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:34.155564 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3ec02-fc9a-454f-baf1-562aae134b76 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:34.156562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3ec02-fc9a-454f-baf1-562aae134b76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:24:34.156873 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3ec02-fc9a-454f-baf1-562aae134b76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:34.158541 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3ec02-fc9a-454f-baf1-562aae134b76 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:34.180921 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 16/33] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:34.181817 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3ec02-fc9a-454f-baf1-562aae134b76 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:34.263817 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:34.303657 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3ec02-fc9a-454f-baf1-562aae134b76 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:34.330101 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 18/34] 10.222.0.26 () {60 vars in 1131 bytes} [Sun Sep 11 08:24:33 2022] POST /identity/v3/roles => generated 219 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:24:34.331154 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f122318-4111-4323-9db3-f476225ded1e None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:34.346879 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9cbec0-1549-4510-a703-abbd9881aae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:34.348092 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cbec0-1549-4510-a703-abbd9881aae7 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:34.348611 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cbec0-1549-4510-a703-abbd9881aae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:34.349171 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cbec0-1549-4510-a703-abbd9881aae7 None admin] PATH_INFO: `/v3/users/3488db0374224de0980821b4dd705941` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:34.350825 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9cbec0-1549-4510-a703-abbd9881aae7 None admin] RBAC: Authorizing `identity:get_user(user_id=3488db0374224de0980821b4dd705941)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:34.352739 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9cbec0-1549-4510-a703-abbd9881aae7 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:34.355762 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 17/35] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:24:34 2022] GET /identity/v3/users/3488db0374224de0980821b4dd705941 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:34.357546 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1b8e7-7153-4fd9-ae28-bc7f0905de7c None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:34.358060 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1b8e7-7153-4fd9-ae28-bc7f0905de7c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:34.358535 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1b8e7-7153-4fd9-ae28-bc7f0905de7c None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:34.360186 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 18/36] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:24:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:24:34.361219 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1b8e7-7153-4fd9-ae28-bc7f0905de7c None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:34.375396 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:34.476489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f122318-4111-4323-9db3-f476225ded1e None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:34.495917 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1b8e7-7153-4fd9-ae28-bc7f0905de7c None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:34.517288 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96713109-b4bf-4c02-84a8-6bc7bb45309b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:34.517843 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96713109-b4bf-4c02-84a8-6bc7bb45309b None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:34.518128 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96713109-b4bf-4c02-84a8-6bc7bb45309b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:34.518409 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96713109-b4bf-4c02-84a8-6bc7bb45309b None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:34.519384 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96713109-b4bf-4c02-84a8-6bc7bb45309b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:34.521004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96713109-b4bf-4c02-84a8-6bc7bb45309b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:34.526485 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:34.540078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceeb6ad-90ac-42d9-a9b3-da894e4f6f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:34.540781 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceeb6ad-90ac-42d9-a9b3-da894e4f6f61 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:34.541068 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceeb6ad-90ac-42d9-a9b3-da894e4f6f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:34.541382 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceeb6ad-90ac-42d9-a9b3-da894e4f6f61 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:34.542093 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceeb6ad-90ac-42d9-a9b3-da894e4f6f61 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:34.543573 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceeb6ad-90ac-42d9-a9b3-da894e4f6f61 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:34.645394 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 19/37] 10.222.0.26 () {60 vars in 1141 bytes} [Sun Sep 11 08:24:34 2022] POST /identity/v3/projects => generated 301 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:24:34.646290 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96713109-b4bf-4c02-84a8-6bc7bb45309b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:34.758964 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:34.772274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 19/38] 10.222.0.26 () {60 vars in 1131 bytes} [Sun Sep 11 08:24:34 2022] POST /identity/v3/roles => generated 225 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:24:34.772274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe71805-4f47-478c-99f8-336b408e3217 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:34.772274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe71805-4f47-478c-99f8-336b408e3217 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:34.772274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe71805-4f47-478c-99f8-336b408e3217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:34.796999 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-dfe71805-4f47-478c-99f8-336b408e3217 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:24:34.799562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-dfe71805-4f47-478c-99f8-336b408e3217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:24:34.824009 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96713109-b4bf-4c02-84a8-6bc7bb45309b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:34.893042 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da774192-6fdf-4909-a3ab-e0ffe0816aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:34.893730 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da774192-6fdf-4909-a3ab-e0ffe0816aea None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:34.894018 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da774192-6fdf-4909-a3ab-e0ffe0816aea None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:34.895020 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da774192-6fdf-4909-a3ab-e0ffe0816aea None admin] PATH_INFO: `/v3/domains/default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:34.896949 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 20/39] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:24:34.898282 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad80558-6f54-40d2-8206-02038f8145b2 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:34.898578 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad80558-6f54-40d2-8206-02038f8145b2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:34.898861 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad80558-6f54-40d2-8206-02038f8145b2 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:34.900225 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 21/40] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:24:34.901073 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da774192-6fdf-4909-a3ab-e0ffe0816aea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:34.902573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da774192-6fdf-4909-a3ab-e0ffe0816aea None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:34.904278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 20/41] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:24:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:34.910297 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ca77f-85c8-4f6c-82d0-305e08bdcf8c None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:34.910615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ca77f-85c8-4f6c-82d0-305e08bdcf8c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:34.910859 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ca77f-85c8-4f6c-82d0-305e08bdcf8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:34.912286 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da774192-6fdf-4909-a3ab-e0ffe0816aea None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:34.933085 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-063ca77f-85c8-4f6c-82d0-305e08bdcf8c None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:24:34.934330 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-063ca77f-85c8-4f6c-82d0-305e08bdcf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:24:35.052216 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 22/42] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:24:35.068563 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da774192-6fdf-4909-a3ab-e0ffe0816aea None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:35.113166 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf0c8d-ac55-445c-8421-311214fb1dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:35.114278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf0c8d-ac55-445c-8421-311214fb1dce None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:35.114765 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf0c8d-ac55-445c-8421-311214fb1dce None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:35.115286 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf0c8d-ac55-445c-8421-311214fb1dce None admin] PATH_INFO: `/v3/domains/default/users/3488db0374224de0980821b4dd705941/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:35.117966 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf0c8d-ac55-445c-8421-311214fb1dce None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3488db0374224de0980821b4dd705941, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:35.120639 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf0c8d-ac55-445c-8421-311214fb1dce None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:35.195677 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ca77f-85c8-4f6c-82d0-305e08bdcf8c None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:35.223577 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:35.232092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 21/43] 10.222.0.26 () {58 vars in 1361 bytes} [Sun Sep 11 08:24:34 2022] PUT /identity/v3/domains/default/users/3488db0374224de0980821b4dd705941/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:24:35.340732 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf0c8d-ac55-445c-8421-311214fb1dce None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:35.365374 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:35.432663 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ca77f-85c8-4f6c-82d0-305e08bdcf8c None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:35.467016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf0c8d-ac55-445c-8421-311214fb1dce None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:35.471745 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25e6c3-136d-45ff-82f9-3e8261dce1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:35.472608 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25e6c3-136d-45ff-82f9-3e8261dce1fc None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:35.473043 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25e6c3-136d-45ff-82f9-3e8261dce1fc None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:35.473559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25e6c3-136d-45ff-82f9-3e8261dce1fc None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:35.474395 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25e6c3-136d-45ff-82f9-3e8261dce1fc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:35.476131 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25e6c3-136d-45ff-82f9-3e8261dce1fc None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:35.505268 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ffc22-05cd-4982-a1ba-1115a4a56319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:35.505920 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ffc22-05cd-4982-a1ba-1115a4a56319 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:35.506208 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ffc22-05cd-4982-a1ba-1115a4a56319 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:35.506483 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ffc22-05cd-4982-a1ba-1115a4a56319 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:35.507724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ffc22-05cd-4982-a1ba-1115a4a56319 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:35.509225 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ffc22-05cd-4982-a1ba-1115a4a56319 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:35.510987 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 22/44] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:24:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:24:35.516872 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ffc22-05cd-4982-a1ba-1115a4a56319 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:35.553898 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 23/45] 10.222.0.26 () {60 vars in 1131 bytes} [Sun Sep 11 08:24:35 2022] POST /identity/v3/roles => generated 223 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:24:35.603946 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:35.645113 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ffc22-05cd-4982-a1ba-1115a4a56319 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:35.687013 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c92e19-60d9-4fa7-9e16-570008c6dc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:35.687695 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c92e19-60d9-4fa7-9e16-570008c6dc67 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:35.690587 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c92e19-60d9-4fa7-9e16-570008c6dc67 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:35.690587 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c92e19-60d9-4fa7-9e16-570008c6dc67 None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:35.690587 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c92e19-60d9-4fa7-9e16-570008c6dc67 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:35.690587 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c92e19-60d9-4fa7-9e16-570008c6dc67 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:35.760654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 23/46] 10.222.0.26 () {60 vars in 1141 bytes} [Sun Sep 11 08:24:35 2022] POST /identity/v3/projects => generated 312 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:24:37.446130 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299fb93-967b-4a62-96e3-1fb50ddd85a0 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:37.446691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299fb93-967b-4a62-96e3-1fb50ddd85a0 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:37.446691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299fb93-967b-4a62-96e3-1fb50ddd85a0 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:37.448610 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 24/47] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:24:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:24:37.454595 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78ed83-4475-4358-83a9-ba8e02730a32 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:37.455495 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78ed83-4475-4358-83a9-ba8e02730a32 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:37.455495 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78ed83-4475-4358-83a9-ba8e02730a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:37.475326 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-9f78ed83-4475-4358-83a9-ba8e02730a32 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:24:37.477000 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9f78ed83-4475-4358-83a9-ba8e02730a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:24:37.548606 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 24/48] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:24:37.815053 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299fb93-967b-4a62-96e3-1fb50ddd85a0 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:37.926295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299fb93-967b-4a62-96e3-1fb50ddd85a0 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:37.928694 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:37.949100 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea3f25-eb66-4f11-9f29-d881d0f70ee6 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:37.949402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea3f25-eb66-4f11-9f29-d881d0f70ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:37.949686 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea3f25-eb66-4f11-9f29-d881d0f70ee6 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:37.951076 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 25/49] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:24:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:24:37.956737 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd2ae4-4a97-4a2a-97fd-74b3f99f38c9 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:37.957051 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd2ae4-4a97-4a2a-97fd-74b3f99f38c9 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:37.957325 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd2ae4-4a97-4a2a-97fd-74b3f99f38c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:37.962173 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64162ce0-2676-4879-9156-872736fe174b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:37.962829 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64162ce0-2676-4879-9156-872736fe174b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:37.963125 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64162ce0-2676-4879-9156-872736fe174b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:37.963466 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64162ce0-2676-4879-9156-872736fe174b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:37.975533 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64162ce0-2676-4879-9156-872736fe174b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:24:37.976968 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-33dd2ae4-4a97-4a2a-97fd-74b3f99f38c9 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:24:37.980976 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-33dd2ae4-4a97-4a2a-97fd-74b3f99f38c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:24:37.981113 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-64162ce0-2676-4879-9156-872736fe174b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:24:37.981113 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:24:37.981113 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:24:37.981113 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:24:37.981113 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:24:37.981113 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:24:37.981113 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:24:37.981113 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:24:37.981113 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:24:37.981113 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:24:37.981113 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:24:37.981113 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:24:37.981113 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:24:37.981113 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:24:37.981113 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:24:37.981113 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:24:37.981970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:24:37.981970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:24:37.981970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:24:37.981970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:24:37.981970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:24:37.981970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:24:37.981970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:24:37.981970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:24:37.981970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:24:37.981970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:24:37.981970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:24:37.981970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:24:37.981970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:24:37.981970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:24:37.981970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:24:37.981970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:24:37.983559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:24:37.983559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:24:37.983559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:24:37.983559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:24:37.983559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:24:37.983559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:24:37.983559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:24:37.983559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:24:37.983559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:24:37.983559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:24:37.983559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:24:37.983559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:24:37.983559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 25/50] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:24:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:24:37.989482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64162ce0-2676-4879-9156-872736fe174b None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:38.032699 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:38.059917 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 26/51] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 08:24:38.107884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64162ce0-2676-4879-9156-872736fe174b None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:38.149422 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11401c2-1d53-454f-bb0f-f9dd9acfebd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:38.150095 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11401c2-1d53-454f-bb0f-f9dd9acfebd3 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:38.150385 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11401c2-1d53-454f-bb0f-f9dd9acfebd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:38.150662 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11401c2-1d53-454f-bb0f-f9dd9acfebd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:38.151395 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11401c2-1d53-454f-bb0f-f9dd9acfebd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:24:38.151822 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11401c2-1d53-454f-bb0f-f9dd9acfebd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:38.153370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11401c2-1d53-454f-bb0f-f9dd9acfebd3 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:38.169228 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 26/52] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:24:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:38.170513 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd2ae4-4a97-4a2a-97fd-74b3f99f38c9 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:38.274818 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd2ae4-4a97-4a2a-97fd-74b3f99f38c9 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:38.309260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a379765-eeaa-4803-9aa3-cfe2ee642328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:38.309910 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a379765-eeaa-4803-9aa3-cfe2ee642328 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:38.310199 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a379765-eeaa-4803-9aa3-cfe2ee642328 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:38.310484 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a379765-eeaa-4803-9aa3-cfe2ee642328 None admin] PATH_INFO: `/v3/users/3488db0374224de0980821b4dd705941` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:38.311656 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a379765-eeaa-4803-9aa3-cfe2ee642328 None admin] RBAC: Authorizing `identity:get_user(user_id=3488db0374224de0980821b4dd705941)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:38.313123 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a379765-eeaa-4803-9aa3-cfe2ee642328 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:38.314712 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 27/53] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:24:38 2022] GET /identity/v3/users/3488db0374224de0980821b4dd705941 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:38.320357 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11401c2-1d53-454f-bb0f-f9dd9acfebd3 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:38.343540 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a379765-eeaa-4803-9aa3-cfe2ee642328 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:38.348298 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:38.390865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:38.420556 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11401c2-1d53-454f-bb0f-f9dd9acfebd3 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:38.446450 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a379765-eeaa-4803-9aa3-cfe2ee642328 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:38.456718 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e655a73-e134-422b-ba7b-4739e894af97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:38.457384 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e655a73-e134-422b-ba7b-4739e894af97 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:38.457671 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e655a73-e134-422b-ba7b-4739e894af97 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:38.457952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e655a73-e134-422b-ba7b-4739e894af97 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:38.459189 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e655a73-e134-422b-ba7b-4739e894af97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:38.460772 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e655a73-e134-422b-ba7b-4739e894af97 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:38.462473 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 27/54] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:24:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:24:38.468841 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e655a73-e134-422b-ba7b-4739e894af97 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:38.570003 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:38.576834 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e655a73-e134-422b-ba7b-4739e894af97 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:38.586505 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07907fb-1ac5-4663-a88b-4946ca1cd3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:38.587370 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07907fb-1ac5-4663-a88b-4946ca1cd3d9 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:38.587483 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07907fb-1ac5-4663-a88b-4946ca1cd3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:38.587719 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07907fb-1ac5-4663-a88b-4946ca1cd3d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:38.589944 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07907fb-1ac5-4663-a88b-4946ca1cd3d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:38.591449 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07907fb-1ac5-4663-a88b-4946ca1cd3d9 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:38.593039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 28/55] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:24:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:24:38.598595 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07907fb-1ac5-4663-a88b-4946ca1cd3d9 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:38.613749 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68874e-a0df-40f0-817d-38c7593a2dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:38.614365 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68874e-a0df-40f0-817d-38c7593a2dbd None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:38.614651 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68874e-a0df-40f0-817d-38c7593a2dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:38.614937 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68874e-a0df-40f0-817d-38c7593a2dbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:38.615713 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68874e-a0df-40f0-817d-38c7593a2dbd None admin] RBAC: Adding query filter params (role.id=d12af9f1dfb344cd8a6a493e165030ba, scope.domain.id=default, user.id=3488db0374224de0980821b4dd705941) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:24:38.616031 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68874e-a0df-40f0-817d-38c7593a2dbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:38.617505 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68874e-a0df-40f0-817d-38c7593a2dbd None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:38.623209 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 28/56] 10.222.0.26 () {56 vars in 1322 bytes} [Sun Sep 11 08:24:38 2022] GET /identity/v3/role_assignments?user.id=3488db0374224de0980821b4dd705941&scope.domain.id=default&role.id=d12af9f1dfb344cd8a6a493e165030ba => generated 530 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:24:38.705532 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07907fb-1ac5-4663-a88b-4946ca1cd3d9 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:38.721593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:38.744177 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdef738-9768-463c-a6ef-6f0366fbfc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:38.744960 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdef738-9768-463c-a6ef-6f0366fbfc62 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:38.745241 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdef738-9768-463c-a6ef-6f0366fbfc62 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:38.745520 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdef738-9768-463c-a6ef-6f0366fbfc62 None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:38.746186 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdef738-9768-463c-a6ef-6f0366fbfc62 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:38.747819 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdef738-9768-463c-a6ef-6f0366fbfc62 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:38.812557 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 29/57] 10.222.0.26 () {60 vars in 1140 bytes} [Sun Sep 11 08:24:38 2022] POST /identity/v3/projects => generated 298 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:24:40.989053 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fc31a-6de8-4d4f-ae3c-6fc5387e25b6 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:40.989563 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fc31a-6de8-4d4f-ae3c-6fc5387e25b6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:40.989648 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fc31a-6de8-4d4f-ae3c-6fc5387e25b6 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:40.990951 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 29/58] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:24:40.996225 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bb60c-0fdf-4f7a-acbb-aac457204aaf None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:40.996633 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bb60c-0fdf-4f7a-acbb-aac457204aaf None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:40.996790 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bb60c-0fdf-4f7a-acbb-aac457204aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:41.014493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-839bb60c-0fdf-4f7a-acbb-aac457204aaf None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:24:41.015746 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-839bb60c-0fdf-4f7a-acbb-aac457204aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:24:41.093439 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 30/59] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:24:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:24:41.365347 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37fc31a-6de8-4d4f-ae3c-6fc5387e25b6 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:41.474376 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37fc31a-6de8-4d4f-ae3c-6fc5387e25b6 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:41.507992 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774d107-a638-4b60-82d1-8ccb089ae1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:41.508623 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774d107-a638-4b60-82d1-8ccb089ae1e5 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:41.508905 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774d107-a638-4b60-82d1-8ccb089ae1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:41.509178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774d107-a638-4b60-82d1-8ccb089ae1e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:41.510321 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774d107-a638-4b60-82d1-8ccb089ae1e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:41.511816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774d107-a638-4b60-82d1-8ccb089ae1e5 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:41.513403 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 30/60] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:24:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:41.518962 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bb60c-0fdf-4f7a-acbb-aac457204aaf None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:41.616050 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:41.621702 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bb60c-0fdf-4f7a-acbb-aac457204aaf None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:41.657439 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743b556-71c9-4ed8-be78-552a0bcc3c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:41.658437 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743b556-71c9-4ed8-be78-552a0bcc3c42 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:41.658730 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743b556-71c9-4ed8-be78-552a0bcc3c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:41.659013 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743b556-71c9-4ed8-be78-552a0bcc3c42 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:41.659729 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743b556-71c9-4ed8-be78-552a0bcc3c42 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:41.661233 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743b556-71c9-4ed8-be78-552a0bcc3c42 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:41.776477 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 31/61] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Sep 11 08:24:41 2022] POST /identity/v3/users => generated 275 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:24:45.747371 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8118b-2063-4906-903c-532591e5c9c9 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:45.748142 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8118b-2063-4906-903c-532591e5c9c9 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:45.748142 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8118b-2063-4906-903c-532591e5c9c9 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:45.749619 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 31/62] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:24:45.757392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272aed0-df82-4bd9-b653-23c301c38e38 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:45.758133 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272aed0-df82-4bd9-b653-23c301c38e38 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:45.758133 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272aed0-df82-4bd9-b653-23c301c38e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:45.788021 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-5272aed0-df82-4bd9-b653-23c301c38e38 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:24:45.789249 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5272aed0-df82-4bd9-b653-23c301c38e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:24:45.889426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 32/63] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:24:46.040186 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaff61-8aed-4889-a999-e51385b34db9 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:46.040888 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaff61-8aed-4889-a999-e51385b34db9 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:46.041425 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaff61-8aed-4889-a999-e51385b34db9 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:46.043139 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 32/64] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:24:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:24:46.049507 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca094855-6508-499c-8a19-a637cd4f86d0 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:46.050153 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca094855-6508-499c-8a19-a637cd4f86d0 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:46.050658 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca094855-6508-499c-8a19-a637cd4f86d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:46.079497 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-ca094855-6508-499c-8a19-a637cd4f86d0 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:24:46.081341 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ca094855-6508-499c-8a19-a637cd4f86d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:24:46.173628 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 33/65] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:24:46.276660 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e1034-7ada-453a-a922-c58d1bcb9740 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:46.277592 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e1034-7ada-453a-a922-c58d1bcb9740 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:46.278381 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e1034-7ada-453a-a922-c58d1bcb9740 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:46.281269 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 33/66] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:24:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:24:46.289418 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986529ef-da97-4b95-ac37-05ae00b8c597 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:46.289748 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986529ef-da97-4b95-ac37-05ae00b8c597 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:46.289984 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986529ef-da97-4b95-ac37-05ae00b8c597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:46.321781 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-986529ef-da97-4b95-ac37-05ae00b8c597 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:24:46.323164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-986529ef-da97-4b95-ac37-05ae00b8c597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:24:46.332226 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:46.361984 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7742a4-eec0-489b-bdb9-b2e8a9a0afac None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:46.361984 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7742a4-eec0-489b-bdb9-b2e8a9a0afac None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:46.361984 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7742a4-eec0-489b-bdb9-b2e8a9a0afac None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:46.361984 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 34/67] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:24:46.369515 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4acd54-a7d1-4876-afcf-690f9f07bc7b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:46.370140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4acd54-a7d1-4876-afcf-690f9f07bc7b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:46.371062 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4acd54-a7d1-4876-afcf-690f9f07bc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:46.408679 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-eb4acd54-a7d1-4876-afcf-690f9f07bc7b None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:24:46.410445 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-eb4acd54-a7d1-4876-afcf-690f9f07bc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:24:46.421008 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 34/68] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 08:24:46.422385 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986529ef-da97-4b95-ac37-05ae00b8c597 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:46.448287 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:46.532827 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 35/69] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 08:24:46.648016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986529ef-da97-4b95-ac37-05ae00b8c597 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:46.648904 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4acd54-a7d1-4876-afcf-690f9f07bc7b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:46.711795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef86a86-cbc5-464f-804b-6bc448677894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:46.713570 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef86a86-cbc5-464f-804b-6bc448677894 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:46.714260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef86a86-cbc5-464f-804b-6bc448677894 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:46.714882 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef86a86-cbc5-464f-804b-6bc448677894 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:46.734976 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef86a86-cbc5-464f-804b-6bc448677894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:24:46.746941 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-eef86a86-cbc5-464f-804b-6bc448677894 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:24:46.746941 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:24:46.746941 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:24:46.746941 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:24:46.746941 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:24:46.746941 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:24:46.746941 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:24:46.746941 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:24:46.746941 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:24:46.746941 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:24:46.746941 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:24:46.746941 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:24:46.746941 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:24:46.746941 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:24:46.746941 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:24:46.746941 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:24:46.748951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:24:46.748951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:24:46.748951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:24:46.748951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:24:46.748951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:24:46.748951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:24:46.748951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:24:46.748951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:24:46.748951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:24:46.748951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:24:46.748951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:24:46.748951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:24:46.748951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:24:46.748951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:24:46.748951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:24:46.748951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:24:46.750785 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:24:46.750785 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:24:46.750785 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:24:46.750785 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:24:46.750785 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:24:46.750785 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:24:46.750785 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:24:46.750785 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:24:46.750785 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:24:46.750785 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:24:46.750785 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:24:46.750785 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:24:46.754029 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 35/70] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:24:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:24:46.756408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbbdaa5-bb3c-49c0-af97-70009a6f76a4 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:46.757288 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbbdaa5-bb3c-49c0-af97-70009a6f76a4 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:46.757967 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbbdaa5-bb3c-49c0-af97-70009a6f76a4 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:46.761856 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 36/71] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:24:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:24:46.763489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbbdaa5-bb3c-49c0-af97-70009a6f76a4 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:46.768011 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:46.843215 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4acd54-a7d1-4876-afcf-690f9f07bc7b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:46.900371 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea308664-278d-4bb5-8a90-7530286a4b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:46.901359 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea308664-278d-4bb5-8a90-7530286a4b18 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:46.901856 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea308664-278d-4bb5-8a90-7530286a4b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:46.902351 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea308664-278d-4bb5-8a90-7530286a4b18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:46.916238 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea308664-278d-4bb5-8a90-7530286a4b18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:24:46.916686 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbbdaa5-bb3c-49c0-af97-70009a6f76a4 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:46.921196 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-ea308664-278d-4bb5-8a90-7530286a4b18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:24:46.921196 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:24:46.921196 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:24:46.921196 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:24:46.921196 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:24:46.921196 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:24:46.921196 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:24:46.921196 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:24:46.921196 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:24:46.921196 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:24:46.921196 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:24:46.921196 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:24:46.921196 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:24:46.921196 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:24:46.921196 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:24:46.921196 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:24:46.922078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:24:46.922078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:24:46.922078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:24:46.922078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:24:46.922078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:24:46.922078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:24:46.922078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:24:46.922078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:24:46.922078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:24:46.922078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:24:46.922078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:24:46.922078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:24:46.922078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:24:46.922078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:24:46.922078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:24:46.922078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:24:46.922836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:24:46.922836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:24:46.922836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:24:46.922836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:24:46.922836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:24:46.922836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:24:46.922836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:24:46.922836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:24:46.922836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:24:46.922836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:24:46.922836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:24:46.922836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:24:46.922836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 36/72] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:24:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:24:46.923882 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea308664-278d-4bb5-8a90-7530286a4b18 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:46.949953 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:46.957212 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b94e3-a42b-43e8-966b-3f828162725a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:46.957866 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b94e3-a42b-43e8-966b-3f828162725a None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:46.958167 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b94e3-a42b-43e8-966b-3f828162725a None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:46.958437 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b94e3-a42b-43e8-966b-3f828162725a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:46.964011 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b94e3-a42b-43e8-966b-3f828162725a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:46.964011 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b94e3-a42b-43e8-966b-3f828162725a None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:46.964011 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 37/73] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:24:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:46.964011 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9685dbd-fc89-454c-9824-5631fa72719f None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:46.964311 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9685dbd-fc89-454c-9824-5631fa72719f None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:46.964533 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9685dbd-fc89-454c-9824-5631fa72719f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:46.983005 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-c9685dbd-fc89-454c-9824-5631fa72719f None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:24:46.984264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c9685dbd-fc89-454c-9824-5631fa72719f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:24:47.039223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea308664-278d-4bb5-8a90-7530286a4b18 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:47.057005 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:47.061823 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 38/74] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:24:47.062692 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9685dbd-fc89-454c-9824-5631fa72719f None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:47.082526 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5fd81-df24-4892-a965-e2e6d4d2776d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:47.083283 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5fd81-df24-4892-a965-e2e6d4d2776d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:47.084156 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5fd81-df24-4892-a965-e2e6d4d2776d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:47.084156 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5fd81-df24-4892-a965-e2e6d4d2776d None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:47.084606 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5fd81-df24-4892-a965-e2e6d4d2776d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:24:47.084983 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5fd81-df24-4892-a965-e2e6d4d2776d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:47.086347 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5fd81-df24-4892-a965-e2e6d4d2776d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:47.096364 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 37/75] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:24:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:47.103070 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5fd81-df24-4892-a965-e2e6d4d2776d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:47.221003 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:47.232340 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9685dbd-fc89-454c-9824-5631fa72719f None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:47.264439 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5fd81-df24-4892-a965-e2e6d4d2776d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:47.280159 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999fc4d-7147-43ea-a40b-d38d1ba476d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:47.280807 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999fc4d-7147-43ea-a40b-d38d1ba476d8 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:47.281090 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999fc4d-7147-43ea-a40b-d38d1ba476d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:47.281351 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999fc4d-7147-43ea-a40b-d38d1ba476d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:47.293370 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9999fc4d-7147-43ea-a40b-d38d1ba476d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:24:47.298378 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-9999fc4d-7147-43ea-a40b-d38d1ba476d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:24:47.298378 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:24:47.298378 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:24:47.298378 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:24:47.298378 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:24:47.298378 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:24:47.298378 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:24:47.298378 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:24:47.298378 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:24:47.298378 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:24:47.298378 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:24:47.298378 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:24:47.298378 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:24:47.298378 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:24:47.298378 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:24:47.298378 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:24:47.299303 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:24:47.299303 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:24:47.299303 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:24:47.299303 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:24:47.299303 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:24:47.299303 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:24:47.299303 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:24:47.299303 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:24:47.299303 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:24:47.299303 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:24:47.299303 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:24:47.299303 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:24:47.299303 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:24:47.299303 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:24:47.299303 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:24:47.299303 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:24:47.300081 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:24:47.300081 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:24:47.300081 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:24:47.300081 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:24:47.300081 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:24:47.300081 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:24:47.300081 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:24:47.300081 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:24:47.300081 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:24:47.300081 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:24:47.300081 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:24:47.300081 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:24:47.300081 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 39/76] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:24:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:24:47.300742 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999fc4d-7147-43ea-a40b-d38d1ba476d8 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:47.321738 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02197183-55f9-41f2-8d24-3e30bc42b16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:47.323630 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02197183-55f9-41f2-8d24-3e30bc42b16b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:47.324153 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02197183-55f9-41f2-8d24-3e30bc42b16b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:47.324732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02197183-55f9-41f2-8d24-3e30bc42b16b None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:47.326108 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02197183-55f9-41f2-8d24-3e30bc42b16b None admin] RBAC: Adding query filter params (name=member) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:24:47.326684 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02197183-55f9-41f2-8d24-3e30bc42b16b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:47.329698 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02197183-55f9-41f2-8d24-3e30bc42b16b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:47.346952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 38/77] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Sep 11 08:24:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:47.346952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02197183-55f9-41f2-8d24-3e30bc42b16b None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:47.376730 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:47.423935 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999fc4d-7147-43ea-a40b-d38d1ba476d8 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:47.460377 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02197183-55f9-41f2-8d24-3e30bc42b16b None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:47.470467 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb5ee8-53f9-446a-b75d-356756abdd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:47.471148 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb5ee8-53f9-446a-b75d-356756abdd55 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:47.471412 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb5ee8-53f9-446a-b75d-356756abdd55 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:47.471692 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb5ee8-53f9-446a-b75d-356756abdd55 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:47.472358 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb5ee8-53f9-446a-b75d-356756abdd55 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:47.473836 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb5ee8-53f9-446a-b75d-356756abdd55 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:47.500802 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6dc329-9033-43b1-bbbb-3ed2724b0352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:47.501434 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dc329-9033-43b1-bbbb-3ed2724b0352 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:47.501716 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dc329-9033-43b1-bbbb-3ed2724b0352 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:47.505852 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dc329-9033-43b1-bbbb-3ed2724b0352 None admin] PATH_INFO: `/v3/users/3488db0374224de0980821b4dd705941` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:47.505852 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6dc329-9033-43b1-bbbb-3ed2724b0352 None admin] RBAC: Authorizing `identity:get_user(user_id=3488db0374224de0980821b4dd705941)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:47.505852 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6dc329-9033-43b1-bbbb-3ed2724b0352 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:47.506358 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 39/78] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:24:47 2022] GET /identity/v3/users/3488db0374224de0980821b4dd705941 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:47.507121 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6dc329-9033-43b1-bbbb-3ed2724b0352 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:47.519866 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:47.575348 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 40/79] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Sep 11 08:24:47 2022] POST /identity/v3/users => generated 289 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:24:47.576679 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb5ee8-53f9-446a-b75d-356756abdd55 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:47.627877 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6dc329-9033-43b1-bbbb-3ed2724b0352 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:47.692613 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50573668-fcea-4a78-a949-f6b010ee5b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:47.693731 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50573668-fcea-4a78-a949-f6b010ee5b0a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:47.694310 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50573668-fcea-4a78-a949-f6b010ee5b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:47.694703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50573668-fcea-4a78-a949-f6b010ee5b0a None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:47.696249 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50573668-fcea-4a78-a949-f6b010ee5b0a None admin] RBAC: Adding query filter params (name=member) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:24:47.696479 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50573668-fcea-4a78-a949-f6b010ee5b0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:47.699890 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50573668-fcea-4a78-a949-f6b010ee5b0a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:47.715131 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 40/80] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Sep 11 08:24:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:47.720347 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50573668-fcea-4a78-a949-f6b010ee5b0a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:47.737485 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb5ee8-53f9-446a-b75d-356756abdd55 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:47.772585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:47.797556 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a13fff-a1d9-4563-aad7-cbef4eda07e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:47.798549 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a13fff-a1d9-4563-aad7-cbef4eda07e0 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:47.798840 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a13fff-a1d9-4563-aad7-cbef4eda07e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:47.799120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a13fff-a1d9-4563-aad7-cbef4eda07e0 None admin] PATH_INFO: `/v3/users/6888ff673cd64e31b2d50533a8dbc8a2` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:47.819398 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a13fff-a1d9-4563-aad7-cbef4eda07e0 None admin] RBAC: Authorizing `identity:get_user(user_id=6888ff673cd64e31b2d50533a8dbc8a2)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:47.821258 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a13fff-a1d9-4563-aad7-cbef4eda07e0 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:47.824565 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 41/81] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:24:47 2022] GET /identity/v3/users/6888ff673cd64e31b2d50533a8dbc8a2 => generated 275 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:47.825667 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:47.825940 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a13fff-a1d9-4563-aad7-cbef4eda07e0 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:47.863279 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50573668-fcea-4a78-a949-f6b010ee5b0a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:47.911312 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b10590-a106-457f-a4cd-439b2d67f769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:47.911993 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b10590-a106-457f-a4cd-439b2d67f769 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:47.912277 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b10590-a106-457f-a4cd-439b2d67f769 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:47.912555 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b10590-a106-457f-a4cd-439b2d67f769 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:47.926362 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b10590-a106-457f-a4cd-439b2d67f769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:24:47.932669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-66b10590-a106-457f-a4cd-439b2d67f769 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 08:24:47.932669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:24:47.932669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:24:47.932669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:24:47.932669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:24:47.932669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:24:47.932669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:24:47.932669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:24:47.932669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:24:47.932669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:24:47.932669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:24:47.932669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:24:47.932669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:24:47.932669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:24:47.932669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:24:47.932669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:24:47.934589 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:24:47.934589 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:24:47.934589 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:24:47.934589 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:24:47.934589 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:24:47.934589 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:24:47.934589 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:24:47.934589 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:24:47.934589 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:24:47.934589 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:24:47.934589 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:24:47.934589 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:24:47.934589 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:24:47.934589 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:24:47.934589 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:24:47.934589 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:24:47.937057 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:24:47.937057 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:24:47.937057 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:24:47.937057 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:24:47.937057 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:24:47.937057 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:24:47.937057 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:24:47.937057 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:24:47.937057 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:24:47.937057 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:24:47.937057 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 08:24:47.937057 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:24:47.937057 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 41/82] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Sep 11 08:24:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:24:47.937057 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b10590-a106-457f-a4cd-439b2d67f769 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:47.990853 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a13fff-a1d9-4563-aad7-cbef4eda07e0 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:48.032026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2f834-6054-4f3f-a370-799df09ae8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:48.032662 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2f834-6054-4f3f-a370-799df09ae8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:48.032949 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2f834-6054-4f3f-a370-799df09ae8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:48.033228 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2f834-6054-4f3f-a370-799df09ae8d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:48.060995 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b10590-a106-457f-a4cd-439b2d67f769 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:48.085214 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:48.098247 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:48.101779 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07df75-a404-42e1-8f3b-968833ac09d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:48.102454 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07df75-a404-42e1-8f3b-968833ac09d3 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:48.102742 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07df75-a404-42e1-8f3b-968833ac09d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:48.103033 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07df75-a404-42e1-8f3b-968833ac09d3 None admin] PATH_INFO: `/v3/users/6888ff673cd64e31b2d50533a8dbc8a2` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:48.104936 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed07df75-a404-42e1-8f3b-968833ac09d3 None admin] RBAC: Authorizing `identity:get_user(user_id=6888ff673cd64e31b2d50533a8dbc8a2)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:48.106594 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed07df75-a404-42e1-8f3b-968833ac09d3 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:48.108519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 42/83] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:24:47 2022] GET /identity/v3/users/6888ff673cd64e31b2d50533a8dbc8a2 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:48.109375 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07df75-a404-42e1-8f3b-968833ac09d3 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:48.114972 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2f834-6054-4f3f-a370-799df09ae8d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:48.116870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2f834-6054-4f3f-a370-799df09ae8d0 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:48.266609 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 42/84] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:24:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 08:24:48.271720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2f834-6054-4f3f-a370-799df09ae8d0 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:48.317559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07df75-a404-42e1-8f3b-968833ac09d3 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:48.358404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624dc11-905b-4f90-a590-4b7f11daf492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:48.359041 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624dc11-905b-4f90-a590-4b7f11daf492 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:48.359369 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624dc11-905b-4f90-a590-4b7f11daf492 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:48.359731 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624dc11-905b-4f90-a590-4b7f11daf492 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:48.372710 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:48.402284 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2f834-6054-4f3f-a370-799df09ae8d0 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:48.436975 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:48.441496 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624dc11-905b-4f90-a590-4b7f11daf492 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:48.443111 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624dc11-905b-4f90-a590-4b7f11daf492 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:48.444727 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189afc9-0c74-40a6-a09d-f90273116480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:48.445375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189afc9-0c74-40a6-a09d-f90273116480 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:48.445662 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189afc9-0c74-40a6-a09d-f90273116480 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:48.445936 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189afc9-0c74-40a6-a09d-f90273116480 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:48.446624 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189afc9-0c74-40a6-a09d-f90273116480 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:24:48.446946 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189afc9-0c74-40a6-a09d-f90273116480 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:48.448533 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189afc9-0c74-40a6-a09d-f90273116480 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:48.462323 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 43/85] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:24:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:48.463743 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189afc9-0c74-40a6-a09d-f90273116480 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:48.567339 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 43/86] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:24:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 08:24:48.568174 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624dc11-905b-4f90-a590-4b7f11daf492 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:48.583411 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189afc9-0c74-40a6-a09d-f90273116480 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:48.621633 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c70e2-4d64-4d70-893f-c2537faf2516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:48.622265 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c70e2-4d64-4d70-893f-c2537faf2516 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:48.622549 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c70e2-4d64-4d70-893f-c2537faf2516 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:48.622828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c70e2-4d64-4d70-893f-c2537faf2516 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:48.626734 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:48.685590 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:48.693093 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624dc11-905b-4f90-a590-4b7f11daf492 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:48.702008 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c70e2-4d64-4d70-893f-c2537faf2516 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:48.703854 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c70e2-4d64-4d70-893f-c2537faf2516 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:48.734852 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535bf54d-84f4-4143-918a-cbcf62b25559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:48.736115 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535bf54d-84f4-4143-918a-cbcf62b25559 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:48.736802 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535bf54d-84f4-4143-918a-cbcf62b25559 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:48.737431 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535bf54d-84f4-4143-918a-cbcf62b25559 None admin] PATH_INFO: `/v3/projects/cfef4a17bab2408d8ab3549e927bff2d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:48.739100 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535bf54d-84f4-4143-918a-cbcf62b25559 None admin] RBAC: Authorizing `identity:get_project(project_id=cfef4a17bab2408d8ab3549e927bff2d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:48.740929 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535bf54d-84f4-4143-918a-cbcf62b25559 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:48.747571 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 44/87] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:24:48 2022] GET /identity/v3/projects/cfef4a17bab2408d8ab3549e927bff2d => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:48.749230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535bf54d-84f4-4143-918a-cbcf62b25559 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:48.817852 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 44/88] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:24:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 08:24:48.823147 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c70e2-4d64-4d70-893f-c2537faf2516 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:48.863481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:48.868405 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535bf54d-84f4-4143-918a-cbcf62b25559 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:48.910963 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6310b5-4b73-4544-9ae5-84e331d0f0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:48.911942 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6310b5-4b73-4544-9ae5-84e331d0f0ca None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:48.912383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6310b5-4b73-4544-9ae5-84e331d0f0ca None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:48.912825 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6310b5-4b73-4544-9ae5-84e331d0f0ca None admin] PATH_INFO: `/v3/users/6888ff673cd64e31b2d50533a8dbc8a2` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:48.914418 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6310b5-4b73-4544-9ae5-84e331d0f0ca None admin] RBAC: Authorizing `identity:get_user(user_id=6888ff673cd64e31b2d50533a8dbc8a2)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:48.916696 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6310b5-4b73-4544-9ae5-84e331d0f0ca None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:48.918571 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 45/89] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:24:48 2022] GET /identity/v3/users/6888ff673cd64e31b2d50533a8dbc8a2 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:48.919638 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6310b5-4b73-4544-9ae5-84e331d0f0ca None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:48.944182 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c70e2-4d64-4d70-893f-c2537faf2516 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:48.962973 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:48.986828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d96f46-c7f1-404c-80c7-eab25694fce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:48.987034 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d96f46-c7f1-404c-80c7-eab25694fce4 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:48.987278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d96f46-c7f1-404c-80c7-eab25694fce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:48.987632 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d96f46-c7f1-404c-80c7-eab25694fce4 None admin] PATH_INFO: `/v3/projects/cfef4a17bab2408d8ab3549e927bff2d` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:48.988956 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d96f46-c7f1-404c-80c7-eab25694fce4 None admin] RBAC: Authorizing `identity:get_project(project_id=cfef4a17bab2408d8ab3549e927bff2d)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:48.990505 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d96f46-c7f1-404c-80c7-eab25694fce4 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:48.992614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 45/90] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:24:48 2022] GET /identity/v3/projects/cfef4a17bab2408d8ab3549e927bff2d => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:48.999046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d96f46-c7f1-404c-80c7-eab25694fce4 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:49.049956 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6310b5-4b73-4544-9ae5-84e331d0f0ca None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:49.096629 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3af42f-1cb7-4c56-9c76-3aade52b894c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:49.096629 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3af42f-1cb7-4c56-9c76-3aade52b894c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:49.096629 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3af42f-1cb7-4c56-9c76-3aade52b894c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:49.096629 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3af42f-1cb7-4c56-9c76-3aade52b894c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:49.097021 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3af42f-1cb7-4c56-9c76-3aade52b894c None admin] RBAC: Adding query filter params (role.id=d12af9f1dfb344cd8a6a493e165030ba, scope.project.id=cfef4a17bab2408d8ab3549e927bff2d, user.id=3488db0374224de0980821b4dd705941) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:24:49.097021 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3af42f-1cb7-4c56-9c76-3aade52b894c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:49.097021 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3af42f-1cb7-4c56-9c76-3aade52b894c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:49.102642 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 46/91] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:24:48 2022] GET /identity/v3/role_assignments?user.id=3488db0374224de0980821b4dd705941&scope.project.id=cfef4a17bab2408d8ab3549e927bff2d&role.id=d12af9f1dfb344cd8a6a493e165030ba => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:49.104438 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3af42f-1cb7-4c56-9c76-3aade52b894c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:49.123283 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d96f46-c7f1-404c-80c7-eab25694fce4 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:49.123283 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:49.173026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b24b77-adb6-4a07-aa3d-eb50efb634ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:49.173365 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b24b77-adb6-4a07-aa3d-eb50efb634ae None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:49.173864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b24b77-adb6-4a07-aa3d-eb50efb634ae None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:49.174349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b24b77-adb6-4a07-aa3d-eb50efb634ae None admin] PATH_INFO: `/v3/projects/c2f4a4da4c594c13a6c96dbb2a1c12ce` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:49.176964 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b24b77-adb6-4a07-aa3d-eb50efb634ae None admin] RBAC: Authorizing `identity:get_project(project_id=c2f4a4da4c594c13a6c96dbb2a1c12ce)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:49.179766 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b24b77-adb6-4a07-aa3d-eb50efb634ae None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:49.187606 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 46/92] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:24:48 2022] GET /identity/v3/projects/c2f4a4da4c594c13a6c96dbb2a1c12ce => generated 312 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:49.187606 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b24b77-adb6-4a07-aa3d-eb50efb634ae None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:49.365952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:49.374567 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3af42f-1cb7-4c56-9c76-3aade52b894c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:49.391023 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b24b77-adb6-4a07-aa3d-eb50efb634ae None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:49.423077 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905539ae-7d2e-4c9e-8d26-5c6139522d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:49.423998 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905539ae-7d2e-4c9e-8d26-5c6139522d11 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:49.424428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905539ae-7d2e-4c9e-8d26-5c6139522d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:49.424957 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905539ae-7d2e-4c9e-8d26-5c6139522d11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:49.474705 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b2e45-cfb4-4953-b320-f5efb32f05b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:49.475782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b2e45-cfb4-4953-b320-f5efb32f05b0 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:49.476243 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b2e45-cfb4-4953-b320-f5efb32f05b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:49.476740 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b2e45-cfb4-4953-b320-f5efb32f05b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:49.478444 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b2e45-cfb4-4953-b320-f5efb32f05b0 None admin] RBAC: Adding query filter params (role.id=3cecaf09e54b4f479cd391db74c49831, scope.project.id=cfef4a17bab2408d8ab3549e927bff2d, user.id=6888ff673cd64e31b2d50533a8dbc8a2) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:24:49.479037 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b2e45-cfb4-4953-b320-f5efb32f05b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:49.483344 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b2e45-cfb4-4953-b320-f5efb32f05b0 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:49.512947 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 47/93] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:24:49 2022] GET /identity/v3/role_assignments?user.id=6888ff673cd64e31b2d50533a8dbc8a2&scope.project.id=cfef4a17bab2408d8ab3549e927bff2d&role.id=3cecaf09e54b4f479cd391db74c49831 => generated 259 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:49.514857 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b2e45-cfb4-4953-b320-f5efb32f05b0 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:49.566800 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905539ae-7d2e-4c9e-8d26-5c6139522d11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:49.568710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905539ae-7d2e-4c9e-8d26-5c6139522d11 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:49.615888 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:49.729872 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b2e45-cfb4-4953-b320-f5efb32f05b0 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:49.796274 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c200c-d8b8-4710-96ef-179d6dada19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:49.797293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c200c-d8b8-4710-96ef-179d6dada19c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:49.797799 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c200c-d8b8-4710-96ef-179d6dada19c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:49.798268 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c200c-d8b8-4710-96ef-179d6dada19c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:49.799682 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c200c-d8b8-4710-96ef-179d6dada19c None admin] RBAC: Adding query filter params (role.id=3cecaf09e54b4f479cd391db74c49831, scope.project.id=c2f4a4da4c594c13a6c96dbb2a1c12ce, user.id=6888ff673cd64e31b2d50533a8dbc8a2) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:24:49.800225 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c200c-d8b8-4710-96ef-179d6dada19c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:49.803116 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c200c-d8b8-4710-96ef-179d6dada19c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:49.814558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 48/94] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:24:49 2022] GET /identity/v3/role_assignments?user.id=6888ff673cd64e31b2d50533a8dbc8a2&scope.project.id=c2f4a4da4c594c13a6c96dbb2a1c12ce&role.id=3cecaf09e54b4f479cd391db74c49831 => generated 259 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:49.835333 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:49.840136 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 47/95] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:24:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 736 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 08:24:49.849118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c200c-d8b8-4710-96ef-179d6dada19c None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:50.054491 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:50.062700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c200c-d8b8-4710-96ef-179d6dada19c None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:50.114567 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b68498-c24a-4324-858d-88e6ba590c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:50.115462 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b68498-c24a-4324-858d-88e6ba590c48 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:50.115763 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b68498-c24a-4324-858d-88e6ba590c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:50.116050 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b68498-c24a-4324-858d-88e6ba590c48 None admin] PATH_INFO: `/v3/projects/cfef4a17bab2408d8ab3549e927bff2d` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:50.117405 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b68498-c24a-4324-858d-88e6ba590c48 None admin] RBAC: Authorizing `identity:get_project(project_id=cfef4a17bab2408d8ab3549e927bff2d)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:50.118916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b68498-c24a-4324-858d-88e6ba590c48 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:50.120752 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 49/96] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:24:49 2022] GET /identity/v3/projects/cfef4a17bab2408d8ab3549e927bff2d => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:50.132511 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905539ae-7d2e-4c9e-8d26-5c6139522d11 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:50.276275 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905539ae-7d2e-4c9e-8d26-5c6139522d11 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:50.318825 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7bcbf-d5d7-4057-b0fc-98687f670f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:50.319428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7bcbf-d5d7-4057-b0fc-98687f670f52 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:50.319717 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7bcbf-d5d7-4057-b0fc-98687f670f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:50.320001 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7bcbf-d5d7-4057-b0fc-98687f670f52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:50.320785 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a7bcbf-d5d7-4057-b0fc-98687f670f52 None admin] RBAC: Adding query filter params (role.id=897bff7604d1492993a708763e54e6d8, scope.project.id=cfef4a17bab2408d8ab3549e927bff2d, user.id=6888ff673cd64e31b2d50533a8dbc8a2) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:24:50.321103 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a7bcbf-d5d7-4057-b0fc-98687f670f52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:50.323179 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a7bcbf-d5d7-4057-b0fc-98687f670f52 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:50.330007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 48/97] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:24:50 2022] GET /identity/v3/role_assignments?user.id=6888ff673cd64e31b2d50533a8dbc8a2&scope.project.id=cfef4a17bab2408d8ab3549e927bff2d&role.id=897bff7604d1492993a708763e54e6d8 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:50.726685 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d29ce8-7e21-41fd-bc14-30bdd3610f20 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:50.727463 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d29ce8-7e21-41fd-bc14-30bdd3610f20 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:50.727962 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d29ce8-7e21-41fd-bc14-30bdd3610f20 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:50.729815 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 50/98] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:24:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:24:50.736126 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f6a59-5d4c-47c4-904a-6e3698df8c30 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:50.736769 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f6a59-5d4c-47c4-904a-6e3698df8c30 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:50.737289 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f6a59-5d4c-47c4-904a-6e3698df8c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:50.760318 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-185f6a59-5d4c-47c4-904a-6e3698df8c30 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:24:50.762095 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-185f6a59-5d4c-47c4-904a-6e3698df8c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:24:50.839641 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:50.851954 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 49/99] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 08:24:51.426782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58503b83-d23b-482d-9721-415ab40e5d8a None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:51.427916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58503b83-d23b-482d-9721-415ab40e5d8a None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:51.428417 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58503b83-d23b-482d-9721-415ab40e5d8a None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:51.429981 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 51/100] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:24:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:24:51.445545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241564ec-97a1-41d2-b0ab-4b6d5fe57d2e None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:51.446511 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241564ec-97a1-41d2-b0ab-4b6d5fe57d2e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:51.446998 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241564ec-97a1-41d2-b0ab-4b6d5fe57d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:51.471307 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-241564ec-97a1-41d2-b0ab-4b6d5fe57d2e None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:24:51.472717 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-241564ec-97a1-41d2-b0ab-4b6d5fe57d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:24:51.560159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 50/101] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:24:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 08:24:51.827100 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58503b83-d23b-482d-9721-415ab40e5d8a None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:52.014136 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58503b83-d23b-482d-9721-415ab40e5d8a None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:52.082362 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b39d6-6c3e-4f08-9f8b-bb32da115c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:52.084040 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b39d6-6c3e-4f08-9f8b-bb32da115c6b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:52.084843 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b39d6-6c3e-4f08-9f8b-bb32da115c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:52.085624 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b39d6-6c3e-4f08-9f8b-bb32da115c6b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:52.095283 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241564ec-97a1-41d2-b0ab-4b6d5fe57d2e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:52.121028 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b39d6-6c3e-4f08-9f8b-bb32da115c6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:24:52.137407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-bb8b39d6-6c3e-4f08-9f8b-bb32da115c6b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 08:24:52.137407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:24:52.137407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:24:52.137407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:24:52.137407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:24:52.137407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:24:52.137407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:24:52.137407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:24:52.137407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:24:52.137407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:24:52.137407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:24:52.137407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:24:52.137407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:24:52.137407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:24:52.137407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:24:52.137407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:24:52.139055 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:24:52.139055 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:24:52.139055 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:24:52.139055 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:24:52.139055 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:24:52.139055 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:24:52.139055 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:24:52.139055 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:24:52.139055 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:24:52.139055 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:24:52.139055 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:24:52.139055 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:24:52.139055 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:24:52.139055 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:24:52.139055 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:24:52.139055 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:24:52.140611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:24:52.140611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:24:52.140611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:24:52.140611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:24:52.140611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:24:52.140611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:24:52.140611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:24:52.140611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:24:52.140611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:24:52.140611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:24:52.140611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 08:24:52.140611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:24:52.148215 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 52/102] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:24:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:24:52.155029 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b39d6-6c3e-4f08-9f8b-bb32da115c6b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:52.213095 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:52.319421 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241564ec-97a1-41d2-b0ab-4b6d5fe57d2e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:52.365988 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b39d6-6c3e-4f08-9f8b-bb32da115c6b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:52.381965 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:52.429049 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4623ba-929f-4c16-986f-73481527f1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:52.429872 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f986a08-3cd0-4946-acb4-47cafd20867a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:52.430049 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4623ba-929f-4c16-986f-73481527f1b5 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:52.430191 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f986a08-3cd0-4946-acb4-47cafd20867a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:52.430337 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4623ba-929f-4c16-986f-73481527f1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:52.430464 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f986a08-3cd0-4946-acb4-47cafd20867a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:52.430595 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4623ba-929f-4c16-986f-73481527f1b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:52.430739 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f986a08-3cd0-4946-acb4-47cafd20867a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:52.431922 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4623ba-929f-4c16-986f-73481527f1b5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:24:52.431922 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4623ba-929f-4c16-986f-73481527f1b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:52.433240 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4623ba-929f-4c16-986f-73481527f1b5 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:52.436107 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f986a08-3cd0-4946-acb4-47cafd20867a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:52.437620 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f986a08-3cd0-4946-acb4-47cafd20867a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:52.439374 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 51/103] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:24:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:52.448770 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f986a08-3cd0-4946-acb4-47cafd20867a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:52.452370 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 53/104] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Sep 11 08:24:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:24:52.463466 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4623ba-929f-4c16-986f-73481527f1b5 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:52.727978 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:52.767939 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4623ba-929f-4c16-986f-73481527f1b5 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:52.769275 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f986a08-3cd0-4946-acb4-47cafd20867a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:52.858091 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246b3dc-1922-4b71-80e6-0925f72a572f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:52.858733 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246b3dc-1922-4b71-80e6-0925f72a572f None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:52.859021 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246b3dc-1922-4b71-80e6-0925f72a572f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:52.859340 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246b3dc-1922-4b71-80e6-0925f72a572f None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:52.860029 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246b3dc-1922-4b71-80e6-0925f72a572f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:52.861559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246b3dc-1922-4b71-80e6-0925f72a572f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:52.922678 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2c38b-962d-4641-a12f-79f08d2b4843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:52.923276 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2c38b-962d-4641-a12f-79f08d2b4843 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:52.923561 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2c38b-962d-4641-a12f-79f08d2b4843 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:52.923847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2c38b-962d-4641-a12f-79f08d2b4843 None admin] PATH_INFO: `/v3/users/9169b15950d0478c86da739c4ef6f888` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:52.941965 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2c38b-962d-4641-a12f-79f08d2b4843 None admin] RBAC: Authorizing `identity:get_user(user_id=9169b15950d0478c86da739c4ef6f888)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:52.946614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2c38b-962d-4641-a12f-79f08d2b4843 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:52.946614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 54/105] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:24:52 2022] GET /identity/v3/users/9169b15950d0478c86da739c4ef6f888 => generated 289 bytes in 483 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:24:52.955309 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2c38b-962d-4641-a12f-79f08d2b4843 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:53.000035 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 52/106] 10.222.0.26 () {60 vars in 1141 bytes} [Sun Sep 11 08:24:52 2022] POST /identity/v3/projects => generated 302 bytes in 552 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:24:53.154281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2c38b-962d-4641-a12f-79f08d2b4843 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:53.216642 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d4f28-72f8-4088-979d-ac8bb758b56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:53.218216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d4f28-72f8-4088-979d-ac8bb758b56b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:53.219001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d4f28-72f8-4088-979d-ac8bb758b56b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:53.219749 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d4f28-72f8-4088-979d-ac8bb758b56b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:53.302159 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:53.523478 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d4f28-72f8-4088-979d-ac8bb758b56b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:53.524881 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d4f28-72f8-4088-979d-ac8bb758b56b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:53.729903 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 55/107] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:24:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 775 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 08:24:53.730881 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246b3dc-1922-4b71-80e6-0925f72a572f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:53.775669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc6a4a-28c2-4e2c-831b-d984064d8817 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:53.775961 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc6a4a-28c2-4e2c-831b-d984064d8817 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:53.776154 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc6a4a-28c2-4e2c-831b-d984064d8817 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:53.777814 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 56/108] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:24:53.795072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07180131-db62-4138-a380-b90b76692836 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:53.795440 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07180131-db62-4138-a380-b90b76692836 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:53.795666 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07180131-db62-4138-a380-b90b76692836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:53.823188 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:53.824704 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-07180131-db62-4138-a380-b90b76692836 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:24:53.825984 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-07180131-db62-4138-a380-b90b76692836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:24:53.893547 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:53.913590 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 57/109] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:24:53.915018 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ca471-1b63-4909-b5c7-ecf59a1ee01e None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:53.915333 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ca471-1b63-4909-b5c7-ecf59a1ee01e None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:53.915614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ca471-1b63-4909-b5c7-ecf59a1ee01e None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:53.917211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 58/110] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:24:53.922812 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adf9f1-382c-49e1-89e4-5a297becc70f None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:53.923156 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adf9f1-382c-49e1-89e4-5a297becc70f None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:53.923541 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adf9f1-382c-49e1-89e4-5a297becc70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:53.943573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-c6adf9f1-382c-49e1-89e4-5a297becc70f None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:24:53.945003 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c6adf9f1-382c-49e1-89e4-5a297becc70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:24:54.009711 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246b3dc-1922-4b71-80e6-0925f72a572f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:54.024918 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 59/111] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:24:54.026349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad683cd1-b972-40b6-9704-801830052d68 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:54.026577 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad683cd1-b972-40b6-9704-801830052d68 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:54.031715 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad683cd1-b972-40b6-9704-801830052d68 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:54.033220 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 60/112] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:24:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:24:54.039425 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd895d-071c-4a65-b7dc-db8b38aff967 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:54.039699 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd895d-071c-4a65-b7dc-db8b38aff967 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:54.039974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd895d-071c-4a65-b7dc-db8b38aff967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:54.071594 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-bcbd895d-071c-4a65-b7dc-db8b38aff967 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:24:54.072919 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-bcbd895d-071c-4a65-b7dc-db8b38aff967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:24:54.107872 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78ea35-ea65-4e35-b633-5889e3d0c996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:54.108648 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78ea35-ea65-4e35-b633-5889e3d0c996 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:54.109009 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78ea35-ea65-4e35-b633-5889e3d0c996 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:54.109346 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78ea35-ea65-4e35-b633-5889e3d0c996 None admin] PATH_INFO: `/v3/projects/cfef4a17bab2408d8ab3549e927bff2d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:54.110680 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78ea35-ea65-4e35-b633-5889e3d0c996 None admin] RBAC: Authorizing `identity:get_project(project_id=cfef4a17bab2408d8ab3549e927bff2d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:54.116638 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78ea35-ea65-4e35-b633-5889e3d0c996 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:54.118566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 53/113] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:24:53 2022] GET /identity/v3/projects/cfef4a17bab2408d8ab3549e927bff2d => generated 298 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:54.125533 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78ea35-ea65-4e35-b633-5889e3d0c996 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:54.205412 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 61/114] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:24:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 08:24:54.260576 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd895d-071c-4a65-b7dc-db8b38aff967 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:54.321101 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:54.346277 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78ea35-ea65-4e35-b633-5889e3d0c996 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:54.367647 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:54.393280 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd895d-071c-4a65-b7dc-db8b38aff967 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:54.434502 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45b72b-7de2-4d19-b1f9-3b2236af9bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:54.435658 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45b72b-7de2-4d19-b1f9-3b2236af9bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:54.436135 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45b72b-7de2-4d19-b1f9-3b2236af9bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:54.436696 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45b72b-7de2-4d19-b1f9-3b2236af9bb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:54.448994 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a45b72b-7de2-4d19-b1f9-3b2236af9bb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:24:54.450023 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c6eb6-e92d-4a49-8693-498f7307d88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:54.450735 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c6eb6-e92d-4a49-8693-498f7307d88e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:54.451106 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c6eb6-e92d-4a49-8693-498f7307d88e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:54.451484 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c6eb6-e92d-4a49-8693-498f7307d88e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:54.452317 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c6eb6-e92d-4a49-8693-498f7307d88e None admin] RBAC: Adding query filter params (role.id=4c81d75b246b4f55b100a3a15eaba6a4, scope.project.id=cfef4a17bab2408d8ab3549e927bff2d, user.id=9169b15950d0478c86da739c4ef6f888) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:24:54.452703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c6eb6-e92d-4a49-8693-498f7307d88e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:54.454530 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c6eb6-e92d-4a49-8693-498f7307d88e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:54.456184 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-3a45b72b-7de2-4d19-b1f9-3b2236af9bb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:24:54.456184 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:24:54.456184 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:24:54.456184 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:24:54.456184 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:24:54.456184 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:24:54.456184 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:24:54.456184 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:24:54.456184 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:24:54.456184 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:24:54.456184 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:24:54.456184 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:24:54.456184 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:24:54.456184 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:24:54.456184 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:24:54.456184 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:24:54.457072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:24:54.457072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:24:54.457072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:24:54.457072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:24:54.457072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:24:54.457072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:24:54.457072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:24:54.457072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:24:54.457072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:24:54.457072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:24:54.457072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:24:54.457072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:24:54.457072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:24:54.457072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:24:54.457072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:24:54.457072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:24:54.457845 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:24:54.457845 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:24:54.457845 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:24:54.457845 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:24:54.457845 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:24:54.457845 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:24:54.457845 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:24:54.457845 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:24:54.457845 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:24:54.457845 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:24:54.457845 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:24:54.457845 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:24:54.460029 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 62/115] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:24:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:24:54.461907 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f28519-37a4-4dd5-a9fd-d34c51715f0b None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:54.463153 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f28519-37a4-4dd5-a9fd-d34c51715f0b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:54.463626 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f28519-37a4-4dd5-a9fd-d34c51715f0b None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:54.466115 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 63/116] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:24:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:24:54.467266 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 54/117] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:24:54 2022] GET /identity/v3/role_assignments?user.id=9169b15950d0478c86da739c4ef6f888&scope.project.id=cfef4a17bab2408d8ab3549e927bff2d&role.id=4c81d75b246b4f55b100a3a15eaba6a4 => generated 259 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:24:54.467605 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f28519-37a4-4dd5-a9fd-d34c51715f0b None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:54.473138 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2fef9-0f23-46c5-a23c-1348d5470ee7 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:54.473455 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2fef9-0f23-46c5-a23c-1348d5470ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:54.473704 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2fef9-0f23-46c5-a23c-1348d5470ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:54.506843 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-a5a2fef9-0f23-46c5-a23c-1348d5470ee7 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:24:54.508642 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a5a2fef9-0f23-46c5-a23c-1348d5470ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:24:54.594588 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 55/118] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:24:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:24:54.595831 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2fef9-0f23-46c5-a23c-1348d5470ee7 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:54.716453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:54.721758 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2fef9-0f23-46c5-a23c-1348d5470ee7 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:54.725925 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:54.734364 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f28519-37a4-4dd5-a9fd-d34c51715f0b None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:54.770622 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a7062-99e2-4790-959c-1ac8cba319d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:54.772171 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a7062-99e2-4790-959c-1ac8cba319d7 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:54.772699 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a7062-99e2-4790-959c-1ac8cba319d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:54.773178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a7062-99e2-4790-959c-1ac8cba319d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:54.774242 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a7062-99e2-4790-959c-1ac8cba319d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:24:54.774850 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a7062-99e2-4790-959c-1ac8cba319d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:54.777264 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a7062-99e2-4790-959c-1ac8cba319d7 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:54.787140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 56/119] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:24:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:54.788530 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a7062-99e2-4790-959c-1ac8cba319d7 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:54.807683 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2a8af-80f4-45a5-80ff-016f06fcea1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:54.808892 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2a8af-80f4-45a5-80ff-016f06fcea1c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:54.809391 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2a8af-80f4-45a5-80ff-016f06fcea1c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:54.809956 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2a8af-80f4-45a5-80ff-016f06fcea1c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:54.831076 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b2a8af-80f4-45a5-80ff-016f06fcea1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:24:54.842039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-01b2a8af-80f4-45a5-80ff-016f06fcea1c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:24:54.842039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:24:54.842039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:24:54.842039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:24:54.842039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:24:54.842039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:24:54.842039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:24:54.842039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:24:54.842039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:24:54.842039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:24:54.842039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:24:54.842039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:24:54.842039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:24:54.842039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:24:54.842039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:24:54.842039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:24:54.842975 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:24:54.842975 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:24:54.842975 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:24:54.842975 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:24:54.842975 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:24:54.842975 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:24:54.842975 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:24:54.842975 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:24:54.842975 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:24:54.842975 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:24:54.842975 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:24:54.842975 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:24:54.842975 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:24:54.842975 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:24:54.842975 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:24:54.842975 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:24:54.844152 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:24:54.844152 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:24:54.844152 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:24:54.844152 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:24:54.844152 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:24:54.844152 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:24:54.844152 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:24:54.844152 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:24:54.844152 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:24:54.844152 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:24:54.844152 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:24:54.844152 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:24:54.853069 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 64/120] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:24:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:24:54.854638 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2a8af-80f4-45a5-80ff-016f06fcea1c None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:54.912855 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a7062-99e2-4790-959c-1ac8cba319d7 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:54.950728 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec0651-d966-410d-b9b1-4b710995838c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:54.951826 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec0651-d966-410d-b9b1-4b710995838c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:54.952344 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec0651-d966-410d-b9b1-4b710995838c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:54.952951 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec0651-d966-410d-b9b1-4b710995838c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:54.966086 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec0651-d966-410d-b9b1-4b710995838c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:24:54.972528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-3bec0651-d966-410d-b9b1-4b710995838c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:24:54.972528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:24:54.972528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:24:54.972528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:24:54.972528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:24:54.972528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:24:54.972528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:24:54.972528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:24:54.972528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:24:54.972528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:24:54.972528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:24:54.972528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:24:54.972528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:24:54.972528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:24:54.972528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:24:54.972528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:24:54.973456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:24:54.973456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:24:54.973456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:24:54.973456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:24:54.973456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:24:54.973456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:24:54.973456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:24:54.973456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:24:54.973456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:24:54.973456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:24:54.973456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:24:54.973456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:24:54.973456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:24:54.973456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:24:54.973456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:24:54.973456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:24:54.974207 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:24:54.974207 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:24:54.974207 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:24:54.974207 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:24:54.974207 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:24:54.974207 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:24:54.974207 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:24:54.974207 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:24:54.974207 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:24:54.974207 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:24:54.974207 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:24:54.974207 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:24:54.977265 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 57/121] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:24:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:24:54.979053 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec0651-d966-410d-b9b1-4b710995838c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:55.030726 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:55.089019 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2a8af-80f4-45a5-80ff-016f06fcea1c None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:55.125912 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec0651-d966-410d-b9b1-4b710995838c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:55.142547 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0454db-78f1-4c8f-b473-f76628616c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:55.143205 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0454db-78f1-4c8f-b473-f76628616c6a None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:55.143549 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0454db-78f1-4c8f-b473-f76628616c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:55.143834 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0454db-78f1-4c8f-b473-f76628616c6a None admin] PATH_INFO: `/v3/users/3488db0374224de0980821b4dd705941` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:55.145139 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0454db-78f1-4c8f-b473-f76628616c6a None admin] RBAC: Authorizing `identity:get_user(user_id=3488db0374224de0980821b4dd705941)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:55.146961 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0454db-78f1-4c8f-b473-f76628616c6a None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:55.148875 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 65/122] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:24:54 2022] GET /identity/v3/users/3488db0374224de0980821b4dd705941 => generated 247 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:55.149817 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0454db-78f1-4c8f-b473-f76628616c6a None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:55.172877 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7e3ba-19b8-4fa1-b8e7-6608adf4c7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:55.173871 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7e3ba-19b8-4fa1-b8e7-6608adf4c7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:55.174446 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7e3ba-19b8-4fa1-b8e7-6608adf4c7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:55.174961 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7e3ba-19b8-4fa1-b8e7-6608adf4c7e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:55.175929 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7e3ba-19b8-4fa1-b8e7-6608adf4c7e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:24:55.176483 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7e3ba-19b8-4fa1-b8e7-6608adf4c7e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:55.178700 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7e3ba-19b8-4fa1-b8e7-6608adf4c7e9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:55.180989 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:55.190654 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 58/123] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Sep 11 08:24:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:55.192054 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7e3ba-19b8-4fa1-b8e7-6608adf4c7e9 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:55.274398 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0454db-78f1-4c8f-b473-f76628616c6a None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:55.316942 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9841556-95ad-43ca-bfba-7f3443752c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:55.317622 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9841556-95ad-43ca-bfba-7f3443752c79 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:55.317912 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9841556-95ad-43ca-bfba-7f3443752c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:55.318195 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9841556-95ad-43ca-bfba-7f3443752c79 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:55.320551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:55.333405 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9841556-95ad-43ca-bfba-7f3443752c79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:24:55.339060 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-b9841556-95ad-43ca-bfba-7f3443752c79 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 08:24:55.339060 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:24:55.339060 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:24:55.339060 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:24:55.339060 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:24:55.339060 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:24:55.339060 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:24:55.339060 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:24:55.339060 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:24:55.339060 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:24:55.339060 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:24:55.339060 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:24:55.339060 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:24:55.339060 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:24:55.339060 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:24:55.339060 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:24:55.340611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:24:55.340611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:24:55.340611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:24:55.340611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:24:55.340611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:24:55.340611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:24:55.340611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:24:55.340611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:24:55.340611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:24:55.340611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:24:55.340611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:24:55.340611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:24:55.340611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:24:55.340611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:24:55.340611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:24:55.340611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:24:55.341399 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:24:55.341399 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:24:55.341399 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:24:55.341399 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:24:55.341399 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:24:55.341399 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:24:55.341399 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:24:55.341399 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:24:55.341399 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:24:55.341399 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:24:55.341399 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 08:24:55.341399 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:24:55.341399 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 66/124] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Sep 11 08:24:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:24:55.341399 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9841556-95ad-43ca-bfba-7f3443752c79 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:55.346559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7e3ba-19b8-4fa1-b8e7-6608adf4c7e9 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:55.416675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c33905-394c-4fd7-ac9f-01d5f8465d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:55.418275 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c33905-394c-4fd7-ac9f-01d5f8465d94 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:55.419168 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c33905-394c-4fd7-ac9f-01d5f8465d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:55.420049 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c33905-394c-4fd7-ac9f-01d5f8465d94 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:55.433813 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c33905-394c-4fd7-ac9f-01d5f8465d94 None admin] RBAC: Adding query filter params (name=member) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:24:55.434739 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c33905-394c-4fd7-ac9f-01d5f8465d94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:55.438210 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c33905-394c-4fd7-ac9f-01d5f8465d94 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:55.454086 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:55.458276 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 59/125] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Sep 11 08:24:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:55.460464 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c33905-394c-4fd7-ac9f-01d5f8465d94 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:55.479286 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9841556-95ad-43ca-bfba-7f3443752c79 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:55.529334 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31a773-8fd0-4992-8731-643e6bbdbeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:55.530056 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31a773-8fd0-4992-8731-643e6bbdbeda None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:55.530343 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31a773-8fd0-4992-8731-643e6bbdbeda None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:55.532141 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31a773-8fd0-4992-8731-643e6bbdbeda None admin] PATH_INFO: `/v3/projects/cfef4a17bab2408d8ab3549e927bff2d` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:55.533879 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31a773-8fd0-4992-8731-643e6bbdbeda None admin] RBAC: Authorizing `identity:get_project(project_id=cfef4a17bab2408d8ab3549e927bff2d)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:55.536772 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31a773-8fd0-4992-8731-643e6bbdbeda None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:55.539816 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 67/126] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:24:55 2022] GET /identity/v3/projects/cfef4a17bab2408d8ab3549e927bff2d => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:55.541613 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31a773-8fd0-4992-8731-643e6bbdbeda None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:55.596764 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c33905-394c-4fd7-ac9f-01d5f8465d94 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:55.646513 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0733a0-83b6-4900-ab5e-52b110c01dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:55.647363 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0733a0-83b6-4900-ab5e-52b110c01dba None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:55.647752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0733a0-83b6-4900-ab5e-52b110c01dba None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:55.648138 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0733a0-83b6-4900-ab5e-52b110c01dba None admin] PATH_INFO: `/v3/users/6888ff673cd64e31b2d50533a8dbc8a2` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:55.649494 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0733a0-83b6-4900-ab5e-52b110c01dba None admin] RBAC: Authorizing `identity:get_user(user_id=6888ff673cd64e31b2d50533a8dbc8a2)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:55.651140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0733a0-83b6-4900-ab5e-52b110c01dba None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:55.652962 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 60/127] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:24:55 2022] GET /identity/v3/users/6888ff673cd64e31b2d50533a8dbc8a2 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:55.653959 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0733a0-83b6-4900-ab5e-52b110c01dba None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:55.678975 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:55.679160 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31a773-8fd0-4992-8731-643e6bbdbeda None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:55.735498 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbef65e-281f-482c-a561-93eca105f2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:55.736141 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbef65e-281f-482c-a561-93eca105f2fb None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:55.736395 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbef65e-281f-482c-a561-93eca105f2fb None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:55.736677 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbef65e-281f-482c-a561-93eca105f2fb None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:55.737675 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbef65e-281f-482c-a561-93eca105f2fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:24:55.737992 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbef65e-281f-482c-a561-93eca105f2fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:55.739620 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbef65e-281f-482c-a561-93eca105f2fb None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:55.752182 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 68/128] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:24:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:55.752895 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbef65e-281f-482c-a561-93eca105f2fb None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:55.777645 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:55.787356 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0733a0-83b6-4900-ab5e-52b110c01dba None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:55.837292 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b392ac-64b1-4cb3-84a1-511bf6d342fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:55.838502 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b392ac-64b1-4cb3-84a1-511bf6d342fe None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:55.838795 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b392ac-64b1-4cb3-84a1-511bf6d342fe None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:55.839081 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b392ac-64b1-4cb3-84a1-511bf6d342fe None admin] PATH_INFO: `/v3/users/6888ff673cd64e31b2d50533a8dbc8a2` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:55.841086 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b392ac-64b1-4cb3-84a1-511bf6d342fe None admin] RBAC: Authorizing `identity:get_user(user_id=6888ff673cd64e31b2d50533a8dbc8a2)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:55.842907 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b392ac-64b1-4cb3-84a1-511bf6d342fe None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:55.845958 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 61/129] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:24:55 2022] GET /identity/v3/users/6888ff673cd64e31b2d50533a8dbc8a2 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:55.846836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b392ac-64b1-4cb3-84a1-511bf6d342fe None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:55.884492 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbef65e-281f-482c-a561-93eca105f2fb None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:55.923402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbee932-22cc-42dd-b713-ce422dde10ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:55.924021 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbee932-22cc-42dd-b713-ce422dde10ca None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:55.924316 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbee932-22cc-42dd-b713-ce422dde10ca None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:55.924662 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbee932-22cc-42dd-b713-ce422dde10ca None admin] PATH_INFO: `/v3/projects/cfef4a17bab2408d8ab3549e927bff2d/users/3488db0374224de0980821b4dd705941/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:55.926718 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbee932-22cc-42dd-b713-ce422dde10ca None admin] RBAC: Authorizing `identity:create_grant(project_id=cfef4a17bab2408d8ab3549e927bff2d, user_id=3488db0374224de0980821b4dd705941, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:55.928251 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbee932-22cc-42dd-b713-ce422dde10ca None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:55.953529 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:55.969567 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b392ac-64b1-4cb3-84a1-511bf6d342fe None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:56.007732 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 69/130] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Sep 11 08:24:55 2022] PUT /identity/v3/projects/cfef4a17bab2408d8ab3549e927bff2d/users/3488db0374224de0980821b4dd705941/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:24:56.009458 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbee932-22cc-42dd-b713-ce422dde10ca None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:56.011976 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83a625-e7cb-42b4-8967-47b71448fb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:56.012659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83a625-e7cb-42b4-8967-47b71448fb52 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:56.013009 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83a625-e7cb-42b4-8967-47b71448fb52 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:56.013295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83a625-e7cb-42b4-8967-47b71448fb52 None admin] PATH_INFO: `/v3/projects/cfef4a17bab2408d8ab3549e927bff2d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:56.014721 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f83a625-e7cb-42b4-8967-47b71448fb52 None admin] RBAC: Authorizing `identity:get_project(project_id=cfef4a17bab2408d8ab3549e927bff2d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:56.016702 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f83a625-e7cb-42b4-8967-47b71448fb52 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:56.018434 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 62/131] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:24:55 2022] GET /identity/v3/projects/cfef4a17bab2408d8ab3549e927bff2d => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:56.019467 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83a625-e7cb-42b4-8967-47b71448fb52 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:56.128887 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:56.146197 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83a625-e7cb-42b4-8967-47b71448fb52 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:56.164456 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbee932-22cc-42dd-b713-ce422dde10ca None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:56.190372 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a882e4-547a-4be8-a44e-98391376d4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:56.190950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a882e4-547a-4be8-a44e-98391376d4e6 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:56.191240 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a882e4-547a-4be8-a44e-98391376d4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:56.191577 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a882e4-547a-4be8-a44e-98391376d4e6 None admin] PATH_INFO: `/v3/projects/c2f4a4da4c594c13a6c96dbb2a1c12ce` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:56.192928 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a882e4-547a-4be8-a44e-98391376d4e6 None admin] RBAC: Authorizing `identity:get_project(project_id=c2f4a4da4c594c13a6c96dbb2a1c12ce)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:56.194512 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a882e4-547a-4be8-a44e-98391376d4e6 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:56.196467 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 63/132] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:24:56 2022] GET /identity/v3/projects/c2f4a4da4c594c13a6c96dbb2a1c12ce => generated 312 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:56.197914 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a882e4-547a-4be8-a44e-98391376d4e6 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:56.222592 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35612512-d1c9-4158-adb8-3655498fd638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:56.223869 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35612512-d1c9-4158-adb8-3655498fd638 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:56.224756 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35612512-d1c9-4158-adb8-3655498fd638 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:56.225277 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35612512-d1c9-4158-adb8-3655498fd638 None admin] PATH_INFO: `/v3/users/6888ff673cd64e31b2d50533a8dbc8a2` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:56.226839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35612512-d1c9-4158-adb8-3655498fd638 None admin] RBAC: Authorizing `identity:get_user(user_id=6888ff673cd64e31b2d50533a8dbc8a2)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:56.229609 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35612512-d1c9-4158-adb8-3655498fd638 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:56.230934 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:56.232336 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 70/133] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:24:56 2022] GET /identity/v3/users/6888ff673cd64e31b2d50533a8dbc8a2 => generated 275 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:56.233758 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35612512-d1c9-4158-adb8-3655498fd638 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:56.367559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a882e4-547a-4be8-a44e-98391376d4e6 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:56.380818 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35612512-d1c9-4158-adb8-3655498fd638 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:56.425647 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570052a-2879-4412-8090-5fe3ea5a9a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:56.426876 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570052a-2879-4412-8090-5fe3ea5a9a36 None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:56.427404 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570052a-2879-4412-8090-5fe3ea5a9a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:56.428327 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570052a-2879-4412-8090-5fe3ea5a9a36 None admin] PATH_INFO: `/v3/projects/c2f4a4da4c594c13a6c96dbb2a1c12ce/users/6888ff673cd64e31b2d50533a8dbc8a2/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:56.430981 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570052a-2879-4412-8090-5fe3ea5a9a36 None admin] RBAC: Authorizing `identity:create_grant(project_id=c2f4a4da4c594c13a6c96dbb2a1c12ce, user_id=6888ff673cd64e31b2d50533a8dbc8a2, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:56.433667 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570052a-2879-4412-8090-5fe3ea5a9a36 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:56.437211 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a118b-64fd-4825-a61d-9a17c9c4e440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:56.438759 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a118b-64fd-4825-a61d-9a17c9c4e440 None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:56.439093 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a118b-64fd-4825-a61d-9a17c9c4e440 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:56.441151 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a118b-64fd-4825-a61d-9a17c9c4e440 None admin] PATH_INFO: `/v3/projects/cfef4a17bab2408d8ab3549e927bff2d/users/6888ff673cd64e31b2d50533a8dbc8a2/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:56.444902 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a118b-64fd-4825-a61d-9a17c9c4e440 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfef4a17bab2408d8ab3549e927bff2d, user_id=6888ff673cd64e31b2d50533a8dbc8a2, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:56.447528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a118b-64fd-4825-a61d-9a17c9c4e440 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:56.558122 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 71/134] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Sep 11 08:24:56 2022] PUT /identity/v3/projects/c2f4a4da4c594c13a6c96dbb2a1c12ce/users/6888ff673cd64e31b2d50533a8dbc8a2/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:24:56.559768 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570052a-2879-4412-8090-5fe3ea5a9a36 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:56.568504 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:56.606728 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 64/135] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Sep 11 08:24:56 2022] PUT /identity/v3/projects/cfef4a17bab2408d8ab3549e927bff2d/users/6888ff673cd64e31b2d50533a8dbc8a2/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:24:56.609082 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf8aca-4ecf-4ccc-90c4-9453d275525a None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:56.609583 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf8aca-4ecf-4ccc-90c4-9453d275525a None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:56.610036 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf8aca-4ecf-4ccc-90c4-9453d275525a None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:56.613414 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 65/136] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:24:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:24:56.623664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4def23-b9d1-4d87-a57b-aafc169462d6 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:56.624142 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4def23-b9d1-4d87-a57b-aafc169462d6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:56.624632 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4def23-b9d1-4d87-a57b-aafc169462d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:56.669069 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-3e4def23-b9d1-4d87-a57b-aafc169462d6 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:24:56.676421 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3e4def23-b9d1-4d87-a57b-aafc169462d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:24:56.835607 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 66/137] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:24:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 08:24:56.863864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570052a-2879-4412-8090-5fe3ea5a9a36 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:56.937504 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb57863-84c8-4b91-901c-3451da351329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:56.938620 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb57863-84c8-4b91-901c-3451da351329 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:56.939124 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb57863-84c8-4b91-901c-3451da351329 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:56.939643 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb57863-84c8-4b91-901c-3451da351329 None admin] PATH_INFO: `/v3/projects/cfef4a17bab2408d8ab3549e927bff2d` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:56.942574 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb57863-84c8-4b91-901c-3451da351329 None admin] RBAC: Authorizing `identity:get_project(project_id=cfef4a17bab2408d8ab3549e927bff2d)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:56.945716 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb57863-84c8-4b91-901c-3451da351329 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:56.949508 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 72/138] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:24:56 2022] GET /identity/v3/projects/cfef4a17bab2408d8ab3549e927bff2d => generated 298 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:56.959479 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4def23-b9d1-4d87-a57b-aafc169462d6 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:56.997776 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:57.197696 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4def23-b9d1-4d87-a57b-aafc169462d6 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:57.275297 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56053d88-0dde-45bb-ad0a-4352f06a0872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:57.276356 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56053d88-0dde-45bb-ad0a-4352f06a0872 None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:57.276864 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56053d88-0dde-45bb-ad0a-4352f06a0872 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:57.277357 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56053d88-0dde-45bb-ad0a-4352f06a0872 None admin] PATH_INFO: `/v3/projects/cfef4a17bab2408d8ab3549e927bff2d/users/6888ff673cd64e31b2d50533a8dbc8a2/roles/897bff7604d1492993a708763e54e6d8` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:57.279914 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56053d88-0dde-45bb-ad0a-4352f06a0872 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfef4a17bab2408d8ab3549e927bff2d, user_id=6888ff673cd64e31b2d50533a8dbc8a2, role_id=897bff7604d1492993a708763e54e6d8)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:57.281647 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56053d88-0dde-45bb-ad0a-4352f06a0872 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:57.365097 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 67/139] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Sep 11 08:24:56 2022] PUT /identity/v3/projects/cfef4a17bab2408d8ab3549e927bff2d/users/6888ff673cd64e31b2d50533a8dbc8a2/roles/897bff7604d1492993a708763e54e6d8 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:24:57.451516 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb57863-84c8-4b91-901c-3451da351329 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:57.554734 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:57.593968 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb57863-84c8-4b91-901c-3451da351329 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:57.641610 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6737e-089b-4abf-8a07-641ee22dc4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:57.642297 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6737e-089b-4abf-8a07-641ee22dc4d8 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:57.642583 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6737e-089b-4abf-8a07-641ee22dc4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:57.642867 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6737e-089b-4abf-8a07-641ee22dc4d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:57.644233 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d6737e-089b-4abf-8a07-641ee22dc4d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:57.646011 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d6737e-089b-4abf-8a07-641ee22dc4d8 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:57.647952 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 73/140] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:24:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:57.654596 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56053d88-0dde-45bb-ad0a-4352f06a0872 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:57.793605 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:57.832874 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56053d88-0dde-45bb-ad0a-4352f06a0872 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:57.879555 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3ba64-faec-42c6-a2fb-df7841f09782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:57.880177 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3ba64-faec-42c6-a2fb-df7841f09782 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:57.880461 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3ba64-faec-42c6-a2fb-df7841f09782 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:57.880739 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3ba64-faec-42c6-a2fb-df7841f09782 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:57.881440 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3ba64-faec-42c6-a2fb-df7841f09782 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:57.883023 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3ba64-faec-42c6-a2fb-df7841f09782 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:57.995875 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 68/141] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Sep 11 08:24:57 2022] POST /identity/v3/users => generated 283 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:24:58.423649 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dddbb2-3575-45ab-8c9f-5e92a8f7af0a None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:58.425251 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dddbb2-3575-45ab-8c9f-5e92a8f7af0a None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:58.426075 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dddbb2-3575-45ab-8c9f-5e92a8f7af0a None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:58.429010 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 74/142] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:24:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:24:58.434879 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6a4e1-bb0f-4588-ab0f-b9adbc09c4e3 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:58.435305 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6a4e1-bb0f-4588-ab0f-b9adbc09c4e3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:58.435535 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6a4e1-bb0f-4588-ab0f-b9adbc09c4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:58.459115 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e3a6a4e1-bb0f-4588-ab0f-b9adbc09c4e3 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:24:58.460397 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e3a6a4e1-bb0f-4588-ab0f-b9adbc09c4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:24:58.557819 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 69/143] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:24:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:24:59.125739 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dddbb2-3575-45ab-8c9f-5e92a8f7af0a None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:59.357444 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dddbb2-3575-45ab-8c9f-5e92a8f7af0a None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:59.446735 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ea960-7b76-4cae-9e1d-81c408acbac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:59.448481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ea960-7b76-4cae-9e1d-81c408acbac2 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:59.448876 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ea960-7b76-4cae-9e1d-81c408acbac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:59.449357 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ea960-7b76-4cae-9e1d-81c408acbac2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:59.473218 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:59.485084 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ea960-7b76-4cae-9e1d-81c408acbac2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:24:59.495104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-2c0ea960-7b76-4cae-9e1d-81c408acbac2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 08:24:59.495104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:24:59.495104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:24:59.495104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:24:59.495104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:24:59.495104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:24:59.495104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:24:59.495104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:24:59.495104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:24:59.495104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:24:59.495104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:24:59.495104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:24:59.495104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:24:59.495104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:24:59.495104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:24:59.495104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:24:59.496832 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:24:59.496832 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:24:59.496832 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:24:59.496832 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:24:59.496832 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:24:59.496832 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:24:59.496832 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:24:59.496832 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:24:59.496832 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:24:59.496832 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:24:59.496832 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:24:59.496832 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:24:59.496832 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:24:59.496832 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:24:59.496832 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:24:59.496832 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:24:59.499163 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:24:59.499163 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:24:59.499163 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:24:59.499163 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:24:59.499163 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:24:59.499163 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:24:59.499163 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:24:59.499163 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:24:59.499163 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:24:59.499163 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:24:59.499163 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 08:24:59.499163 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:24:59.499163 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 75/144] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:24:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:24:59.503917 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6a4e1-bb0f-4588-ab0f-b9adbc09c4e3 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:59.633284 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:24:59.691467 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6a4e1-bb0f-4588-ab0f-b9adbc09c4e3 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:24:59.736510 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea6124-952f-4bc2-91d8-63248e9f8bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:24:59.737141 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea6124-952f-4bc2-91d8-63248e9f8bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:24:59.737425 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea6124-952f-4bc2-91d8-63248e9f8bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:24:59.737703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea6124-952f-4bc2-91d8-63248e9f8bb5 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:24:59.738393 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea6124-952f-4bc2-91d8-63248e9f8bb5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:24:59.738704 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea6124-952f-4bc2-91d8-63248e9f8bb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:24:59.740158 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea6124-952f-4bc2-91d8-63248e9f8bb5 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:24:59.749950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 70/145] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Sep 11 08:24:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:24:59.756349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ea960-7b76-4cae-9e1d-81c408acbac2 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:24:59.980612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ea960-7b76-4cae-9e1d-81c408acbac2 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:00.045158 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad1c58-2c90-42db-9fd6-050ab85267f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:00.046165 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad1c58-2c90-42db-9fd6-050ab85267f7 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:00.046662 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad1c58-2c90-42db-9fd6-050ab85267f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:00.047145 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad1c58-2c90-42db-9fd6-050ab85267f7 None admin] PATH_INFO: `/v3/users/9169b15950d0478c86da739c4ef6f888` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:00.052525 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad1c58-2c90-42db-9fd6-050ab85267f7 None admin] RBAC: Authorizing `identity:get_user(user_id=9169b15950d0478c86da739c4ef6f888)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:00.055354 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad1c58-2c90-42db-9fd6-050ab85267f7 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:00.058790 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 76/146] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:24:59 2022] GET /identity/v3/users/9169b15950d0478c86da739c4ef6f888 => generated 289 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:00.065386 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea6124-952f-4bc2-91d8-63248e9f8bb5 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:00.218984 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea6124-952f-4bc2-91d8-63248e9f8bb5 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:00.248083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:00.263063 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a8e95-2a10-4eca-9bc4-bd9273b2e71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:00.263767 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a8e95-2a10-4eca-9bc4-bd9273b2e71d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:00.264049 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a8e95-2a10-4eca-9bc4-bd9273b2e71d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:00.264327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a8e95-2a10-4eca-9bc4-bd9273b2e71d None admin] PATH_INFO: `/v3/projects/cfef4a17bab2408d8ab3549e927bff2d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:00.265666 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a8e95-2a10-4eca-9bc4-bd9273b2e71d None admin] RBAC: Authorizing `identity:get_project(project_id=cfef4a17bab2408d8ab3549e927bff2d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:00.271689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a8e95-2a10-4eca-9bc4-bd9273b2e71d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:00.273678 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 71/147] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:25:00 2022] GET /identity/v3/projects/cfef4a17bab2408d8ab3549e927bff2d => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:00.280305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad1c58-2c90-42db-9fd6-050ab85267f7 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:00.445176 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:00.529615 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad1c58-2c90-42db-9fd6-050ab85267f7 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:00.600981 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d64d8-18ca-423f-a302-5fdbba9bee05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:00.602129 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d64d8-18ca-423f-a302-5fdbba9bee05 None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:00.602607 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d64d8-18ca-423f-a302-5fdbba9bee05 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:00.603716 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d64d8-18ca-423f-a302-5fdbba9bee05 None admin] PATH_INFO: `/v3/projects/cfef4a17bab2408d8ab3549e927bff2d/users/9169b15950d0478c86da739c4ef6f888/roles/4c81d75b246b4f55b100a3a15eaba6a4` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:00.613827 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d64d8-18ca-423f-a302-5fdbba9bee05 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfef4a17bab2408d8ab3549e927bff2d, user_id=9169b15950d0478c86da739c4ef6f888, role_id=4c81d75b246b4f55b100a3a15eaba6a4)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:00.616733 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d64d8-18ca-423f-a302-5fdbba9bee05 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:00.632106 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19310b-1399-41f9-bbfd-40f859f51d67 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:00.633167 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19310b-1399-41f9-bbfd-40f859f51d67 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:00.640413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19310b-1399-41f9-bbfd-40f859f51d67 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:00.640413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 72/148] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:25:00.644365 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dfc8c-698d-4cf7-959e-eed7c2cf129b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:00.645114 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dfc8c-698d-4cf7-959e-eed7c2cf129b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:00.645590 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dfc8c-698d-4cf7-959e-eed7c2cf129b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:00.670382 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-343dfc8c-698d-4cf7-959e-eed7c2cf129b None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:00.677104 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-343dfc8c-698d-4cf7-959e-eed7c2cf129b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:00.723593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 77/149] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Sep 11 08:25:00 2022] PUT /identity/v3/projects/cfef4a17bab2408d8ab3549e927bff2d/users/9169b15950d0478c86da739c4ef6f888/roles/4c81d75b246b4f55b100a3a15eaba6a4 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:25:00.787741 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 73/150] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:25:00.887645 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cb4f1-3ad4-422b-ab00-93c0774471c6 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:00.888099 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cb4f1-3ad4-422b-ab00-93c0774471c6 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:00.888571 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cb4f1-3ad4-422b-ab00-93c0774471c6 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:00.890995 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 78/151] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:00.899431 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c44b28-72ea-4031-879a-dca2c3302db8 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:00.900527 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c44b28-72ea-4031-879a-dca2c3302db8 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:00.900691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c44b28-72ea-4031-879a-dca2c3302db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:00.920273 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-a3c44b28-72ea-4031-879a-dca2c3302db8 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:00.921489 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a3c44b28-72ea-4031-879a-dca2c3302db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:01.012410 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 74/152] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:25:01.360038 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da61e8-15bb-43ce-be5a-26a7251f9619 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:01.360252 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da61e8-15bb-43ce-be5a-26a7251f9619 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:01.360633 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da61e8-15bb-43ce-be5a-26a7251f9619 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:01.362142 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 79/153] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:01.367822 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f27b1b-ed6b-472d-b18f-a3b9d6c3ef0f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:01.368195 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f27b1b-ed6b-472d-b18f-a3b9d6c3ef0f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:01.368444 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f27b1b-ed6b-472d-b18f-a3b9d6c3ef0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:01.393208 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-01f27b1b-ed6b-472d-b18f-a3b9d6c3ef0f None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:01.394441 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-01f27b1b-ed6b-472d-b18f-a3b9d6c3ef0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:01.460204 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:01.489885 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 75/154] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:25:01.579624 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103dbb0-8002-4f6c-b071-d6bede4077dc None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:01.580343 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103dbb0-8002-4f6c-b071-d6bede4077dc None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:01.580343 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103dbb0-8002-4f6c-b071-d6bede4077dc None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:01.581846 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 80/155] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:01.587946 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030c709-d61b-4e65-b4e6-ceafe892a7cd None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:01.588280 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030c709-d61b-4e65-b4e6-ceafe892a7cd None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:01.588506 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030c709-d61b-4e65-b4e6-ceafe892a7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:01.608428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f030c709-d61b-4e65-b4e6-ceafe892a7cd None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:01.609880 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f030c709-d61b-4e65-b4e6-ceafe892a7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:01.656169 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103dbb0-8002-4f6c-b071-d6bede4077dc None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:01.703876 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 76/156] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:25:01.910071 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103dbb0-8002-4f6c-b071-d6bede4077dc None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:01.910550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030c709-d61b-4e65-b4e6-ceafe892a7cd None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:01.961890 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:01.979931 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec38d49-840a-45d5-9c63-332a2149cd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:01.980593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec38d49-840a-45d5-9c63-332a2149cd7f None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:01.986331 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec38d49-840a-45d5-9c63-332a2149cd7f None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:01.986331 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec38d49-840a-45d5-9c63-332a2149cd7f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:02.014003 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec38d49-840a-45d5-9c63-332a2149cd7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:02.019001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-cec38d49-840a-45d5-9c63-332a2149cd7f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:25:02.019001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:02.019001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:02.019001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:02.019001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:02.019001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:02.019001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:02.019001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:02.019001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:02.019001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:02.019001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:02.019001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:02.019001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:02.019001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:02.019001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:02.019001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:02.019918 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:02.019918 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:02.019918 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:02.019918 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:02.019918 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:02.019918 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:02.019918 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:02.019918 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:02.019918 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:02.019918 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:02.019918 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:02.019918 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:02.019918 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:02.019918 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:02.019918 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:02.019918 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:02.020888 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:02.020888 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:02.020888 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:02.020888 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:02.020888 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:02.020888 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:02.020888 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:02.020888 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:02.020888 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:02.020888 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:02.020888 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:25:02.020888 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:25:02.021560 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 81/157] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:25:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:25:02.037148 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec38d49-840a-45d5-9c63-332a2149cd7f None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:02.159705 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030c709-d61b-4e65-b4e6-ceafe892a7cd None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:02.220070 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:02.260260 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce01f02-d4da-4356-b6c9-5a1309610f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:02.260931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce01f02-d4da-4356-b6c9-5a1309610f12 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:02.261213 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce01f02-d4da-4356-b6c9-5a1309610f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:02.261487 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce01f02-d4da-4356-b6c9-5a1309610f12 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:02.278274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce01f02-d4da-4356-b6c9-5a1309610f12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:02.283506 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-6ce01f02-d4da-4356-b6c9-5a1309610f12 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 08:25:02.283506 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:02.283506 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:02.283506 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:02.283506 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:02.283506 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:02.283506 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:02.283506 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:02.283506 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:02.283506 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:02.283506 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:02.283506 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:02.283506 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:02.283506 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:02.283506 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:02.283506 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:02.284520 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:02.284520 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:02.284520 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:02.284520 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:02.284520 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:02.284520 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:02.284520 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:02.284520 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:02.284520 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:02.284520 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:02.284520 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:02.284520 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:02.284520 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:02.284520 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:02.284520 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:02.284520 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:02.285394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:02.285394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:02.285394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:02.285394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:02.285394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:02.285394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:02.285394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:02.285394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:02.285394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:02.285394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:02.285394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 08:25:02.285394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:25:02.285394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 77/158] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Sep 11 08:25:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:25:02.286164 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce01f02-d4da-4356-b6c9-5a1309610f12 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:02.350866 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec38d49-840a-45d5-9c63-332a2149cd7f None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:02.429035 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ebe6e-3451-429a-9ee9-c85da3f68522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:02.429689 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ebe6e-3451-429a-9ee9-c85da3f68522 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:02.429970 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ebe6e-3451-429a-9ee9-c85da3f68522 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:02.430240 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ebe6e-3451-429a-9ee9-c85da3f68522 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:02.464938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ebe6e-3451-429a-9ee9-c85da3f68522 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:02.470628 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce01f02-d4da-4356-b6c9-5a1309610f12 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:02.470927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-b89ebe6e-3451-429a-9ee9-c85da3f68522 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:25:02.470927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:02.470927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:02.470927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:02.470927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:02.470927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:02.470927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:02.470927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:02.470927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:02.470927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:02.470927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:02.470927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:02.470927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:02.470927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:02.470927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:02.470927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:02.471974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:02.471974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:02.471974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:02.471974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:02.471974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:02.471974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:02.471974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:02.471974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:02.471974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:02.471974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:02.471974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:02.471974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:02.471974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:02.471974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:02.471974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:02.471974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:02.472912 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:02.472912 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:02.472912 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:02.472912 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:02.472912 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:02.472912 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:02.472912 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:02.472912 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:02.472912 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:02.472912 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:02.472912 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:25:02.472912 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:25:02.472912 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 82/159] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:25:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 451 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:25:02.473653 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ebe6e-3451-429a-9ee9-c85da3f68522 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:02.579343 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3f045-13fe-4aa8-af1f-ccef34d78cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:02.580220 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3f045-13fe-4aa8-af1f-ccef34d78cef None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:02.580507 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3f045-13fe-4aa8-af1f-ccef34d78cef None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:02.580785 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3f045-13fe-4aa8-af1f-ccef34d78cef None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:02.581542 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf3f045-13fe-4aa8-af1f-ccef34d78cef None admin] RBAC: Adding query filter params (name=member) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:02.581854 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf3f045-13fe-4aa8-af1f-ccef34d78cef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:02.583412 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf3f045-13fe-4aa8-af1f-ccef34d78cef None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:02.596819 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 78/160] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Sep 11 08:25:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:02.597698 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3f045-13fe-4aa8-af1f-ccef34d78cef None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:02.598482 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:02.671029 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:02.775113 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ebe6e-3451-429a-9ee9-c85da3f68522 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:02.812747 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3f045-13fe-4aa8-af1f-ccef34d78cef None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:02.858320 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edbc82-b6bf-4ee5-9493-0316419407cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:02.859432 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edbc82-b6bf-4ee5-9493-0316419407cc None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:02.859922 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edbc82-b6bf-4ee5-9493-0316419407cc None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:02.860399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edbc82-b6bf-4ee5-9493-0316419407cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:02.872928 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edbc82-b6bf-4ee5-9493-0316419407cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:02.878899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-e3edbc82-b6bf-4ee5-9493-0316419407cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:25:02.878899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:02.878899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:02.878899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:02.878899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:02.878899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:02.878899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:02.878899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:02.878899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:02.878899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:02.878899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:02.878899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:02.878899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:02.878899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:02.878899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:02.878899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:02.880114 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:02.880114 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:02.880114 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:02.880114 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:02.880114 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:02.880114 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:02.880114 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:02.880114 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:02.880114 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:02.880114 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:02.880114 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:02.880114 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:02.880114 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:02.880114 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:02.880114 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:02.880114 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:02.880903 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:02.880903 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:02.880903 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:02.880903 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:02.880903 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:02.880903 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:02.880903 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:02.880903 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:02.880903 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:02.880903 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:02.880903 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:25:02.880903 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:25:02.883487 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 79/161] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:25:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:25:02.885148 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edbc82-b6bf-4ee5-9493-0316419407cc None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:02.937362 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c0c30-22ca-4881-b567-308ce850d8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:02.938419 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c0c30-22ca-4881-b567-308ce850d8d5 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:02.938915 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c0c30-22ca-4881-b567-308ce850d8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:02.939443 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c0c30-22ca-4881-b567-308ce850d8d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:02.940674 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c0c30-22ca-4881-b567-308ce850d8d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:02.941202 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c0c30-22ca-4881-b567-308ce850d8d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:02.943862 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c0c30-22ca-4881-b567-308ce850d8d5 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:02.986914 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 83/162] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:25:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 514 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:02.991295 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c0c30-22ca-4881-b567-308ce850d8d5 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:03.015854 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:03.018423 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edbc82-b6bf-4ee5-9493-0316419407cc None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:03.058746 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c814831b-1151-4ac9-ad01-6c0e249c0208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:03.059734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814831b-1151-4ac9-ad01-6c0e249c0208 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:03.060224 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814831b-1151-4ac9-ad01-6c0e249c0208 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:03.060712 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814831b-1151-4ac9-ad01-6c0e249c0208 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:03.061654 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c814831b-1151-4ac9-ad01-6c0e249c0208 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:03.062167 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c814831b-1151-4ac9-ad01-6c0e249c0208 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:03.063959 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c814831b-1151-4ac9-ad01-6c0e249c0208 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:03.073775 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 80/163] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:25:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:03.075018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c814831b-1151-4ac9-ad01-6c0e249c0208 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:03.260036 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c814831b-1151-4ac9-ad01-6c0e249c0208 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:03.384519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48c584-d69a-4f9d-8325-0c1c22bfe605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:03.385478 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48c584-d69a-4f9d-8325-0c1c22bfe605 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:03.386118 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48c584-d69a-4f9d-8325-0c1c22bfe605 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:03.386547 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48c584-d69a-4f9d-8325-0c1c22bfe605 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:03.387809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48c584-d69a-4f9d-8325-0c1c22bfe605 None admin] RBAC: Adding query filter params (name=member) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:03.388332 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48c584-d69a-4f9d-8325-0c1c22bfe605 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:03.390886 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48c584-d69a-4f9d-8325-0c1c22bfe605 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:03.415107 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c0c30-22ca-4881-b567-308ce850d8d5 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:03.417503 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 81/164] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Sep 11 08:25:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:03.419020 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48c584-d69a-4f9d-8325-0c1c22bfe605 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:03.454408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:03.477425 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:03.557468 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b4996-5fae-44dc-961a-c5b369ac5bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:03.558453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b4996-5fae-44dc-961a-c5b369ac5bcf None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:03.558837 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b4996-5fae-44dc-961a-c5b369ac5bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:03.559473 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b4996-5fae-44dc-961a-c5b369ac5bcf None admin] PATH_INFO: `/v3/users/6888ff673cd64e31b2d50533a8dbc8a2` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:03.564428 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b4996-5fae-44dc-961a-c5b369ac5bcf None admin] RBAC: Authorizing `identity:get_user(user_id=6888ff673cd64e31b2d50533a8dbc8a2)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:03.567150 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b4996-5fae-44dc-961a-c5b369ac5bcf None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:03.570810 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 84/165] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:25:02 2022] GET /identity/v3/users/6888ff673cd64e31b2d50533a8dbc8a2 => generated 275 bytes in 583 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:03.572364 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b4996-5fae-44dc-961a-c5b369ac5bcf None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:03.770010 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b4996-5fae-44dc-961a-c5b369ac5bcf None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:03.803429 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48c584-d69a-4f9d-8325-0c1c22bfe605 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:03.809702 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31a074-8949-44b0-bd35-c69040e4e3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:03.810749 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31a074-8949-44b0-bd35-c69040e4e3f3 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:03.811278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31a074-8949-44b0-bd35-c69040e4e3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:03.811767 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31a074-8949-44b0-bd35-c69040e4e3f3 None admin] PATH_INFO: `/v3/users/3488db0374224de0980821b4dd705941` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:03.813272 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a31a074-8949-44b0-bd35-c69040e4e3f3 None admin] RBAC: Authorizing `identity:get_user(user_id=3488db0374224de0980821b4dd705941)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:03.814980 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a31a074-8949-44b0-bd35-c69040e4e3f3 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:03.817007 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 85/166] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:25:03 2022] GET /identity/v3/users/3488db0374224de0980821b4dd705941 => generated 247 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:03.818066 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31a074-8949-44b0-bd35-c69040e4e3f3 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:03.878406 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:03.928655 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd0543-0ef1-4916-b827-f39fb24eb0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:03.929670 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd0543-0ef1-4916-b827-f39fb24eb0de None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:03.930155 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd0543-0ef1-4916-b827-f39fb24eb0de None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:03.930638 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd0543-0ef1-4916-b827-f39fb24eb0de None admin] PATH_INFO: `/v3/users/6888ff673cd64e31b2d50533a8dbc8a2` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:03.936841 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd0543-0ef1-4916-b827-f39fb24eb0de None admin] RBAC: Authorizing `identity:get_user(user_id=6888ff673cd64e31b2d50533a8dbc8a2)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:03.939567 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd0543-0ef1-4916-b827-f39fb24eb0de None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:03.943056 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 82/167] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:25:03 2022] GET /identity/v3/users/6888ff673cd64e31b2d50533a8dbc8a2 => generated 275 bytes in 525 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:03.943715 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31a074-8949-44b0-bd35-c69040e4e3f3 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:03.944811 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd0543-0ef1-4916-b827-f39fb24eb0de None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:04.065840 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:04.082494 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd0543-0ef1-4916-b827-f39fb24eb0de None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:04.116549 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5083ec7-0f8d-4c57-acbb-f1942af6b975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:04.117960 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5083ec7-0f8d-4c57-acbb-f1942af6b975 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:04.118172 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5083ec7-0f8d-4c57-acbb-f1942af6b975 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:04.119176 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5083ec7-0f8d-4c57-acbb-f1942af6b975 None admin] PATH_INFO: `/v3/users/6888ff673cd64e31b2d50533a8dbc8a2` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:04.124660 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5083ec7-0f8d-4c57-acbb-f1942af6b975 None admin] RBAC: Authorizing `identity:get_user(user_id=6888ff673cd64e31b2d50533a8dbc8a2)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:04.127491 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5083ec7-0f8d-4c57-acbb-f1942af6b975 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:04.128814 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1213021-25af-43e8-91d0-0ca7af468576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:04.129853 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1213021-25af-43e8-91d0-0ca7af468576 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:04.130294 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 86/168] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:25:03 2022] GET /identity/v3/users/6888ff673cd64e31b2d50533a8dbc8a2 => generated 275 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:04.130568 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1213021-25af-43e8-91d0-0ca7af468576 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:04.131047 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1213021-25af-43e8-91d0-0ca7af468576 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:04.131574 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5083ec7-0f8d-4c57-acbb-f1942af6b975 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:04.219105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1213021-25af-43e8-91d0-0ca7af468576 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:04.221468 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1213021-25af-43e8-91d0-0ca7af468576 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:04.355547 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:04.366748 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5083ec7-0f8d-4c57-acbb-f1942af6b975 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:04.381873 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 83/169] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:25:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 08:25:04.381873 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1213021-25af-43e8-91d0-0ca7af468576 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:04.415821 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:04.476593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d2c5e-e780-4e8e-80c3-d860682423ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:04.477593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d2c5e-e780-4e8e-80c3-d860682423ae None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:04.478671 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d2c5e-e780-4e8e-80c3-d860682423ae None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:04.479088 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d2c5e-e780-4e8e-80c3-d860682423ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:04.546660 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1213021-25af-43e8-91d0-0ca7af468576 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:04.590418 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27c89f-c99c-4b5a-aee8-60c861e83d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:04.591663 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27c89f-c99c-4b5a-aee8-60c861e83d30 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:04.592133 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27c89f-c99c-4b5a-aee8-60c861e83d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:04.592617 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27c89f-c99c-4b5a-aee8-60c861e83d30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:04.630318 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d2c5e-e780-4e8e-80c3-d860682423ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:04.633113 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d2c5e-e780-4e8e-80c3-d860682423ae None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:04.667476 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:04.684361 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27c89f-c99c-4b5a-aee8-60c861e83d30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:04.687239 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27c89f-c99c-4b5a-aee8-60c861e83d30 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:04.814746 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 87/170] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:25:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 679 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 08:25:04.814746 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d2c5e-e780-4e8e-80c3-d860682423ae None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:04.843141 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:04.870270 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 84/171] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:25:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 08:25:04.876811 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ece521-f572-46db-9fe2-4e22b903afe4 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:04.877193 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ece521-f572-46db-9fe2-4e22b903afe4 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:04.877445 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ece521-f572-46db-9fe2-4e22b903afe4 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:04.879055 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 85/172] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:04.881094 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ece521-f572-46db-9fe2-4e22b903afe4 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:04.992006 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:05.026003 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d2c5e-e780-4e8e-80c3-d860682423ae None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:05.030505 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ece521-f572-46db-9fe2-4e22b903afe4 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:05.071331 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829514d1-8212-4250-821b-c58599fdce83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:05.072626 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829514d1-8212-4250-821b-c58599fdce83 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:05.073083 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829514d1-8212-4250-821b-c58599fdce83 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:05.073531 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829514d1-8212-4250-821b-c58599fdce83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:05.104232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e788f-5202-47a4-8c73-f4ac8b6d8293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:05.105327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e788f-5202-47a4-8c73-f4ac8b6d8293 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:05.105805 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e788f-5202-47a4-8c73-f4ac8b6d8293 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:05.106654 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e788f-5202-47a4-8c73-f4ac8b6d8293 None admin] PATH_INFO: `/v3/projects/c2f4a4da4c594c13a6c96dbb2a1c12ce` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:05.108906 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e788f-5202-47a4-8c73-f4ac8b6d8293 None admin] RBAC: Authorizing `identity:get_project(project_id=c2f4a4da4c594c13a6c96dbb2a1c12ce)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:05.112244 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e788f-5202-47a4-8c73-f4ac8b6d8293 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:05.121639 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 86/173] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:25:04 2022] GET /identity/v3/projects/c2f4a4da4c594c13a6c96dbb2a1c12ce => generated 312 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:05.121639 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab5d70-d36c-44c5-b7b0-4dc14549c6c8 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:05.121639 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab5d70-d36c-44c5-b7b0-4dc14549c6c8 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:05.121639 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab5d70-d36c-44c5-b7b0-4dc14549c6c8 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:05.123002 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 87/174] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:05.127130 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab5d70-d36c-44c5-b7b0-4dc14549c6c8 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:05.175322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829514d1-8212-4250-821b-c58599fdce83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:05.177888 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829514d1-8212-4250-821b-c58599fdce83 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:05.204187 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:05.292687 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab5d70-d36c-44c5-b7b0-4dc14549c6c8 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:05.354975 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1fcde-05a6-4759-bb63-af261046be5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:05.363745 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 88/175] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:25:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 08:25:05.363985 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1fcde-05a6-4759-bb63-af261046be5c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:05.364154 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829514d1-8212-4250-821b-c58599fdce83 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:05.364287 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1fcde-05a6-4759-bb63-af261046be5c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:05.364287 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1fcde-05a6-4759-bb63-af261046be5c None admin] PATH_INFO: `/v3/projects/cfef4a17bab2408d8ab3549e927bff2d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:05.365103 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1fcde-05a6-4759-bb63-af261046be5c None admin] RBAC: Authorizing `identity:get_project(project_id=cfef4a17bab2408d8ab3549e927bff2d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:05.369914 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1fcde-05a6-4759-bb63-af261046be5c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:05.379321 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 88/176] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:25:05 2022] GET /identity/v3/projects/cfef4a17bab2408d8ab3549e927bff2d => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:05.379321 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b211ff-a61a-4040-8e6b-43e1e6066c4e None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:05.379321 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b211ff-a61a-4040-8e6b-43e1e6066c4e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:05.379321 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b211ff-a61a-4040-8e6b-43e1e6066c4e None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:05.379876 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 89/177] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:05.381599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b4925-1cbf-4c9d-8a0e-3dcb17cdeadc None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:05.382105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b4925-1cbf-4c9d-8a0e-3dcb17cdeadc None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:05.382587 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b4925-1cbf-4c9d-8a0e-3dcb17cdeadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:05.413179 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-b85b4925-1cbf-4c9d-8a0e-3dcb17cdeadc None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:05.414612 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b85b4925-1cbf-4c9d-8a0e-3dcb17cdeadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:05.431999 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:05.481836 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829514d1-8212-4250-821b-c58599fdce83 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:05.498171 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:05.531282 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 90/178] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:25:05.531282 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b4925-1cbf-4c9d-8a0e-3dcb17cdeadc None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:05.533078 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfb130-43de-4be4-bd9b-60e172173245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:05.533886 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfb130-43de-4be4-bd9b-60e172173245 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:05.534316 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfb130-43de-4be4-bd9b-60e172173245 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:05.534727 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfb130-43de-4be4-bd9b-60e172173245 None admin] PATH_INFO: `/v3/projects/cfef4a17bab2408d8ab3549e927bff2d` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:05.536856 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cfb130-43de-4be4-bd9b-60e172173245 None admin] RBAC: Authorizing `identity:get_project(project_id=cfef4a17bab2408d8ab3549e927bff2d)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:05.538524 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cfb130-43de-4be4-bd9b-60e172173245 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:05.541694 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 89/179] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:25:05 2022] GET /identity/v3/projects/cfef4a17bab2408d8ab3549e927bff2d => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:05.549692 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d3e59-6c5a-4c8e-a80e-954ea740b8e9 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:05.549692 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d3e59-6c5a-4c8e-a80e-954ea740b8e9 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:05.549692 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d3e59-6c5a-4c8e-a80e-954ea740b8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:05.584617 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-579d3e59-6c5a-4c8e-a80e-954ea740b8e9 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:05.588585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-579d3e59-6c5a-4c8e-a80e-954ea740b8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:05.699988 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b4925-1cbf-4c9d-8a0e-3dcb17cdeadc None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:05.710526 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 90/180] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:25:05.711829 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d3e59-6c5a-4c8e-a80e-954ea740b8e9 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:05.767814 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c15764-9b14-40a2-9678-b57c93ba00a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:05.768831 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c15764-9b14-40a2-9678-b57c93ba00a7 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:05.769668 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c15764-9b14-40a2-9678-b57c93ba00a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:05.770128 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c15764-9b14-40a2-9678-b57c93ba00a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:05.772537 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c15764-9b14-40a2-9678-b57c93ba00a7 None admin] RBAC: Adding query filter params (role.id=3cecaf09e54b4f479cd391db74c49831, scope.project.id=c2f4a4da4c594c13a6c96dbb2a1c12ce, user.id=6888ff673cd64e31b2d50533a8dbc8a2) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:05.773083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c15764-9b14-40a2-9678-b57c93ba00a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:05.775760 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c15764-9b14-40a2-9678-b57c93ba00a7 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:05.787630 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 91/181] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:25:05 2022] GET /identity/v3/role_assignments?user.id=6888ff673cd64e31b2d50533a8dbc8a2&scope.project.id=c2f4a4da4c594c13a6c96dbb2a1c12ce&role.id=3cecaf09e54b4f479cd391db74c49831 => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:05.789731 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661cd6f-43cc-48e6-8131-4698ab1d3f1f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:05.790346 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661cd6f-43cc-48e6-8131-4698ab1d3f1f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:05.790804 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661cd6f-43cc-48e6-8131-4698ab1d3f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:05.822739 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2661cd6f-43cc-48e6-8131-4698ab1d3f1f None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:05.824738 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2661cd6f-43cc-48e6-8131-4698ab1d3f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:05.838936 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:05.945364 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d3e59-6c5a-4c8e-a80e-954ea740b8e9 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:05.962825 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 92/182] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:25:05.969594 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661cd6f-43cc-48e6-8131-4698ab1d3f1f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:05.979581 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:06.069079 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e54b6-673b-4895-b4d8-35005f8a2c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:06.073141 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e54b6-673b-4895-b4d8-35005f8a2c89 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:06.074650 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e54b6-673b-4895-b4d8-35005f8a2c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:06.076656 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e54b6-673b-4895-b4d8-35005f8a2c89 None admin] PATH_INFO: `/v3/projects/cfef4a17bab2408d8ab3549e927bff2d` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:06.080744 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065e54b6-673b-4895-b4d8-35005f8a2c89 None admin] RBAC: Authorizing `identity:get_project(project_id=cfef4a17bab2408d8ab3549e927bff2d)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:06.083502 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065e54b6-673b-4895-b4d8-35005f8a2c89 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:06.086728 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 91/183] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:25:05 2022] GET /identity/v3/projects/cfef4a17bab2408d8ab3549e927bff2d => generated 298 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:06.091452 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de280660-0fe6-4a8b-846d-4a587d457361 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:06.091940 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de280660-0fe6-4a8b-846d-4a587d457361 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:06.092419 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de280660-0fe6-4a8b-846d-4a587d457361 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:06.095098 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 92/184] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:06.099594 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de280660-0fe6-4a8b-846d-4a587d457361 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:06.255796 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661cd6f-43cc-48e6-8131-4698ab1d3f1f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:06.325668 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45811ad8-c848-45ca-a716-71caa3d2a504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:06.326635 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45811ad8-c848-45ca-a716-71caa3d2a504 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:06.327113 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45811ad8-c848-45ca-a716-71caa3d2a504 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:06.327422 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45811ad8-c848-45ca-a716-71caa3d2a504 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:06.328186 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45811ad8-c848-45ca-a716-71caa3d2a504 None admin] RBAC: Adding query filter params (role.id=d12af9f1dfb344cd8a6a493e165030ba, scope.project.id=cfef4a17bab2408d8ab3549e927bff2d, user.id=3488db0374224de0980821b4dd705941) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:06.328764 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45811ad8-c848-45ca-a716-71caa3d2a504 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:06.330294 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45811ad8-c848-45ca-a716-71caa3d2a504 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:06.344075 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 93/185] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:25:05 2022] GET /identity/v3/role_assignments?user.id=3488db0374224de0980821b4dd705941&scope.project.id=cfef4a17bab2408d8ab3549e927bff2d&role.id=d12af9f1dfb344cd8a6a493e165030ba => generated 608 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:06.344935 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45811ad8-c848-45ca-a716-71caa3d2a504 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:06.369560 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:06.380521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de280660-0fe6-4a8b-846d-4a587d457361 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:06.461563 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f94aa5-28f9-4f4d-a7c1-4ed6b9b0cca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:06.463577 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f94aa5-28f9-4f4d-a7c1-4ed6b9b0cca8 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:06.464076 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f94aa5-28f9-4f4d-a7c1-4ed6b9b0cca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:06.464570 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f94aa5-28f9-4f4d-a7c1-4ed6b9b0cca8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:06.465791 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f94aa5-28f9-4f4d-a7c1-4ed6b9b0cca8 None admin] RBAC: Adding query filter params (role.id=897bff7604d1492993a708763e54e6d8, scope.project.id=cfef4a17bab2408d8ab3549e927bff2d, user.id=6888ff673cd64e31b2d50533a8dbc8a2) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:06.466509 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f94aa5-28f9-4f4d-a7c1-4ed6b9b0cca8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:06.469943 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f94aa5-28f9-4f4d-a7c1-4ed6b9b0cca8 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:06.477236 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45811ad8-c848-45ca-a716-71caa3d2a504 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:06.491721 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 93/186] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:25:06 2022] GET /identity/v3/role_assignments?user.id=6888ff673cd64e31b2d50533a8dbc8a2&scope.project.id=cfef4a17bab2408d8ab3549e927bff2d&role.id=897bff7604d1492993a708763e54e6d8 => generated 608 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:06.494147 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f94aa5-28f9-4f4d-a7c1-4ed6b9b0cca8 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:06.520169 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e793c6-19af-4376-a04a-ce459bf3b567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:06.520753 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e793c6-19af-4376-a04a-ce459bf3b567 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:06.521043 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e793c6-19af-4376-a04a-ce459bf3b567 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:06.521317 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e793c6-19af-4376-a04a-ce459bf3b567 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:06.535442 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e793c6-19af-4376-a04a-ce459bf3b567 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:06.541616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-a7e793c6-19af-4376-a04a-ce459bf3b567 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:25:06.541616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:06.541616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:06.541616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:06.541616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:06.541616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:06.541616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:06.541616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:06.541616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:06.541616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:06.541616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:06.541616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:06.541616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:06.541616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:06.541616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:06.541616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:06.543159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:06.543159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:06.543159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:06.543159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:06.543159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:06.543159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:06.543159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:06.543159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:06.543159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:06.543159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:06.543159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:06.543159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:06.543159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:06.543159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:06.543159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:06.543159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:06.546710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:06.546710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:06.546710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:06.546710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:06.546710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:06.546710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:06.546710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:06.546710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:06.546710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:06.546710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:06.546710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:25:06.546710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:25:06.546710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 94/187] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:25:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:25:06.549262 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10a43a-f697-4c50-8c17-82f4be6da965 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:06.549262 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10a43a-f697-4c50-8c17-82f4be6da965 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:06.549262 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10a43a-f697-4c50-8c17-82f4be6da965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:06.579539 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-7b10a43a-f697-4c50-8c17-82f4be6da965 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:06.580914 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7b10a43a-f697-4c50-8c17-82f4be6da965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:06.623542 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:06.659695 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:06.676832 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 95/188] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:25:06.677989 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10a43a-f697-4c50-8c17-82f4be6da965 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:06.753316 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f94aa5-28f9-4f4d-a7c1-4ed6b9b0cca8 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:06.805652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10a43a-f697-4c50-8c17-82f4be6da965 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:06.829419 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff9b1d-3c79-42b8-931a-77dfb96c9bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:06.830880 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff9b1d-3c79-42b8-931a-77dfb96c9bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:06.831603 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff9b1d-3c79-42b8-931a-77dfb96c9bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:06.832426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff9b1d-3c79-42b8-931a-77dfb96c9bb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:06.834036 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff9b1d-3c79-42b8-931a-77dfb96c9bb9 None admin] RBAC: Adding query filter params (role.id=3cecaf09e54b4f479cd391db74c49831, scope.project.id=cfef4a17bab2408d8ab3549e927bff2d, user.id=6888ff673cd64e31b2d50533a8dbc8a2) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:06.834829 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff9b1d-3c79-42b8-931a-77dfb96c9bb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:06.838728 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff9b1d-3c79-42b8-931a-77dfb96c9bb9 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:06.850312 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b2750-a451-40cb-9211-4f4d44342295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:06.851388 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b2750-a451-40cb-9211-4f4d44342295 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:06.851878 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b2750-a451-40cb-9211-4f4d44342295 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:06.852003 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 94/189] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:25:06 2022] GET /identity/v3/role_assignments?user.id=6888ff673cd64e31b2d50533a8dbc8a2&scope.project.id=cfef4a17bab2408d8ab3549e927bff2d&role.id=3cecaf09e54b4f479cd391db74c49831 => generated 608 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:06.852478 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b2750-a451-40cb-9211-4f4d44342295 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:06.853707 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff9b1d-3c79-42b8-931a-77dfb96c9bb9 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:06.867076 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b2750-a451-40cb-9211-4f4d44342295 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:06.874545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-2a2b2750-a451-40cb-9211-4f4d44342295 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 08:25:06.874545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:06.874545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:06.874545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:06.874545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:06.874545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:06.874545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:06.874545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:06.874545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:06.874545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:06.874545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:06.874545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:06.874545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:06.874545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:06.874545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:06.874545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:06.875551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:06.875551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:06.875551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:06.875551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:06.875551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:06.875551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:06.875551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:06.875551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:06.875551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:06.875551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:06.875551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:06.875551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:06.875551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:06.875551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:06.875551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:06.875551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:06.876348 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:06.876348 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:06.876348 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:06.876348 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:06.876348 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:06.876348 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:06.876348 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:06.876348 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:06.876348 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:06.876348 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:06.876348 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 08:25:06.876348 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:25:06.878961 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 96/190] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Sep 11 08:25:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:25:06.880316 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b2750-a451-40cb-9211-4f4d44342295 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:06.965782 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:07.048619 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b2750-a451-40cb-9211-4f4d44342295 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:07.095549 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff9b1d-3c79-42b8-931a-77dfb96c9bb9 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:07.102748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2df25-553f-4b19-8961-51d1f7cd73ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:07.103724 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2df25-553f-4b19-8961-51d1f7cd73ea None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:07.104156 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2df25-553f-4b19-8961-51d1f7cd73ea None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:07.104575 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2df25-553f-4b19-8961-51d1f7cd73ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:07.107144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b2df25-553f-4b19-8961-51d1f7cd73ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:07.108950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b2df25-553f-4b19-8961-51d1f7cd73ea None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:07.111778 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:07.113132 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 97/191] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:25:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:07.114189 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2df25-553f-4b19-8961-51d1f7cd73ea None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:07.151076 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a289e-f6ac-4ceb-95a0-cefa74b4df88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:07.151793 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a289e-f6ac-4ceb-95a0-cefa74b4df88 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:07.152079 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a289e-f6ac-4ceb-95a0-cefa74b4df88 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:07.152405 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a289e-f6ac-4ceb-95a0-cefa74b4df88 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:07.153101 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a289e-f6ac-4ceb-95a0-cefa74b4df88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:07.153408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a289e-f6ac-4ceb-95a0-cefa74b4df88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:07.154807 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a289e-f6ac-4ceb-95a0-cefa74b4df88 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:07.175199 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 95/192] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:25:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:07.177974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a289e-f6ac-4ceb-95a0-cefa74b4df88 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:07.263930 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2df25-553f-4b19-8961-51d1f7cd73ea None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:07.288695 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:07.299470 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73119f62-df9e-4b3a-96d7-2459a636aa25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:07.300085 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73119f62-df9e-4b3a-96d7-2459a636aa25 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:07.300361 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73119f62-df9e-4b3a-96d7-2459a636aa25 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:07.300632 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73119f62-df9e-4b3a-96d7-2459a636aa25 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:07.301439 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73119f62-df9e-4b3a-96d7-2459a636aa25 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:07.301742 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73119f62-df9e-4b3a-96d7-2459a636aa25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:07.303128 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73119f62-df9e-4b3a-96d7-2459a636aa25 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:07.312332 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 98/193] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:25:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:07.313287 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73119f62-df9e-4b3a-96d7-2459a636aa25 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:07.313890 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a289e-f6ac-4ceb-95a0-cefa74b4df88 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:07.351058 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9dd8c9-6804-4773-9ead-231d60b045c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:07.351602 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dd8c9-6804-4773-9ead-231d60b045c0 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:07.351885 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dd8c9-6804-4773-9ead-231d60b045c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:07.352155 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dd8c9-6804-4773-9ead-231d60b045c0 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:07.352853 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9dd8c9-6804-4773-9ead-231d60b045c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:07.354335 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9dd8c9-6804-4773-9ead-231d60b045c0 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:07.427569 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73119f62-df9e-4b3a-96d7-2459a636aa25 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:07.461906 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 96/194] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Sep 11 08:25:07 2022] POST /identity/v3/users => generated 297 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:25:07.462786 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9dd8c9-6804-4773-9ead-231d60b045c0 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:07.471991 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40a8a7-ac5f-4e58-bd54-584b3d940258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:07.472671 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40a8a7-ac5f-4e58-bd54-584b3d940258 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:07.472953 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40a8a7-ac5f-4e58-bd54-584b3d940258 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:07.473324 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40a8a7-ac5f-4e58-bd54-584b3d940258 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:07.486751 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b40a8a7-ac5f-4e58-bd54-584b3d940258 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:07.492652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-3b40a8a7-ac5f-4e58-bd54-584b3d940258 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 08:25:07.492652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:07.492652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:07.492652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:07.492652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:07.492652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:07.492652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:07.492652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:07.492652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:07.492652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:07.492652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:07.492652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:07.492652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:07.492652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:07.492652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:07.492652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:07.494504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:07.494504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:07.494504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:07.494504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:07.494504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:07.494504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:07.494504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:07.494504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:07.494504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:07.494504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:07.494504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:07.494504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:07.494504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:07.494504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:07.494504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:07.494504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:07.495664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:07.495664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:07.495664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:07.495664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:07.495664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:07.495664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:07.495664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:07.495664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:07.495664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:07.495664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:07.495664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 08:25:07.495664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:25:07.497013 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 99/195] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:25:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:25:07.500364 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40a8a7-ac5f-4e58-bd54-584b3d940258 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:07.510178 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:07.581905 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:07.636594 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9dd8c9-6804-4773-9ead-231d60b045c0 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:07.643516 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40a8a7-ac5f-4e58-bd54-584b3d940258 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:07.695767 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa1630-6fd7-42fc-a1ce-1fff7ac22834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:07.696423 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa1630-6fd7-42fc-a1ce-1fff7ac22834 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:07.696827 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa1630-6fd7-42fc-a1ce-1fff7ac22834 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:07.697111 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa1630-6fd7-42fc-a1ce-1fff7ac22834 None admin] PATH_INFO: `/v3/users/81193b3ad0824a5a9cde7269fa3d5fec` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:07.701282 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130beaa-c120-4600-af4c-121e065286bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:07.702469 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130beaa-c120-4600-af4c-121e065286bb None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:07.702760 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130beaa-c120-4600-af4c-121e065286bb None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:07.703030 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130beaa-c120-4600-af4c-121e065286bb None admin] PATH_INFO: `/v3/users/81193b3ad0824a5a9cde7269fa3d5fec` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:07.718080 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa1630-6fd7-42fc-a1ce-1fff7ac22834 None admin] RBAC: Authorizing `identity:get_user(user_id=81193b3ad0824a5a9cde7269fa3d5fec)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:07.720161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa1630-6fd7-42fc-a1ce-1fff7ac22834 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:07.722250 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 97/196] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:25:07 2022] GET /identity/v3/users/81193b3ad0824a5a9cde7269fa3d5fec => generated 283 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:07.722720 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130beaa-c120-4600-af4c-121e065286bb None admin] RBAC: Authorizing `identity:get_user(user_id=81193b3ad0824a5a9cde7269fa3d5fec)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:07.722907 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa1630-6fd7-42fc-a1ce-1fff7ac22834 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:07.724391 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130beaa-c120-4600-af4c-121e065286bb None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:07.726260 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 100/197] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:25:07 2022] GET /identity/v3/users/81193b3ad0824a5a9cde7269fa3d5fec => generated 283 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:07.729362 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130beaa-c120-4600-af4c-121e065286bb None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:07.875322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:07.882348 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130beaa-c120-4600-af4c-121e065286bb None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:07.893123 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:07.895536 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa1630-6fd7-42fc-a1ce-1fff7ac22834 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:07.946810 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e01e9e-43c2-4ace-ac70-26199a28647d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:07.947507 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73725436-df63-4886-9b30-f88ab1f7f455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:07.948035 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e01e9e-43c2-4ace-ac70-26199a28647d None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:07.948555 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73725436-df63-4886-9b30-f88ab1f7f455 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:07.948779 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e01e9e-43c2-4ace-ac70-26199a28647d None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:07.949132 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73725436-df63-4886-9b30-f88ab1f7f455 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:07.949401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e01e9e-43c2-4ace-ac70-26199a28647d None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:07.949628 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73725436-df63-4886-9b30-f88ab1f7f455 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:07.950472 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e01e9e-43c2-4ace-ac70-26199a28647d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:07.951204 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e01e9e-43c2-4ace-ac70-26199a28647d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:07.953103 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e01e9e-43c2-4ace-ac70-26199a28647d None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:07.969085 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 98/198] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Sep 11 08:25:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:07.970244 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e01e9e-43c2-4ace-ac70-26199a28647d None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:08.067967 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73725436-df63-4886-9b30-f88ab1f7f455 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:08.069149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73725436-df63-4886-9b30-f88ab1f7f455 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:08.111356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e01e9e-43c2-4ace-ac70-26199a28647d None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:08.160955 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f7136-53bf-4c78-9f6f-82c4acb06da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:08.162215 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f7136-53bf-4c78-9f6f-82c4acb06da9 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:08.162706 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f7136-53bf-4c78-9f6f-82c4acb06da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:08.163798 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f7136-53bf-4c78-9f6f-82c4acb06da9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:08.195683 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:08.236842 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 101/199] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:25:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 08:25:08.238052 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73725436-df63-4886-9b30-f88ab1f7f455 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:08.242594 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:08.285185 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f7136-53bf-4c78-9f6f-82c4acb06da9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:08.286760 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f7136-53bf-4c78-9f6f-82c4acb06da9 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:08.377426 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73725436-df63-4886-9b30-f88ab1f7f455 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:08.431681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c4292-4450-45f9-a09f-199308553ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:08.433121 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c4292-4450-45f9-a09f-199308553ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:08.433640 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c4292-4450-45f9-a09f-199308553ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:08.434137 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c4292-4450-45f9-a09f-199308553ed9 None admin] PATH_INFO: `/v3/users/9169b15950d0478c86da739c4ef6f888` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:08.435766 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c4292-4450-45f9-a09f-199308553ed9 None admin] RBAC: Authorizing `identity:get_user(user_id=9169b15950d0478c86da739c4ef6f888)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:08.437509 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c4292-4450-45f9-a09f-199308553ed9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:08.440373 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 102/200] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:25:08 2022] GET /identity/v3/users/9169b15950d0478c86da739c4ef6f888 => generated 289 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:08.445350 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c4292-4450-45f9-a09f-199308553ed9 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:08.469295 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 99/201] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:25:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 08:25:08.474276 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f7136-53bf-4c78-9f6f-82c4acb06da9 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:08.559498 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:08.564118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:08.609826 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c4292-4450-45f9-a09f-199308553ed9 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:08.659956 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f7136-53bf-4c78-9f6f-82c4acb06da9 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:08.681530 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44483e11-48f7-47b5-aa0f-5b907f76330f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:08.682804 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44483e11-48f7-47b5-aa0f-5b907f76330f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:08.683233 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44483e11-48f7-47b5-aa0f-5b907f76330f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:08.683814 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44483e11-48f7-47b5-aa0f-5b907f76330f None admin] PATH_INFO: `/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:08.685768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44483e11-48f7-47b5-aa0f-5b907f76330f None admin] RBAC: Authorizing `identity:get_project(project_id=16bd6bbfd5774162b2c2103efb3a6d76)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:08.695209 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44483e11-48f7-47b5-aa0f-5b907f76330f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:08.698873 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 103/202] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:25:08 2022] GET /identity/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76 => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:08.700265 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44483e11-48f7-47b5-aa0f-5b907f76330f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:08.708687 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a950060-ebd2-4262-8540-428c42c19341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:08.709751 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a950060-ebd2-4262-8540-428c42c19341 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:08.710237 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a950060-ebd2-4262-8540-428c42c19341 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:08.710723 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a950060-ebd2-4262-8540-428c42c19341 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:08.831052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a950060-ebd2-4262-8540-428c42c19341 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:08.833934 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a950060-ebd2-4262-8540-428c42c19341 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:08.861684 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44483e11-48f7-47b5-aa0f-5b907f76330f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:08.906985 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00c522-18b4-4505-a083-887285739411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:08.908058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00c522-18b4-4505-a083-887285739411 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:08.908534 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00c522-18b4-4505-a083-887285739411 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:08.909025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00c522-18b4-4505-a083-887285739411 None admin] PATH_INFO: `/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:08.910712 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00c522-18b4-4505-a083-887285739411 None admin] RBAC: Authorizing `identity:get_project(project_id=16bd6bbfd5774162b2c2103efb3a6d76)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:08.912489 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00c522-18b4-4505-a083-887285739411 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:08.914554 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 104/203] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:25:08 2022] GET /identity/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:08.915683 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00c522-18b4-4505-a083-887285739411 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:08.927911 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:08.933385 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:09.039175 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00c522-18b4-4505-a083-887285739411 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:09.045260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 100/204] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:25:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 08:25:09.045260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a950060-ebd2-4262-8540-428c42c19341 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:09.088462 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28599e8f-294c-46cd-84ca-87d74184de74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:09.089472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28599e8f-294c-46cd-84ca-87d74184de74 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:09.089947 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28599e8f-294c-46cd-84ca-87d74184de74 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:09.090409 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28599e8f-294c-46cd-84ca-87d74184de74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:09.091380 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28599e8f-294c-46cd-84ca-87d74184de74 None admin] RBAC: Adding query filter params (role.id=d12af9f1dfb344cd8a6a493e165030ba, scope.project.id=16bd6bbfd5774162b2c2103efb3a6d76, user.id=81193b3ad0824a5a9cde7269fa3d5fec) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:09.091915 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28599e8f-294c-46cd-84ca-87d74184de74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:09.093804 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28599e8f-294c-46cd-84ca-87d74184de74 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:09.100631 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 105/205] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:25:08 2022] GET /identity/v3/role_assignments?user.id=81193b3ad0824a5a9cde7269fa3d5fec&scope.project.id=16bd6bbfd5774162b2c2103efb3a6d76&role.id=d12af9f1dfb344cd8a6a493e165030ba => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:09.101746 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28599e8f-294c-46cd-84ca-87d74184de74 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:09.190458 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:09.229556 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28599e8f-294c-46cd-84ca-87d74184de74 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:09.241164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a950060-ebd2-4262-8540-428c42c19341 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:09.270493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefec63f-6ebf-4989-aaec-9ae5876cebc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:09.271604 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefec63f-6ebf-4989-aaec-9ae5876cebc6 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:09.272107 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefec63f-6ebf-4989-aaec-9ae5876cebc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:09.272575 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefec63f-6ebf-4989-aaec-9ae5876cebc6 None admin] PATH_INFO: `/v3/projects/cfef4a17bab2408d8ab3549e927bff2d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:09.274022 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefec63f-6ebf-4989-aaec-9ae5876cebc6 None admin] RBAC: Authorizing `identity:get_project(project_id=cfef4a17bab2408d8ab3549e927bff2d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:09.275795 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefec63f-6ebf-4989-aaec-9ae5876cebc6 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:09.277987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 106/206] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:25:09 2022] GET /identity/v3/projects/cfef4a17bab2408d8ab3549e927bff2d => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:09.288450 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefec63f-6ebf-4989-aaec-9ae5876cebc6 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:09.311288 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d7867-4e30-4a37-9f44-352c2e8f09f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:09.311288 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d7867-4e30-4a37-9f44-352c2e8f09f3 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:09.311288 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d7867-4e30-4a37-9f44-352c2e8f09f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:09.311288 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d7867-4e30-4a37-9f44-352c2e8f09f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:09.311802 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d7867-4e30-4a37-9f44-352c2e8f09f3 None admin] RBAC: Adding query filter params (role.id=897bff7604d1492993a708763e54e6d8, scope.project.id=16bd6bbfd5774162b2c2103efb3a6d76, user.id=81193b3ad0824a5a9cde7269fa3d5fec) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:09.312309 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d7867-4e30-4a37-9f44-352c2e8f09f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:09.315224 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d7867-4e30-4a37-9f44-352c2e8f09f3 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:09.328282 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 101/207] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:25:09 2022] GET /identity/v3/role_assignments?user.id=81193b3ad0824a5a9cde7269fa3d5fec&scope.project.id=16bd6bbfd5774162b2c2103efb3a6d76&role.id=897bff7604d1492993a708763e54e6d8 => generated 259 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:09.572724 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefec63f-6ebf-4989-aaec-9ae5876cebc6 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:09.646397 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd6194-89c1-4403-82cf-9aa159f74dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:09.647552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd6194-89c1-4403-82cf-9aa159f74dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:09.648040 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd6194-89c1-4403-82cf-9aa159f74dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:09.648523 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd6194-89c1-4403-82cf-9aa159f74dc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:09.650459 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd6194-89c1-4403-82cf-9aa159f74dc9 None admin] RBAC: Adding query filter params (role.id=4c81d75b246b4f55b100a3a15eaba6a4, scope.project.id=cfef4a17bab2408d8ab3549e927bff2d, user.id=9169b15950d0478c86da739c4ef6f888) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:09.651017 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd6194-89c1-4403-82cf-9aa159f74dc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:09.654172 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd6194-89c1-4403-82cf-9aa159f74dc9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:09.666311 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 107/208] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:25:09 2022] GET /identity/v3/role_assignments?user.id=9169b15950d0478c86da739c4ef6f888&scope.project.id=cfef4a17bab2408d8ab3549e927bff2d&role.id=4c81d75b246b4f55b100a3a15eaba6a4 => generated 608 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:10.438282 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d0bed-560a-4c99-be93-c0ca9b22b8b3 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:10.438852 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d0bed-560a-4c99-be93-c0ca9b22b8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:10.439128 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d0bed-560a-4c99-be93-c0ca9b22b8b3 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:10.441768 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 102/209] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:10.457154 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d8f9b-63f6-41bd-81cc-785aefc7f062 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:10.458024 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d8f9b-63f6-41bd-81cc-785aefc7f062 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:10.458783 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d8f9b-63f6-41bd-81cc-785aefc7f062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:10.471539 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:10.493822 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-716d8f9b-63f6-41bd-81cc-785aefc7f062 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:10.496275 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-716d8f9b-63f6-41bd-81cc-785aefc7f062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:10.570984 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c3b96-526d-49e3-a5e3-ec87ba91b523 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:10.572758 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c3b96-526d-49e3-a5e3-ec87ba91b523 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:10.573570 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c3b96-526d-49e3-a5e3-ec87ba91b523 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:10.576762 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 103/210] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:10.588287 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d3206-ebcb-4243-adb2-fddadea307d1 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:10.589130 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d3206-ebcb-4243-adb2-fddadea307d1 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:10.589822 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d3206-ebcb-4243-adb2-fddadea307d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:10.621408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-217d3206-ebcb-4243-adb2-fddadea307d1 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:10.623623 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-217d3206-ebcb-4243-adb2-fddadea307d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:10.630377 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:10.661223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 108/211] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:25:10.748700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 104/212] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:25:11.186794 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d8f9b-63f6-41bd-81cc-785aefc7f062 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:11.260852 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d3206-ebcb-4243-adb2-fddadea307d1 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:11.401356 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d8f9b-63f6-41bd-81cc-785aefc7f062 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:11.471241 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a0bf0-e996-4d2f-a5c0-b312978e65c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:11.471804 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d3206-ebcb-4243-adb2-fddadea307d1 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:11.473760 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a0bf0-e996-4d2f-a5c0-b312978e65c9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:11.474643 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a0bf0-e996-4d2f-a5c0-b312978e65c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:11.475479 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a0bf0-e996-4d2f-a5c0-b312978e65c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:11.480286 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:11.498950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a0bf0-e996-4d2f-a5c0-b312978e65c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:11.509370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-fc2a0bf0-e996-4d2f-a5c0-b312978e65c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:25:11.509370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:11.509370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:11.509370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:11.509370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:11.509370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:11.509370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:11.509370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:11.509370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:11.509370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:11.509370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:11.509370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:11.509370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:11.509370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:11.509370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:11.509370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:11.511020 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:11.511020 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:11.511020 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:11.511020 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:11.511020 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:11.511020 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:11.511020 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:11.511020 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:11.511020 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:11.511020 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:11.511020 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:11.511020 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:11.511020 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:11.511020 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:11.511020 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:11.511020 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:11.512661 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:11.512661 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:11.512661 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:11.512661 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:11.512661 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:11.512661 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:11.512661 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:11.512661 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:11.512661 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:11.512661 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:11.512661 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:25:11.512661 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:25:11.517371 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 109/213] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:25:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:25:11.527436 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a0bf0-e996-4d2f-a5c0-b312978e65c9 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:11.546117 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5c443-5420-48d2-b8ea-8db2360d8a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:11.547713 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5c443-5420-48d2-b8ea-8db2360d8a6a None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:11.548468 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5c443-5420-48d2-b8ea-8db2360d8a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:11.549216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5c443-5420-48d2-b8ea-8db2360d8a6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:11.551665 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5c443-5420-48d2-b8ea-8db2360d8a6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:11.554465 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5c443-5420-48d2-b8ea-8db2360d8a6a None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:11.558002 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 105/214] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:25:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:11.566747 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5c443-5420-48d2-b8ea-8db2360d8a6a None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:11.591667 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:11.725244 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a0bf0-e996-4d2f-a5c0-b312978e65c9 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:11.772065 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec654932-9051-496f-b220-82e0d10509f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:11.772689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec654932-9051-496f-b220-82e0d10509f4 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:11.772971 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec654932-9051-496f-b220-82e0d10509f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:11.773246 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec654932-9051-496f-b220-82e0d10509f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:11.773926 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec654932-9051-496f-b220-82e0d10509f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:11.774233 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec654932-9051-496f-b220-82e0d10509f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:11.775141 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5c443-5420-48d2-b8ea-8db2360d8a6a None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:11.776214 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec654932-9051-496f-b220-82e0d10509f4 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:11.785665 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 110/215] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Sep 11 08:25:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:25:11.787412 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4ecd4-8ef5-45c1-bad5-1ee350961ea7 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:11.787953 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4ecd4-8ef5-45c1-bad5-1ee350961ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:11.788437 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4ecd4-8ef5-45c1-bad5-1ee350961ea7 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:11.790947 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 111/216] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:11.795992 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4ecd4-8ef5-45c1-bad5-1ee350961ea7 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:11.840850 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d4923-e53c-4e14-8d5a-0ff01f327a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:11.841475 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d4923-e53c-4e14-8d5a-0ff01f327a2c None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:11.841771 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d4923-e53c-4e14-8d5a-0ff01f327a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:11.842063 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d4923-e53c-4e14-8d5a-0ff01f327a2c None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:11.842697 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d4923-e53c-4e14-8d5a-0ff01f327a2c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:11.844204 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d4923-e53c-4e14-8d5a-0ff01f327a2c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:11.866026 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:11.913672 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4ecd4-8ef5-45c1-bad5-1ee350961ea7 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:11.949523 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63281fc-da6a-4a9f-81be-658bbeff9fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:11.950173 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63281fc-da6a-4a9f-81be-658bbeff9fab None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:11.950454 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63281fc-da6a-4a9f-81be-658bbeff9fab None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:11.950775 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63281fc-da6a-4a9f-81be-658bbeff9fab None admin] PATH_INFO: `/v3/users/4925c25c93c147b9b92a596470d66d75` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:11.954988 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 106/217] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Sep 11 08:25:11 2022] POST /identity/v3/users => generated 297 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:25:11.963112 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7440f-e442-41f9-994d-0de116854479 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:11.963575 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7440f-e442-41f9-994d-0de116854479 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:11.964106 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7440f-e442-41f9-994d-0de116854479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:11.970686 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63281fc-da6a-4a9f-81be-658bbeff9fab None admin] RBAC: Authorizing `identity:get_user(user_id=4925c25c93c147b9b92a596470d66d75)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:11.973417 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63281fc-da6a-4a9f-81be-658bbeff9fab None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:11.985825 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 112/218] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:25:11 2022] GET /identity/v3/users/4925c25c93c147b9b92a596470d66d75 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:11.985825 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4f97c-148a-4580-a51f-fbe8cf59f7b6 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:11.985825 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4f97c-148a-4580-a51f-fbe8cf59f7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:11.985825 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4f97c-148a-4580-a51f-fbe8cf59f7b6 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:11.991341 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 113/219] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:11.991341 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4f97c-148a-4580-a51f-fbe8cf59f7b6 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:12.001913 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-01e7440f-e442-41f9-994d-0de116854479 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:12.003901 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-01e7440f-e442-41f9-994d-0de116854479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:12.106286 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:12.120860 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 107/220] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:25:12.122858 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c73a8-18ea-41b9-a85a-9cbae967003f None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:12.123702 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c73a8-18ea-41b9-a85a-9cbae967003f None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:12.123860 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c73a8-18ea-41b9-a85a-9cbae967003f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:12.160642 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-5e9c73a8-18ea-41b9-a85a-9cbae967003f None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:12.163102 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5e9c73a8-18ea-41b9-a85a-9cbae967003f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:12.182710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4f97c-148a-4580-a51f-fbe8cf59f7b6 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:12.203850 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:12.234302 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08545993-4190-4098-95cb-f7dfa8f9f71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:12.234931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08545993-4190-4098-95cb-f7dfa8f9f71f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:12.235278 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08545993-4190-4098-95cb-f7dfa8f9f71f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:12.235547 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08545993-4190-4098-95cb-f7dfa8f9f71f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:12.287039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 108/221] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:25:12.345743 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08545993-4190-4098-95cb-f7dfa8f9f71f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:12.348801 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08545993-4190-4098-95cb-f7dfa8f9f71f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:12.411618 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c73a8-18ea-41b9-a85a-9cbae967003f None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:12.479129 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 114/222] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:25:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 08:25:12.484836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08545993-4190-4098-95cb-f7dfa8f9f71f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:12.501594 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:12.553659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c73a8-18ea-41b9-a85a-9cbae967003f None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:12.591096 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:12.615229 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b52a7f-38c7-4eb9-80d3-0191f5624331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:12.615922 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b52a7f-38c7-4eb9-80d3-0191f5624331 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:12.616202 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b52a7f-38c7-4eb9-80d3-0191f5624331 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:12.616473 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b52a7f-38c7-4eb9-80d3-0191f5624331 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:12.637132 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b52a7f-38c7-4eb9-80d3-0191f5624331 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:12.642900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-c6b52a7f-38c7-4eb9-80d3-0191f5624331 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:25:12.642900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:12.642900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:12.642900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:12.642900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:12.642900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:12.642900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:12.642900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:12.642900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:12.642900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:12.642900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:12.642900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:12.642900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:12.642900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:12.642900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:12.642900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:12.643870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:12.643870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:12.643870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:12.643870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:12.643870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:12.643870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:12.643870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:12.643870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:12.643870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:12.643870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:12.643870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:12.643870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:12.643870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:12.643870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:12.643870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:12.643870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:12.644669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:12.644669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:12.644669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:12.644669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:12.644669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:12.644669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:12.644669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:12.644669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:12.644669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:12.644669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:12.644669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:25:12.644669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:25:12.646622 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08545993-4190-4098-95cb-f7dfa8f9f71f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:12.648255 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 109/223] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:25:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:25:12.656559 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b52a7f-38c7-4eb9-80d3-0191f5624331 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:12.727595 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b870f40-4917-44ff-beed-5c30a2ca22ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:12.728290 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b870f40-4917-44ff-beed-5c30a2ca22ed None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:12.728538 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b870f40-4917-44ff-beed-5c30a2ca22ed None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:12.728819 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b870f40-4917-44ff-beed-5c30a2ca22ed None admin] PATH_INFO: `/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:12.732122 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b870f40-4917-44ff-beed-5c30a2ca22ed None admin] RBAC: Authorizing `identity:get_project(project_id=16bd6bbfd5774162b2c2103efb3a6d76)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:12.734846 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b870f40-4917-44ff-beed-5c30a2ca22ed None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:12.744829 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 115/224] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:25:12 2022] GET /identity/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76 => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:25:12.746429 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b870f40-4917-44ff-beed-5c30a2ca22ed None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:12.822653 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b52a7f-38c7-4eb9-80d3-0191f5624331 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:12.867237 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:12.872504 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbecc2-b2a7-42cb-a62f-a7499e2e615b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:12.881075 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbecc2-b2a7-42cb-a62f-a7499e2e615b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:12.881075 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbecc2-b2a7-42cb-a62f-a7499e2e615b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:12.881075 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbecc2-b2a7-42cb-a62f-a7499e2e615b None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:12.881075 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cbecc2-b2a7-42cb-a62f-a7499e2e615b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:12.881075 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cbecc2-b2a7-42cb-a62f-a7499e2e615b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:12.881075 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cbecc2-b2a7-42cb-a62f-a7499e2e615b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:12.889357 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b870f40-4917-44ff-beed-5c30a2ca22ed None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:12.889556 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 110/225] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:25:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:25:12.890326 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbecc2-b2a7-42cb-a62f-a7499e2e615b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:12.940876 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77df7a-a8b6-4536-86dc-42ec01b9698b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:12.941966 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77df7a-a8b6-4536-86dc-42ec01b9698b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:12.942501 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77df7a-a8b6-4536-86dc-42ec01b9698b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:12.943436 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77df7a-a8b6-4536-86dc-42ec01b9698b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:12.948823 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:12.960225 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77df7a-a8b6-4536-86dc-42ec01b9698b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:12.968643 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-cd77df7a-a8b6-4536-86dc-42ec01b9698b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 08:25:12.968643 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:12.968643 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:12.968643 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:12.968643 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:12.968643 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:12.968643 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:12.968643 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:12.968643 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:12.968643 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:12.968643 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:12.968643 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:12.968643 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:12.968643 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:12.968643 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:12.968643 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:12.969697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:12.969697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:12.969697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:12.969697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:12.969697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:12.969697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:12.969697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:12.969697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:12.969697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:12.969697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:12.969697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:12.969697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:12.969697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:12.969697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:12.969697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:12.969697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:12.970524 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:12.970524 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:12.970524 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:12.970524 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:12.970524 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:12.970524 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:12.970524 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:12.970524 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:12.970524 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:12.970524 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:12.970524 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 08:25:12.970524 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:25:12.972802 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 116/226] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Sep 11 08:25:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:25:12.973443 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77df7a-a8b6-4536-86dc-42ec01b9698b None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:13.017796 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbecc2-b2a7-42cb-a62f-a7499e2e615b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:13.060990 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3158a8-eaf4-4c3a-b66e-68f3ffbac06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:13.061572 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3158a8-eaf4-4c3a-b66e-68f3ffbac06e None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:13.061944 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3158a8-eaf4-4c3a-b66e-68f3ffbac06e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:13.062221 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3158a8-eaf4-4c3a-b66e-68f3ffbac06e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:13.063028 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3158a8-eaf4-4c3a-b66e-68f3ffbac06e None admin] RBAC: Adding query filter params (role.id=3cecaf09e54b4f479cd391db74c49831, scope.project.id=16bd6bbfd5774162b2c2103efb3a6d76, user.id=4925c25c93c147b9b92a596470d66d75) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:13.063391 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3158a8-eaf4-4c3a-b66e-68f3ffbac06e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:13.065039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3158a8-eaf4-4c3a-b66e-68f3ffbac06e None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:13.072193 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 111/227] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:25:12 2022] GET /identity/v3/role_assignments?user.id=4925c25c93c147b9b92a596470d66d75&scope.project.id=16bd6bbfd5774162b2c2103efb3a6d76&role.id=3cecaf09e54b4f479cd391db74c49831 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:13.073133 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3158a8-eaf4-4c3a-b66e-68f3ffbac06e None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:13.122046 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77df7a-a8b6-4536-86dc-42ec01b9698b None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:13.171236 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7e840-837e-4295-baae-0255078d8a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:13.171236 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7e840-837e-4295-baae-0255078d8a51 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:13.171536 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7e840-837e-4295-baae-0255078d8a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:13.171777 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7e840-837e-4295-baae-0255078d8a51 None admin] PATH_INFO: `/v3/users/81193b3ad0824a5a9cde7269fa3d5fec` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:13.176093 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d7e840-837e-4295-baae-0255078d8a51 None admin] RBAC: Authorizing `identity:get_user(user_id=81193b3ad0824a5a9cde7269fa3d5fec)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:13.177948 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d7e840-837e-4295-baae-0255078d8a51 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:13.179762 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 117/228] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:25:12 2022] GET /identity/v3/users/81193b3ad0824a5a9cde7269fa3d5fec => generated 283 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:13.185682 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7e840-837e-4295-baae-0255078d8a51 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:13.208402 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:13.212159 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3158a8-eaf4-4c3a-b66e-68f3ffbac06e None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:13.225301 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:13.257248 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee850b9-aeae-48dc-aa94-5e216c97a879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:13.258326 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee850b9-aeae-48dc-aa94-5e216c97a879 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:13.259509 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee850b9-aeae-48dc-aa94-5e216c97a879 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:13.260059 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee850b9-aeae-48dc-aa94-5e216c97a879 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:13.261261 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee850b9-aeae-48dc-aa94-5e216c97a879 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:13.261851 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee850b9-aeae-48dc-aa94-5e216c97a879 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:13.263576 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee850b9-aeae-48dc-aa94-5e216c97a879 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:13.275533 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 112/229] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:25:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:13.288402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee850b9-aeae-48dc-aa94-5e216c97a879 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:13.360532 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7e840-837e-4295-baae-0255078d8a51 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:13.430855 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2f731-5dea-4324-91c8-7765966c8ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:13.432640 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2f731-5dea-4324-91c8-7765966c8ddf None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:13.433418 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2f731-5dea-4324-91c8-7765966c8ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:13.434202 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2f731-5dea-4324-91c8-7765966c8ddf None admin] PATH_INFO: `/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:13.436787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2f731-5dea-4324-91c8-7765966c8ddf None admin] RBAC: Authorizing `identity:get_project(project_id=16bd6bbfd5774162b2c2103efb3a6d76)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:13.440174 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2f731-5dea-4324-91c8-7765966c8ddf None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:13.444240 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 118/230] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:25:13 2022] GET /identity/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76 => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:25:13.455321 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2f731-5dea-4324-91c8-7765966c8ddf None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:13.494174 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee850b9-aeae-48dc-aa94-5e216c97a879 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:13.558007 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d6774-71bb-4f56-b962-b523a2cba709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:13.558970 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d6774-71bb-4f56-b962-b523a2cba709 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:13.558970 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d6774-71bb-4f56-b962-b523a2cba709 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:13.559213 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d6774-71bb-4f56-b962-b523a2cba709 None admin] PATH_INFO: `/v3/users/81193b3ad0824a5a9cde7269fa3d5fec` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:13.560432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d6774-71bb-4f56-b962-b523a2cba709 None admin] RBAC: Authorizing `identity:get_user(user_id=81193b3ad0824a5a9cde7269fa3d5fec)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:13.561921 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d6774-71bb-4f56-b962-b523a2cba709 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:13.563923 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 113/231] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:25:13 2022] GET /identity/v3/users/81193b3ad0824a5a9cde7269fa3d5fec => generated 283 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:13.569430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d6774-71bb-4f56-b962-b523a2cba709 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:13.632703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:13.651778 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:13.716462 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2f731-5dea-4324-91c8-7765966c8ddf None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:13.735182 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d6774-71bb-4f56-b962-b523a2cba709 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:13.779100 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c56174-65c0-4056-9343-b44a612596ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:13.779903 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c56174-65c0-4056-9343-b44a612596ce None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:13.780201 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c56174-65c0-4056-9343-b44a612596ce None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:13.780472 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c56174-65c0-4056-9343-b44a612596ce None admin] PATH_INFO: `/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:13.781866 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c56174-65c0-4056-9343-b44a612596ce None admin] RBAC: Authorizing `identity:get_project(project_id=16bd6bbfd5774162b2c2103efb3a6d76)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:13.783421 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c56174-65c0-4056-9343-b44a612596ce None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:13.785542 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 114/232] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:25:13 2022] GET /identity/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:25:13.793876 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c56174-65c0-4056-9343-b44a612596ce None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:13.831524 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5785798-7b45-4134-9100-10b1aec65b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:13.832329 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5785798-7b45-4134-9100-10b1aec65b4b None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:13.832609 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5785798-7b45-4134-9100-10b1aec65b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:13.832886 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5785798-7b45-4134-9100-10b1aec65b4b None admin] PATH_INFO: `/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76/users/81193b3ad0824a5a9cde7269fa3d5fec/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:13.837783 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5785798-7b45-4134-9100-10b1aec65b4b None admin] RBAC: Authorizing `identity:create_grant(project_id=16bd6bbfd5774162b2c2103efb3a6d76, user_id=81193b3ad0824a5a9cde7269fa3d5fec, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:13.839372 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5785798-7b45-4134-9100-10b1aec65b4b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:13.934119 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 119/233] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Sep 11 08:25:13 2022] PUT /identity/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76/users/81193b3ad0824a5a9cde7269fa3d5fec/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:25:14.013615 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c56174-65c0-4056-9343-b44a612596ce None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:14.033152 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:14.095912 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5989e0d-45ed-44fd-b118-8f24d733066d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:14.097049 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5989e0d-45ed-44fd-b118-8f24d733066d None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:14.097541 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5989e0d-45ed-44fd-b118-8f24d733066d None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:14.098039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5989e0d-45ed-44fd-b118-8f24d733066d None admin] PATH_INFO: `/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76/users/81193b3ad0824a5a9cde7269fa3d5fec/roles/897bff7604d1492993a708763e54e6d8` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:14.105795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5989e0d-45ed-44fd-b118-8f24d733066d None admin] RBAC: Authorizing `identity:create_grant(project_id=16bd6bbfd5774162b2c2103efb3a6d76, user_id=81193b3ad0824a5a9cde7269fa3d5fec, role_id=897bff7604d1492993a708763e54e6d8)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:14.108775 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5989e0d-45ed-44fd-b118-8f24d733066d None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:14.246079 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 115/234] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Sep 11 08:25:13 2022] PUT /identity/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76/users/81193b3ad0824a5a9cde7269fa3d5fec/roles/897bff7604d1492993a708763e54e6d8 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:25:15.775919 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76580fd-a937-4e6a-88fb-8e161cbd0a44 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:15.776723 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76580fd-a937-4e6a-88fb-8e161cbd0a44 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:15.776723 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76580fd-a937-4e6a-88fb-8e161cbd0a44 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:15.778107 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 120/235] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:15.779671 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630e65e-5fa5-48ce-b9f8-ed1359ab7b5f None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:15.780307 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630e65e-5fa5-48ce-b9f8-ed1359ab7b5f None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:15.780307 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630e65e-5fa5-48ce-b9f8-ed1359ab7b5f None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:15.781829 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 116/236] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:15.787848 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21ad09-6746-4c2f-846b-9e75633e7367 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:15.788323 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21ad09-6746-4c2f-846b-9e75633e7367 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:15.788607 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21ad09-6746-4c2f-846b-9e75633e7367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:15.793275 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fd33b-5871-461e-82d0-88dedb22f54b None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:15.793607 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fd33b-5871-461e-82d0-88dedb22f54b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:15.793873 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fd33b-5871-461e-82d0-88dedb22f54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:15.821678 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2b21ad09-6746-4c2f-846b-9e75633e7367 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:15.824223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2b21ad09-6746-4c2f-846b-9e75633e7367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:15.830824 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-294fd33b-5871-461e-82d0-88dedb22f54b None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:15.832094 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-294fd33b-5871-461e-82d0-88dedb22f54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:15.901149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 121/237] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 08:25:15.904431 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a04698-cc44-4fb1-8fde-6cfe74a0cdf2 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:15.904727 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a04698-cc44-4fb1-8fde-6cfe74a0cdf2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:15.904969 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a04698-cc44-4fb1-8fde-6cfe74a0cdf2 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:15.906580 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 122/238] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:15.911969 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0068e65-5c85-4da0-929e-f33f7f9b14d4 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:15.912324 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0068e65-5c85-4da0-929e-f33f7f9b14d4 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:15.912569 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0068e65-5c85-4da0-929e-f33f7f9b14d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:15.917772 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 117/239] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:25:15.936158 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-d0068e65-5c85-4da0-929e-f33f7f9b14d4 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:15.937260 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d0068e65-5c85-4da0-929e-f33f7f9b14d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:16.020560 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:16.026921 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 123/240] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:25:16.238104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fd33b-5871-461e-82d0-88dedb22f54b None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:16.344445 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0068e65-5c85-4da0-929e-f33f7f9b14d4 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:16.371288 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:16.371288 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fd33b-5871-461e-82d0-88dedb22f54b None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:16.408199 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260dff1-c263-4aa6-b3ad-c49576279fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:16.408851 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260dff1-c263-4aa6-b3ad-c49576279fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:16.409128 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260dff1-c263-4aa6-b3ad-c49576279fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:16.409403 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260dff1-c263-4aa6-b3ad-c49576279fb6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:16.437645 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260dff1-c263-4aa6-b3ad-c49576279fb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:16.442690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-0260dff1-c263-4aa6-b3ad-c49576279fb6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 08:25:16.442690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:16.442690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:16.442690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:16.442690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:16.442690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:16.442690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:16.442690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:16.442690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:16.442690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:16.442690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:16.442690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:16.442690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:16.442690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:16.442690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:16.442690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:16.444849 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:16.444849 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:16.444849 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:16.444849 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:16.444849 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:16.444849 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:16.444849 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:16.444849 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:16.444849 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:16.444849 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:16.444849 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:16.444849 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:16.444849 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:16.444849 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:16.444849 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:16.444849 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:16.447026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:16.447026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:16.447026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:16.447026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:16.447026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:16.447026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:16.447026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:16.447026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:16.447026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:16.447026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:16.447026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 08:25:16.447026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:25:16.447026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 118/241] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:25:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:25:16.459703 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260dff1-c263-4aa6-b3ad-c49576279fb6 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:16.520307 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0068e65-5c85-4da0-929e-f33f7f9b14d4 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:16.559009 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f08dfd-d590-454d-81b4-77c2c185b2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:16.559774 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f08dfd-d590-454d-81b4-77c2c185b2ee None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:16.560098 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f08dfd-d590-454d-81b4-77c2c185b2ee None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:16.560380 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f08dfd-d590-454d-81b4-77c2c185b2ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:16.561556 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f08dfd-d590-454d-81b4-77c2c185b2ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:16.563040 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f08dfd-d590-454d-81b4-77c2c185b2ee None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:16.569416 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 124/242] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:25:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:16.570473 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f08dfd-d590-454d-81b4-77c2c185b2ee None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:16.600593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260dff1-c263-4aa6-b3ad-c49576279fb6 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:16.643236 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:16.646067 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85d0fd-bfa6-4a78-9438-43f0c0c7ab0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:16.646753 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85d0fd-bfa6-4a78-9438-43f0c0c7ab0f None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:16.647035 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85d0fd-bfa6-4a78-9438-43f0c0c7ab0f None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:16.647349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85d0fd-bfa6-4a78-9438-43f0c0c7ab0f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:16.662464 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f85d0fd-bfa6-4a78-9438-43f0c0c7ab0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:16.668367 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-1f85d0fd-bfa6-4a78-9438-43f0c0c7ab0f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:25:16.668367 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:16.668367 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:16.668367 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:16.668367 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:16.668367 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:16.668367 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:16.668367 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:16.668367 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:16.668367 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:16.668367 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:16.668367 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:16.668367 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:16.668367 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:16.668367 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:16.668367 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:16.669426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:16.669426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:16.669426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:16.669426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:16.669426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:16.669426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:16.669426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:16.669426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:16.669426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:16.669426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:16.669426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:16.669426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:16.669426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:16.669426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:16.669426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:16.669426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:16.670328 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:16.670328 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:16.670328 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:16.670328 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:16.670328 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:16.670328 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:16.670328 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:16.670328 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:16.670328 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:16.670328 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:16.670328 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:25:16.670328 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:25:16.670328 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 119/243] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:25:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:25:16.671062 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85d0fd-bfa6-4a78-9438-43f0c0c7ab0f None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:16.697354 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f08dfd-d590-454d-81b4-77c2c185b2ee None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:16.708816 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:16.749137 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efed6d4-85d9-4fdd-9dc1-0817415ef8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:16.750030 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efed6d4-85d9-4fdd-9dc1-0817415ef8f8 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:16.750420 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efed6d4-85d9-4fdd-9dc1-0817415ef8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:16.750791 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efed6d4-85d9-4fdd-9dc1-0817415ef8f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:16.752197 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efed6d4-85d9-4fdd-9dc1-0817415ef8f8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:16.752646 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efed6d4-85d9-4fdd-9dc1-0817415ef8f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:16.754693 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efed6d4-85d9-4fdd-9dc1-0817415ef8f8 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:16.772334 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 125/244] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Sep 11 08:25:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:16.776160 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efed6d4-85d9-4fdd-9dc1-0817415ef8f8 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:16.837847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85d0fd-bfa6-4a78-9438-43f0c0c7ab0f None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:16.878558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051a1c2-ed64-4161-b25b-5a01673964ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:16.879669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051a1c2-ed64-4161-b25b-5a01673964ef None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:16.880173 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051a1c2-ed64-4161-b25b-5a01673964ef None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:16.880698 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051a1c2-ed64-4161-b25b-5a01673964ef None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:16.881607 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051a1c2-ed64-4161-b25b-5a01673964ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:16.883453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051a1c2-ed64-4161-b25b-5a01673964ef None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:16.913761 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efed6d4-85d9-4fdd-9dc1-0817415ef8f8 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:16.945608 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:16.955344 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a45d9e-d29f-4724-85d4-6e914ec23ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:16.956078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a45d9e-d29f-4724-85d4-6e914ec23ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:16.956389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a45d9e-d29f-4724-85d4-6e914ec23ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:16.956640 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a45d9e-d29f-4724-85d4-6e914ec23ae6 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:16.957333 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a45d9e-d29f-4724-85d4-6e914ec23ae6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:16.957649 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a45d9e-d29f-4724-85d4-6e914ec23ae6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:16.959068 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a45d9e-d29f-4724-85d4-6e914ec23ae6 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:16.969352 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 126/245] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Sep 11 08:25:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:16.972117 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 120/246] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Sep 11 08:25:16 2022] POST /identity/v3/users => generated 293 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:25:16.975299 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a45d9e-d29f-4724-85d4-6e914ec23ae6 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:16.987786 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051a1c2-ed64-4161-b25b-5a01673964ef None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:17.095768 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:17.131280 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051a1c2-ed64-4161-b25b-5a01673964ef None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:17.192366 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e21a1-7e72-43d2-9206-b30d777f6cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:17.193454 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e21a1-7e72-43d2-9206-b30d777f6cee None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:17.193955 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e21a1-7e72-43d2-9206-b30d777f6cee None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:17.194471 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e21a1-7e72-43d2-9206-b30d777f6cee None admin] PATH_INFO: `/v3/users/4925c25c93c147b9b92a596470d66d75` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:17.198030 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35e21a1-7e72-43d2-9206-b30d777f6cee None admin] RBAC: Authorizing `identity:get_user(user_id=4925c25c93c147b9b92a596470d66d75)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:17.199968 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35e21a1-7e72-43d2-9206-b30d777f6cee None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:17.203705 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 121/247] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:25:16 2022] GET /identity/v3/users/4925c25c93c147b9b92a596470d66d75 => generated 297 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:17.209764 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e21a1-7e72-43d2-9206-b30d777f6cee None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:17.257879 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a45d9e-d29f-4724-85d4-6e914ec23ae6 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:17.315838 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023a106-3583-4469-a0c1-7916ef3e6b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:17.317120 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023a106-3583-4469-a0c1-7916ef3e6b2f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:17.317619 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023a106-3583-4469-a0c1-7916ef3e6b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:17.318756 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023a106-3583-4469-a0c1-7916ef3e6b2f None admin] PATH_INFO: `/v3/users/71db31096303405cbf552b1b23a795af` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:17.339172 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e023a106-3583-4469-a0c1-7916ef3e6b2f None admin] RBAC: Authorizing `identity:get_user(user_id=71db31096303405cbf552b1b23a795af)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:17.342057 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e023a106-3583-4469-a0c1-7916ef3e6b2f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:17.344190 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 127/248] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:25:16 2022] GET /identity/v3/users/71db31096303405cbf552b1b23a795af => generated 297 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:17.356887 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023a106-3583-4469-a0c1-7916ef3e6b2f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:17.367346 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e21a1-7e72-43d2-9206-b30d777f6cee None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:17.409194 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc928e4-73e0-4a15-90c9-8faa344540fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:17.409848 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc928e4-73e0-4a15-90c9-8faa344540fa None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:17.410159 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc928e4-73e0-4a15-90c9-8faa344540fa None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:17.410411 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc928e4-73e0-4a15-90c9-8faa344540fa None admin] PATH_INFO: `/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:17.411655 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc928e4-73e0-4a15-90c9-8faa344540fa None admin] RBAC: Authorizing `identity:get_project(project_id=16bd6bbfd5774162b2c2103efb3a6d76)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:17.413886 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc928e4-73e0-4a15-90c9-8faa344540fa None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:17.417139 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 122/249] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:25:17 2022] GET /identity/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:17.423016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc928e4-73e0-4a15-90c9-8faa344540fa None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:17.448029 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:17.495577 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:17.595641 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023a106-3583-4469-a0c1-7916ef3e6b2f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:17.619822 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc928e4-73e0-4a15-90c9-8faa344540fa None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:17.657457 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef55f4a-57f9-4eda-8a51-5ffa32fdf4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:17.658133 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef55f4a-57f9-4eda-8a51-5ffa32fdf4c3 None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:17.658417 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef55f4a-57f9-4eda-8a51-5ffa32fdf4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:17.658697 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef55f4a-57f9-4eda-8a51-5ffa32fdf4c3 None admin] PATH_INFO: `/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76/users/4925c25c93c147b9b92a596470d66d75/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:17.660354 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3129f-3e27-49c3-8b0e-a0570a6bfeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:17.660988 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef55f4a-57f9-4eda-8a51-5ffa32fdf4c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=16bd6bbfd5774162b2c2103efb3a6d76, user_id=4925c25c93c147b9b92a596470d66d75, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:17.662103 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3129f-3e27-49c3-8b0e-a0570a6bfeb9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:17.662481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef55f4a-57f9-4eda-8a51-5ffa32fdf4c3 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:17.663149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3129f-3e27-49c3-8b0e-a0570a6bfeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:17.663970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3129f-3e27-49c3-8b0e-a0570a6bfeb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:17.748045 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 123/250] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Sep 11 08:25:17 2022] PUT /identity/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76/users/4925c25c93c147b9b92a596470d66d75/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:25:17.750387 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95c3bc-d708-4f65-8446-c0098ac1f146 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:17.750692 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95c3bc-d708-4f65-8446-c0098ac1f146 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:17.751002 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95c3bc-d708-4f65-8446-c0098ac1f146 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:17.757445 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 124/251] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:17.764742 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42313276-549e-49b8-a671-ec7a91d25f7c None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:17.765027 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42313276-549e-49b8-a671-ec7a91d25f7c None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:17.765312 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42313276-549e-49b8-a671-ec7a91d25f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:17.799231 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-42313276-549e-49b8-a671-ec7a91d25f7c None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:17.801226 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-42313276-549e-49b8-a671-ec7a91d25f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:17.824360 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3129f-3e27-49c3-8b0e-a0570a6bfeb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:17.826558 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3129f-3e27-49c3-8b0e-a0570a6bfeb9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:17.970046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:17.986652 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 125/252] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 08:25:17.987654 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:18.075000 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 128/253] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:25:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 719 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 08:25:18.085273 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42313276-549e-49b8-a671-ec7a91d25f7c None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:18.178345 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10db69-f7cf-4960-b024-3f6e06c8bb6b None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:18.178734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10db69-f7cf-4960-b024-3f6e06c8bb6b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:18.178894 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10db69-f7cf-4960-b024-3f6e06c8bb6b None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:18.181441 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 129/254] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:25:18.188624 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb66734-56a5-405e-a389-0555520fa530 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:18.189017 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb66734-56a5-405e-a389-0555520fa530 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:18.189150 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb66734-56a5-405e-a389-0555520fa530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:18.236190 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-afb66734-56a5-405e-a389-0555520fa530 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:18.238148 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-afb66734-56a5-405e-a389-0555520fa530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:18.316376 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42313276-549e-49b8-a671-ec7a91d25f7c None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:18.404964 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b8501-555a-4d4f-a7b5-61e08ced9220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:18.406724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b8501-555a-4d4f-a7b5-61e08ced9220 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:18.407507 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b8501-555a-4d4f-a7b5-61e08ced9220 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:18.408212 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b8501-555a-4d4f-a7b5-61e08ced9220 None admin] PATH_INFO: `/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:18.410947 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b8501-555a-4d4f-a7b5-61e08ced9220 None admin] RBAC: Authorizing `identity:get_project(project_id=16bd6bbfd5774162b2c2103efb3a6d76)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:18.413989 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b8501-555a-4d4f-a7b5-61e08ced9220 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:18.418744 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 126/255] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:25:18 2022] GET /identity/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76 => generated 302 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:18.424292 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b8501-555a-4d4f-a7b5-61e08ced9220 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:18.433025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 130/256] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 08:25:18.451216 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb66734-56a5-405e-a389-0555520fa530 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:18.637955 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:18.660087 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:18.717921 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb66734-56a5-405e-a389-0555520fa530 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:18.771503 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b8501-555a-4d4f-a7b5-61e08ced9220 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:18.793402 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6de59a-154e-4054-a3b1-493ad19727ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:18.794912 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6de59a-154e-4054-a3b1-493ad19727ca None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:18.795721 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6de59a-154e-4054-a3b1-493ad19727ca None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:18.796508 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6de59a-154e-4054-a3b1-493ad19727ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:18.798186 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6de59a-154e-4054-a3b1-493ad19727ca None admin] RBAC: Adding query filter params (role.id=4c81d75b246b4f55b100a3a15eaba6a4, scope.project.id=16bd6bbfd5774162b2c2103efb3a6d76, user.id=71db31096303405cbf552b1b23a795af) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:18.799091 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6de59a-154e-4054-a3b1-493ad19727ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:18.802338 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6de59a-154e-4054-a3b1-493ad19727ca None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:18.813844 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 131/257] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:25:18 2022] GET /identity/v3/role_assignments?user.id=71db31096303405cbf552b1b23a795af&scope.project.id=16bd6bbfd5774162b2c2103efb3a6d76&role.id=4c81d75b246b4f55b100a3a15eaba6a4 => generated 259 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:25:18.886101 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c713738-d3f1-47c4-bd56-3178a3d79d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:18.887386 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c713738-d3f1-47c4-bd56-3178a3d79d93 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:18.887862 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c713738-d3f1-47c4-bd56-3178a3d79d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:18.888409 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c713738-d3f1-47c4-bd56-3178a3d79d93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:18.917541 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c713738-d3f1-47c4-bd56-3178a3d79d93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:18.927004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-5c713738-d3f1-47c4-bd56-3178a3d79d93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:25:18.927004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:18.927004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:18.927004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:18.927004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:18.927004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:18.927004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:18.927004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:18.927004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:18.927004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:18.927004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:18.927004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:18.927004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:18.927004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:18.927004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:18.927004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:18.927999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:18.927999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:18.927999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:18.927999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:18.927999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:18.927999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:18.927999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:18.927999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:18.927999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:18.927999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:18.927999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:18.927999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:18.927999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:18.927999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:18.927999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:18.927999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:18.928866 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:18.928866 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:18.928866 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:18.928866 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:18.928866 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:18.928866 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:18.928866 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:18.928866 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:18.928866 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:18.928866 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:18.928866 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:25:18.928866 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:25:18.930022 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 127/258] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:25:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 506 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:25:18.938637 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6de59a-154e-4054-a3b1-493ad19727ca None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:19.025099 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c713738-d3f1-47c4-bd56-3178a3d79d93 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:19.121196 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6de59a-154e-4054-a3b1-493ad19727ca None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:19.236399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00570f46-b2bf-41da-98e6-d13b8e8dd9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:19.236399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00570f46-b2bf-41da-98e6-d13b8e8dd9ca None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:19.236793 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00570f46-b2bf-41da-98e6-d13b8e8dd9ca None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:19.237145 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00570f46-b2bf-41da-98e6-d13b8e8dd9ca None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:19.238319 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00570f46-b2bf-41da-98e6-d13b8e8dd9ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:19.238860 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00570f46-b2bf-41da-98e6-d13b8e8dd9ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:19.242059 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00570f46-b2bf-41da-98e6-d13b8e8dd9ca None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:19.280094 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 132/259] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:25:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:19.289380 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00570f46-b2bf-41da-98e6-d13b8e8dd9ca None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:19.315780 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:19.427387 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c713738-d3f1-47c4-bd56-3178a3d79d93 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:19.507348 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:19.540558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb354b65-267b-43d4-a3ff-606797f40f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:19.541239 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb354b65-267b-43d4-a3ff-606797f40f3b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:19.541578 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb354b65-267b-43d4-a3ff-606797f40f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:19.541816 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb354b65-267b-43d4-a3ff-606797f40f3b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:19.558178 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb354b65-267b-43d4-a3ff-606797f40f3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:19.571938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-cb354b65-267b-43d4-a3ff-606797f40f3b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 08:25:19.571938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:19.571938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:19.571938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:19.571938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:19.571938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:19.571938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:19.571938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:19.571938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:19.571938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:19.571938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:19.571938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:19.571938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:19.571938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:19.571938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:19.571938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:19.573690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:19.573690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:19.573690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:19.573690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:19.573690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:19.573690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:19.573690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:19.573690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:19.573690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:19.573690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:19.573690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:19.573690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:19.573690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:19.573690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:19.573690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:19.573690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:19.575335 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:19.575335 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:19.575335 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:19.575335 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:19.575335 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:19.575335 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:19.575335 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:19.575335 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:19.575335 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:19.575335 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:19.575335 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 08:25:19.575335 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:25:19.583295 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 128/260] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Sep 11 08:25:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 557 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:25:19.583295 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb354b65-267b-43d4-a3ff-606797f40f3b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:19.623856 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00570f46-b2bf-41da-98e6-d13b8e8dd9ca None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:19.716752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78a44b-2460-4d28-b579-034ae4af66d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:19.717414 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78a44b-2460-4d28-b579-034ae4af66d8 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:19.717697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78a44b-2460-4d28-b579-034ae4af66d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:19.717974 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78a44b-2460-4d28-b579-034ae4af66d8 None admin] PATH_INFO: `/v3/users/81193b3ad0824a5a9cde7269fa3d5fec` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:19.720165 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78a44b-2460-4d28-b579-034ae4af66d8 None admin] RBAC: Authorizing `identity:get_user(user_id=81193b3ad0824a5a9cde7269fa3d5fec)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:19.721669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78a44b-2460-4d28-b579-034ae4af66d8 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:19.723366 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 133/261] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:25:19 2022] GET /identity/v3/users/81193b3ad0824a5a9cde7269fa3d5fec => generated 283 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:19.729659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78a44b-2460-4d28-b579-034ae4af66d8 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:19.850700 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:19.878652 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb354b65-267b-43d4-a3ff-606797f40f3b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:19.904696 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78a44b-2460-4d28-b579-034ae4af66d8 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:19.962573 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76623146-5b08-4dbb-8c6a-ac042f021e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:19.963586 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76623146-5b08-4dbb-8c6a-ac042f021e33 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:19.963586 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76623146-5b08-4dbb-8c6a-ac042f021e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:19.963824 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76623146-5b08-4dbb-8c6a-ac042f021e33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:20.001880 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613a865-5f94-4445-a519-0266c6cdff16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:20.002901 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613a865-5f94-4445-a519-0266c6cdff16 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:20.010850 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613a865-5f94-4445-a519-0266c6cdff16 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:20.011455 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613a865-5f94-4445-a519-0266c6cdff16 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:20.012730 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f613a865-5f94-4445-a519-0266c6cdff16 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:20.013281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f613a865-5f94-4445-a519-0266c6cdff16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:20.015925 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f613a865-5f94-4445-a519-0266c6cdff16 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:20.041546 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 129/262] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:25:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:20.051913 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613a865-5f94-4445-a519-0266c6cdff16 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:20.073102 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76623146-5b08-4dbb-8c6a-ac042f021e33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:20.074639 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76623146-5b08-4dbb-8c6a-ac042f021e33 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:20.165404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:20.203172 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 134/263] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:25:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 08:25:20.214959 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76623146-5b08-4dbb-8c6a-ac042f021e33 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:20.228814 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:20.340053 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613a865-5f94-4445-a519-0266c6cdff16 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:20.417868 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215dfdd-d3ff-46f4-bbf5-f449c4ffce2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:20.418436 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215dfdd-d3ff-46f4-bbf5-f449c4ffce2f None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:20.418717 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215dfdd-d3ff-46f4-bbf5-f449c4ffce2f None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:20.418990 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215dfdd-d3ff-46f4-bbf5-f449c4ffce2f None admin] PATH_INFO: `/v3/users/81193b3ad0824a5a9cde7269fa3d5fec` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:20.421360 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2215dfdd-d3ff-46f4-bbf5-f449c4ffce2f None admin] RBAC: Authorizing `identity:get_user(user_id=81193b3ad0824a5a9cde7269fa3d5fec)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:20.422935 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2215dfdd-d3ff-46f4-bbf5-f449c4ffce2f None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:20.424644 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 130/264] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:25:20 2022] GET /identity/v3/users/81193b3ad0824a5a9cde7269fa3d5fec => generated 283 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:20.427703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76623146-5b08-4dbb-8c6a-ac042f021e33 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:20.433790 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215dfdd-d3ff-46f4-bbf5-f449c4ffce2f None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:20.479488 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b67d5-9267-40b4-9b9b-fe8f04fbcb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:20.480137 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b67d5-9267-40b4-9b9b-fe8f04fbcb9d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:20.480413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b67d5-9267-40b4-9b9b-fe8f04fbcb9d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:20.480681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b67d5-9267-40b4-9b9b-fe8f04fbcb9d None admin] PATH_INFO: `/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:20.481958 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b67d5-9267-40b4-9b9b-fe8f04fbcb9d None admin] RBAC: Authorizing `identity:get_project(project_id=16bd6bbfd5774162b2c2103efb3a6d76)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:20.483543 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b67d5-9267-40b4-9b9b-fe8f04fbcb9d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:20.485255 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 135/265] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:25:20 2022] GET /identity/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:25:20.491417 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b67d5-9267-40b4-9b9b-fe8f04fbcb9d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:20.547813 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:20.621025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b67d5-9267-40b4-9b9b-fe8f04fbcb9d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:20.641468 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215dfdd-d3ff-46f4-bbf5-f449c4ffce2f None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:20.691659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:20.691908 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e3add-2898-4e72-903c-317bba23b2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:20.691908 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e3add-2898-4e72-903c-317bba23b2ec None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:20.691908 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e3add-2898-4e72-903c-317bba23b2ec None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:20.691908 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e3add-2898-4e72-903c-317bba23b2ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:20.692392 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e3add-2898-4e72-903c-317bba23b2ec None admin] RBAC: Adding query filter params (role.id=d12af9f1dfb344cd8a6a493e165030ba, scope.project.id=16bd6bbfd5774162b2c2103efb3a6d76, user.id=81193b3ad0824a5a9cde7269fa3d5fec) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:20.695537 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e3add-2898-4e72-903c-317bba23b2ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:20.695537 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e3add-2898-4e72-903c-317bba23b2ec None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:20.708270 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 136/266] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:25:20 2022] GET /identity/v3/role_assignments?user.id=81193b3ad0824a5a9cde7269fa3d5fec&scope.project.id=16bd6bbfd5774162b2c2103efb3a6d76&role.id=d12af9f1dfb344cd8a6a493e165030ba => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:20.731822 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49f207-c50b-4ca1-809a-aac4f46ddc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:20.733348 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49f207-c50b-4ca1-809a-aac4f46ddc13 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:20.734158 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49f207-c50b-4ca1-809a-aac4f46ddc13 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:20.734927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49f207-c50b-4ca1-809a-aac4f46ddc13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:20.875588 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f49f207-c50b-4ca1-809a-aac4f46ddc13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:20.878957 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f49f207-c50b-4ca1-809a-aac4f46ddc13 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:21.075910 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 131/267] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:25:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 08:25:21.086462 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e3add-2898-4e72-903c-317bba23b2ec None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:21.306511 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e3add-2898-4e72-903c-317bba23b2ec None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:21.313124 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:21.392633 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e667c9-2ee9-4202-9f24-2b3e303e1fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:21.394218 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e667c9-2ee9-4202-9f24-2b3e303e1fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:21.395017 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e667c9-2ee9-4202-9f24-2b3e303e1fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:21.395794 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e667c9-2ee9-4202-9f24-2b3e303e1fc8 None admin] PATH_INFO: `/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:21.404371 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e667c9-2ee9-4202-9f24-2b3e303e1fc8 None admin] RBAC: Authorizing `identity:get_project(project_id=16bd6bbfd5774162b2c2103efb3a6d76)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:21.407545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e667c9-2ee9-4202-9f24-2b3e303e1fc8 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:21.411650 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 137/268] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:25:21 2022] GET /identity/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76 => generated 302 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:21.421585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49f207-c50b-4ca1-809a-aac4f46ddc13 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:21.464467 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:21.486908 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343eccf3-e3d1-4de8-bc1c-a85bdc09ceb5 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:21.487366 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343eccf3-e3d1-4de8-bc1c-a85bdc09ceb5 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:21.488068 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343eccf3-e3d1-4de8-bc1c-a85bdc09ceb5 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:21.492244 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 138/269] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:21.507014 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d02940-cfbe-4d5d-bb39-a89b1cd9a858 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:21.507526 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d02940-cfbe-4d5d-bb39-a89b1cd9a858 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:21.507999 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d02940-cfbe-4d5d-bb39-a89b1cd9a858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:21.551934 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-d3d02940-cfbe-4d5d-bb39-a89b1cd9a858 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:21.553980 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d3d02940-cfbe-4d5d-bb39-a89b1cd9a858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:21.601089 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49f207-c50b-4ca1-809a-aac4f46ddc13 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:21.641581 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db3c6d-aa98-443a-9003-ad767f370960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:21.642242 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db3c6d-aa98-443a-9003-ad767f370960 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:21.642524 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db3c6d-aa98-443a-9003-ad767f370960 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:21.642877 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db3c6d-aa98-443a-9003-ad767f370960 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:21.643614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db3c6d-aa98-443a-9003-ad767f370960 None admin] RBAC: Adding query filter params (role.id=897bff7604d1492993a708763e54e6d8, scope.project.id=16bd6bbfd5774162b2c2103efb3a6d76, user.id=81193b3ad0824a5a9cde7269fa3d5fec) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:21.643953 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db3c6d-aa98-443a-9003-ad767f370960 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:21.645625 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db3c6d-aa98-443a-9003-ad767f370960 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:21.652586 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 132/270] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:25:21 2022] GET /identity/v3/role_assignments?user.id=81193b3ad0824a5a9cde7269fa3d5fec&scope.project.id=16bd6bbfd5774162b2c2103efb3a6d76&role.id=897bff7604d1492993a708763e54e6d8 => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:21.707762 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 139/271] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:25:21.922856 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cfa049-db2a-4363-bfe0-6ad4a9b573f8 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:21.923100 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cfa049-db2a-4363-bfe0-6ad4a9b573f8 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:21.923511 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cfa049-db2a-4363-bfe0-6ad4a9b573f8 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:21.925016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 133/272] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:21.933357 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2547a1-09fd-4f75-b668-593efd5f069c None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:21.933762 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2547a1-09fd-4f75-b668-593efd5f069c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:21.933917 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2547a1-09fd-4f75-b668-593efd5f069c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:21.957337 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-4f2547a1-09fd-4f75-b668-593efd5f069c None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:21.958554 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4f2547a1-09fd-4f75-b668-593efd5f069c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:21.988659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b221f-4c96-4349-9ffb-536e5cfdcce7 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:21.988996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b221f-4c96-4349-9ffb-536e5cfdcce7 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:21.989218 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b221f-4c96-4349-9ffb-536e5cfdcce7 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:21.990753 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 134/273] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:25:22.002193 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51731390-8fd9-4e2a-8675-d059466b3e3c None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:22.003132 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51731390-8fd9-4e2a-8675-d059466b3e3c None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:22.003951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51731390-8fd9-4e2a-8675-d059466b3e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:22.041511 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-51731390-8fd9-4e2a-8675-d059466b3e3c None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:22.045500 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-51731390-8fd9-4e2a-8675-d059466b3e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:22.080930 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 140/274] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:25:22.082430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2547a1-09fd-4f75-b668-593efd5f069c None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:22.163681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:22.237964 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 135/275] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:25:22.351845 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2547a1-09fd-4f75-b668-593efd5f069c None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:22.437327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e16c80-a465-4b75-b8fe-9ed77a533cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:22.438381 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e16c80-a465-4b75-b8fe-9ed77a533cca None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:22.438839 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e16c80-a465-4b75-b8fe-9ed77a533cca None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:22.439334 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e16c80-a465-4b75-b8fe-9ed77a533cca None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:22.444887 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e16c80-a465-4b75-b8fe-9ed77a533cca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:22.447906 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e16c80-a465-4b75-b8fe-9ed77a533cca None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:22.451064 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 141/276] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:25:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:22.459477 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51731390-8fd9-4e2a-8675-d059466b3e3c None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:22.488587 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:22.605324 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e16c80-a465-4b75-b8fe-9ed77a533cca None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:22.675709 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51731390-8fd9-4e2a-8675-d059466b3e3c None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:22.766283 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b50c1-8eb4-4a23-a51d-95828a0d99c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:22.768038 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b50c1-8eb4-4a23-a51d-95828a0d99c4 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:22.769240 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b50c1-8eb4-4a23-a51d-95828a0d99c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:22.770734 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b50c1-8eb4-4a23-a51d-95828a0d99c4 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:22.772870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b50c1-8eb4-4a23-a51d-95828a0d99c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:22.776768 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b50c1-8eb4-4a23-a51d-95828a0d99c4 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:22.784234 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:22.788134 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e16c80-a465-4b75-b8fe-9ed77a533cca None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:22.839446 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f2886-0aa0-43d0-904f-b57972db2bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:22.840179 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f2886-0aa0-43d0-904f-b57972db2bbc None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:22.840567 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f2886-0aa0-43d0-904f-b57972db2bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:22.840926 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f2886-0aa0-43d0-904f-b57972db2bbc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:22.854406 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f2886-0aa0-43d0-904f-b57972db2bbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:22.860120 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-3e6f2886-0aa0-43d0-904f-b57972db2bbc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:25:22.860120 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:22.860120 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:22.860120 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:22.860120 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:22.860120 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:22.860120 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:22.860120 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:22.860120 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:22.860120 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:22.860120 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:22.860120 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:22.860120 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:22.860120 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:22.860120 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:22.860120 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:22.861959 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:22.861959 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:22.861959 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:22.861959 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:22.861959 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:22.861959 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:22.861959 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:22.861959 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:22.861959 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:22.861959 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:22.861959 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:22.861959 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:22.861959 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:22.861959 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:22.861959 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:22.861959 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:22.864937 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:22.864937 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:22.864937 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:22.864937 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:22.864937 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:22.864937 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:22.864937 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:22.864937 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:22.864937 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:22.864937 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:22.864937 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:25:22.864937 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:25:22.864937 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 142/277] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:25:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:25:22.864937 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f2886-0aa0-43d0-904f-b57972db2bbc None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:22.911404 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 136/278] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Sep 11 08:25:22 2022] POST /identity/v3/users => generated 293 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:25:22.912926 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b50c1-8eb4-4a23-a51d-95828a0d99c4 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:22.994343 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:23.034819 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b50c1-8eb4-4a23-a51d-95828a0d99c4 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:23.036583 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f2886-0aa0-43d0-904f-b57972db2bbc None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:23.092811 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da498b5-a037-401d-bdc7-db136ed3d1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:23.094020 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da498b5-a037-401d-bdc7-db136ed3d1c7 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:23.094489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da498b5-a037-401d-bdc7-db136ed3d1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:23.094935 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da498b5-a037-401d-bdc7-db136ed3d1c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:23.095185 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d7b9a-1b0c-4ec5-b3be-2f1faf588b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:23.100385 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da498b5-a037-401d-bdc7-db136ed3d1c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:23.100517 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d7b9a-1b0c-4ec5-b3be-2f1faf588b88 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:23.100595 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da498b5-a037-401d-bdc7-db136ed3d1c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:23.100670 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d7b9a-1b0c-4ec5-b3be-2f1faf588b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:23.100670 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d7b9a-1b0c-4ec5-b3be-2f1faf588b88 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:23.100818 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da498b5-a037-401d-bdc7-db136ed3d1c7 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:23.114229 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d7b9a-1b0c-4ec5-b3be-2f1faf588b88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:23.114689 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 137/279] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Sep 11 08:25:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:23.122109 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d10ce3-6c58-4be6-bd58-d6cc92ebc09b None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:23.122109 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d10ce3-6c58-4be6-bd58-d6cc92ebc09b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:23.122109 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d10ce3-6c58-4be6-bd58-d6cc92ebc09b None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:23.122486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-669d7b9a-1b0c-4ec5-b3be-2f1faf588b88 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:25:23.122486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:23.122486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:23.122486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:23.122486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:23.122486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:23.122486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:23.122486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:23.122486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:23.122486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:23.122486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:23.122486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:23.122486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:23.122486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:23.122486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:23.122486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:23.124145 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:23.124145 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:23.124145 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:23.124145 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:23.124145 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:23.124145 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:23.124145 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:23.124145 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:23.124145 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:23.124145 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:23.124145 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:23.124145 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:23.124145 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:23.124145 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:23.124145 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:23.124145 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:23.127043 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:23.127043 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:23.127043 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:23.127043 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:23.127043 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:23.127043 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:23.127043 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:23.127043 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:23.127043 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:23.127043 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:23.127043 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:25:23.127043 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:25:23.129912 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 138/280] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:23.129990 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 143/281] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:25:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:25:23.130359 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d10ce3-6c58-4be6-bd58-d6cc92ebc09b None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:23.132070 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653624ce-ff00-4d7e-b620-bdffdf6f28db None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:23.132579 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653624ce-ff00-4d7e-b620-bdffdf6f28db None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:23.133019 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653624ce-ff00-4d7e-b620-bdffdf6f28db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:23.154576 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-653624ce-ff00-4d7e-b620-bdffdf6f28db None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:23.156184 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-653624ce-ff00-4d7e-b620-bdffdf6f28db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:23.174411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:23.268524 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 144/282] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:25:23.269526 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653624ce-ff00-4d7e-b620-bdffdf6f28db None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:23.325754 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d10ce3-6c58-4be6-bd58-d6cc92ebc09b None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:23.379184 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:23.394633 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023007a8-5f70-4ea3-85fd-39999d99f5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:23.395865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023007a8-5f70-4ea3-85fd-39999d99f5dd None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:23.396433 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023007a8-5f70-4ea3-85fd-39999d99f5dd None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:23.396960 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023007a8-5f70-4ea3-85fd-39999d99f5dd None admin] PATH_INFO: `/v3/users/ba11d7cc512f4f42a2d1c7841ef08e56` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:23.427827 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023007a8-5f70-4ea3-85fd-39999d99f5dd None admin] RBAC: Authorizing `identity:get_user(user_id=ba11d7cc512f4f42a2d1c7841ef08e56)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:23.433880 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023007a8-5f70-4ea3-85fd-39999d99f5dd None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:23.438239 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 139/283] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:25:23 2022] GET /identity/v3/users/ba11d7cc512f4f42a2d1c7841ef08e56 => generated 293 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:23.448902 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023007a8-5f70-4ea3-85fd-39999d99f5dd None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:23.456536 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653624ce-ff00-4d7e-b620-bdffdf6f28db None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:23.502693 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001491fa-a77f-4139-933d-34d0d74a58e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:23.503455 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001491fa-a77f-4139-933d-34d0d74a58e9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:23.503739 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001491fa-a77f-4139-933d-34d0d74a58e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:23.504014 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001491fa-a77f-4139-933d-34d0d74a58e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:23.504758 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001491fa-a77f-4139-933d-34d0d74a58e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:23.505068 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001491fa-a77f-4139-933d-34d0d74a58e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:23.506490 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001491fa-a77f-4139-933d-34d0d74a58e9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:23.519990 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 145/284] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Sep 11 08:25:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:23.526099 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001491fa-a77f-4139-933d-34d0d74a58e9 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:23.544448 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:23.593239 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023007a8-5f70-4ea3-85fd-39999d99f5dd None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:23.630830 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd9135-f71c-426a-a8ed-17be56d8cd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:23.631540 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd9135-f71c-426a-a8ed-17be56d8cd95 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:23.631803 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd9135-f71c-426a-a8ed-17be56d8cd95 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:23.632081 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd9135-f71c-426a-a8ed-17be56d8cd95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:23.633012 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd9135-f71c-426a-a8ed-17be56d8cd95 None admin] RBAC: Adding query filter params (role.id=3cecaf09e54b4f479cd391db74c49831, user.id=ba11d7cc512f4f42a2d1c7841ef08e56, scope.system=all) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:23.633144 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd9135-f71c-426a-a8ed-17be56d8cd95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:23.634611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd9135-f71c-426a-a8ed-17be56d8cd95 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:23.639409 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001491fa-a77f-4139-933d-34d0d74a58e9 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:23.640624 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 140/285] 10.222.0.26 () {56 vars in 1308 bytes} [Sun Sep 11 08:25:23 2022] GET /identity/v3/role_assignments?user.id=ba11d7cc512f4f42a2d1c7841ef08e56&scope.system=all&role.id=3cecaf09e54b4f479cd391db74c49831 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:23.641551 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd9135-f71c-426a-a8ed-17be56d8cd95 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:23.682183 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da03e26-53c2-49d8-b4af-a8b9fd51a476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:23.683202 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da03e26-53c2-49d8-b4af-a8b9fd51a476 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:23.683727 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da03e26-53c2-49d8-b4af-a8b9fd51a476 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:23.684175 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da03e26-53c2-49d8-b4af-a8b9fd51a476 None admin] PATH_INFO: `/v3/users/4925c25c93c147b9b92a596470d66d75` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:23.685749 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da03e26-53c2-49d8-b4af-a8b9fd51a476 None admin] RBAC: Authorizing `identity:get_user(user_id=4925c25c93c147b9b92a596470d66d75)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:23.687580 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da03e26-53c2-49d8-b4af-a8b9fd51a476 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:23.694327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 146/286] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:25:23 2022] GET /identity/v3/users/4925c25c93c147b9b92a596470d66d75 => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:23.696017 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da03e26-53c2-49d8-b4af-a8b9fd51a476 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:23.706032 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:23.759494 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd9135-f71c-426a-a8ed-17be56d8cd95 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:23.787952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:23.799095 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71758e-a390-4e3f-862a-15a486f86585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:23.800781 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71758e-a390-4e3f-862a-15a486f86585 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:23.800781 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71758e-a390-4e3f-862a-15a486f86585 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:23.800781 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71758e-a390-4e3f-862a-15a486f86585 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:23.810399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da03e26-53c2-49d8-b4af-a8b9fd51a476 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:23.813014 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f71758e-a390-4e3f-862a-15a486f86585 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:23.818071 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-7f71758e-a390-4e3f-862a-15a486f86585 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 08:25:23.818071 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:23.818071 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:23.818071 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:23.818071 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:23.818071 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:23.818071 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:23.818071 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:23.818071 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:23.818071 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:23.818071 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:23.818071 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:23.818071 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:23.818071 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:23.818071 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:23.818071 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:23.819013 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:23.819013 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:23.819013 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:23.819013 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:23.819013 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:23.819013 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:23.819013 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:23.819013 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:23.819013 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:23.819013 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:23.819013 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:23.819013 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:23.819013 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:23.819013 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:23.819013 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:23.819013 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:23.819861 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:23.819861 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:23.819861 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:23.819861 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:23.819861 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:23.819861 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:23.819861 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:23.819861 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:23.819861 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:23.819861 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:23.819861 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 08:25:23.819861 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:25:23.819861 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 141/287] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:25:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:25:23.825451 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71758e-a390-4e3f-862a-15a486f86585 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:23.850656 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bd7b9-e6e4-4bf2-b64a-62adaaa1bf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:23.851201 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bd7b9-e6e4-4bf2-b64a-62adaaa1bf84 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:23.851537 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bd7b9-e6e4-4bf2-b64a-62adaaa1bf84 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:23.851810 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bd7b9-e6e4-4bf2-b64a-62adaaa1bf84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:23.936417 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bd7b9-e6e4-4bf2-b64a-62adaaa1bf84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:23.937886 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bd7b9-e6e4-4bf2-b64a-62adaaa1bf84 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:23.997967 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71758e-a390-4e3f-862a-15a486f86585 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:24.030581 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:24.068926 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:24.069591 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d100cda-e341-4160-9a3f-c70f86a22c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:24.070178 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d100cda-e341-4160-9a3f-c70f86a22c34 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:24.070457 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d100cda-e341-4160-9a3f-c70f86a22c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:24.070728 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d100cda-e341-4160-9a3f-c70f86a22c34 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:24.072015 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d100cda-e341-4160-9a3f-c70f86a22c34 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:24.072317 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d100cda-e341-4160-9a3f-c70f86a22c34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:24.078232 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d100cda-e341-4160-9a3f-c70f86a22c34 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:24.084142 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 142/288] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Sep 11 08:25:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:24.090725 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d100cda-e341-4160-9a3f-c70f86a22c34 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:24.142587 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 147/289] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:25:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 08:25:24.161055 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bd7b9-e6e4-4bf2-b64a-62adaaa1bf84 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:24.213893 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d100cda-e341-4160-9a3f-c70f86a22c34 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:24.252730 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f9fb5-d10d-42d8-9ffe-e7e082fc1af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:24.253377 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f9fb5-d10d-42d8-9ffe-e7e082fc1af5 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:24.253657 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f9fb5-d10d-42d8-9ffe-e7e082fc1af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:24.253933 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f9fb5-d10d-42d8-9ffe-e7e082fc1af5 None admin] PATH_INFO: `/v3/users/71db31096303405cbf552b1b23a795af` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:24.255141 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f9fb5-d10d-42d8-9ffe-e7e082fc1af5 None admin] RBAC: Authorizing `identity:get_user(user_id=71db31096303405cbf552b1b23a795af)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:24.256677 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f9fb5-d10d-42d8-9ffe-e7e082fc1af5 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:24.263391 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 143/290] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:25:24 2022] GET /identity/v3/users/71db31096303405cbf552b1b23a795af => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:25:24.265002 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f9fb5-d10d-42d8-9ffe-e7e082fc1af5 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:24.335640 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:24.392160 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f9fb5-d10d-42d8-9ffe-e7e082fc1af5 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:24.432076 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2af482-e792-431a-bcdd-fdf459599c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:24.432655 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2af482-e792-431a-bcdd-fdf459599c11 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:24.433215 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2af482-e792-431a-bcdd-fdf459599c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:24.433509 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2af482-e792-431a-bcdd-fdf459599c11 None admin] PATH_INFO: `/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:24.434722 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2af482-e792-431a-bcdd-fdf459599c11 None admin] RBAC: Authorizing `identity:get_project(project_id=16bd6bbfd5774162b2c2103efb3a6d76)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:24.436233 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2af482-e792-431a-bcdd-fdf459599c11 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:24.442734 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 144/291] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:25:24 2022] GET /identity/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:25:24.445719 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2af482-e792-431a-bcdd-fdf459599c11 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:24.564422 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2af482-e792-431a-bcdd-fdf459599c11 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:24.574602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bd7b9-e6e4-4bf2-b64a-62adaaa1bf84 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:24.599741 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:24.605080 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a8424-52e0-4c52-8f5f-06d149892d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:24.606417 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a8424-52e0-4c52-8f5f-06d149892d97 None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:24.606697 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a8424-52e0-4c52-8f5f-06d149892d97 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:24.606971 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a8424-52e0-4c52-8f5f-06d149892d97 None admin] PATH_INFO: `/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76/users/71db31096303405cbf552b1b23a795af/roles/4c81d75b246b4f55b100a3a15eaba6a4` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:24.609189 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a8424-52e0-4c52-8f5f-06d149892d97 None admin] RBAC: Authorizing `identity:create_grant(project_id=16bd6bbfd5774162b2c2103efb3a6d76, user_id=71db31096303405cbf552b1b23a795af, role_id=4c81d75b246b4f55b100a3a15eaba6a4)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:24.610797 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a8424-52e0-4c52-8f5f-06d149892d97 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:24.649850 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae8385-eb26-48bc-91b0-6ca99ea34b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:24.650503 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae8385-eb26-48bc-91b0-6ca99ea34b46 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:24.650781 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae8385-eb26-48bc-91b0-6ca99ea34b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:24.651052 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae8385-eb26-48bc-91b0-6ca99ea34b46 None admin] PATH_INFO: `/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:24.652484 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae8385-eb26-48bc-91b0-6ca99ea34b46 None admin] RBAC: Authorizing `identity:get_project(project_id=16bd6bbfd5774162b2c2103efb3a6d76)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:24.654087 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae8385-eb26-48bc-91b0-6ca99ea34b46 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:24.656086 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 148/292] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:25:24 2022] GET /identity/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76 => generated 302 bytes in 496 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:24.662687 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae8385-eb26-48bc-91b0-6ca99ea34b46 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:24.703108 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 145/293] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Sep 11 08:25:24 2022] PUT /identity/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76/users/71db31096303405cbf552b1b23a795af/roles/4c81d75b246b4f55b100a3a15eaba6a4 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:25:24.768231 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:25.007226 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae8385-eb26-48bc-91b0-6ca99ea34b46 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:25.140046 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440617d5-3512-496f-a80d-597ab43be08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:25.143283 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440617d5-3512-496f-a80d-597ab43be08a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:25.143283 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440617d5-3512-496f-a80d-597ab43be08a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:25.143283 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440617d5-3512-496f-a80d-597ab43be08a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:25.144768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440617d5-3512-496f-a80d-597ab43be08a None admin] RBAC: Adding query filter params (role.id=3cecaf09e54b4f479cd391db74c49831, scope.project.id=16bd6bbfd5774162b2c2103efb3a6d76, user.id=4925c25c93c147b9b92a596470d66d75) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:25.145901 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440617d5-3512-496f-a80d-597ab43be08a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:25.151353 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440617d5-3512-496f-a80d-597ab43be08a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:25.166378 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 149/294] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:25:24 2022] GET /identity/v3/role_assignments?user.id=4925c25c93c147b9b92a596470d66d75&scope.project.id=16bd6bbfd5774162b2c2103efb3a6d76&role.id=3cecaf09e54b4f479cd391db74c49831 => generated 608 bytes in 504 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:26.024964 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708cc15-ad98-4d5e-a0b0-fa819b521376 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:26.025784 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708cc15-ad98-4d5e-a0b0-fa819b521376 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:26.025936 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708cc15-ad98-4d5e-a0b0-fa819b521376 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:26.028737 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 146/295] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:26.037670 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a099be3-454f-44f2-8cc0-b8eedbee50c8 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:26.038561 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a099be3-454f-44f2-8cc0-b8eedbee50c8 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:26.038561 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a099be3-454f-44f2-8cc0-b8eedbee50c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:26.080587 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-6a099be3-454f-44f2-8cc0-b8eedbee50c8 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:26.082615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6a099be3-454f-44f2-8cc0-b8eedbee50c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:26.212490 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 150/296] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 08:25:26.580910 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a9610-f46d-44e9-9e5b-290d241bee58 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:26.581297 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a9610-f46d-44e9-9e5b-290d241bee58 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:26.581493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a9610-f46d-44e9-9e5b-290d241bee58 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:26.582981 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 147/297] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:26.589870 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bcf04-ef54-4cbd-9d1a-688bd3875410 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:26.590375 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bcf04-ef54-4cbd-9d1a-688bd3875410 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:26.590875 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bcf04-ef54-4cbd-9d1a-688bd3875410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:26.623406 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c74bcf04-ef54-4cbd-9d1a-688bd3875410 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:26.625476 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c74bcf04-ef54-4cbd-9d1a-688bd3875410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:26.645892 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a9610-f46d-44e9-9e5b-290d241bee58 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:26.723669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:26.772544 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 151/298] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:25:26.778397 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a9610-f46d-44e9-9e5b-290d241bee58 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:26.842872 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56492142-19f4-4e04-b828-e886e0b66114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:26.844196 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56492142-19f4-4e04-b828-e886e0b66114 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:26.844879 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56492142-19f4-4e04-b828-e886e0b66114 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:26.845543 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56492142-19f4-4e04-b828-e886e0b66114 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:26.866240 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56492142-19f4-4e04-b828-e886e0b66114 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:26.875996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-56492142-19f4-4e04-b828-e886e0b66114 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 08:25:26.875996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:26.875996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:26.875996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:26.875996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:26.875996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:26.875996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:26.875996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:26.875996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:26.875996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:26.875996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:26.875996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:26.875996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:26.875996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:26.875996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:26.875996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:26.878024 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:26.878024 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:26.878024 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:26.878024 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:26.878024 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:26.878024 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:26.878024 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:26.878024 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:26.878024 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:26.878024 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:26.878024 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:26.878024 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:26.878024 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:26.878024 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:26.878024 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:26.878024 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:26.879916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:26.879916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:26.879916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:26.879916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:26.879916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:26.879916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:26.879916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:26.879916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:26.879916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:26.879916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:26.879916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 08:25:26.879916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:25:26.883913 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 148/299] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:25:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:25:26.891378 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74bcf04-ef54-4cbd-9d1a-688bd3875410 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:26.999661 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74bcf04-ef54-4cbd-9d1a-688bd3875410 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:27.037684 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfec05b-87a0-440f-b3c5-0f24a28d7201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:27.038808 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfec05b-87a0-440f-b3c5-0f24a28d7201 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:27.038808 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfec05b-87a0-440f-b3c5-0f24a28d7201 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:27.038808 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfec05b-87a0-440f-b3c5-0f24a28d7201 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:27.039648 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfec05b-87a0-440f-b3c5-0f24a28d7201 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:27.039879 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfec05b-87a0-440f-b3c5-0f24a28d7201 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:27.041254 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfec05b-87a0-440f-b3c5-0f24a28d7201 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:27.050835 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 152/300] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Sep 11 08:25:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:27.057010 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56492142-19f4-4e04-b828-e886e0b66114 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:27.104897 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfec05b-87a0-440f-b3c5-0f24a28d7201 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:27.113283 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:27.150961 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:27.287970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfec05b-87a0-440f-b3c5-0f24a28d7201 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:27.306342 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56492142-19f4-4e04-b828-e886e0b66114 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:27.352027 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b68846-adab-4a4a-b6a9-932d90b3875c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:27.353228 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b68846-adab-4a4a-b6a9-932d90b3875c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:27.353673 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b68846-adab-4a4a-b6a9-932d90b3875c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:27.354168 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b68846-adab-4a4a-b6a9-932d90b3875c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:27.364217 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77781b5b-e15b-4d25-b2d1-6a32b99e980c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:27.365204 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77781b5b-e15b-4d25-b2d1-6a32b99e980c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:27.365705 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77781b5b-e15b-4d25-b2d1-6a32b99e980c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:27.366212 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77781b5b-e15b-4d25-b2d1-6a32b99e980c None admin] PATH_INFO: `/v3/users/dbde549ef59248c097945e1d2f33e546` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:27.374712 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b68846-adab-4a4a-b6a9-932d90b3875c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:27.387438 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-37b68846-adab-4a4a-b6a9-932d90b3875c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:25:27.387438 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:27.387438 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:27.387438 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:27.387438 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:27.387438 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:27.387438 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:27.387438 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:27.387438 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:27.387438 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:27.387438 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:27.387438 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:27.387438 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:27.387438 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:27.387438 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:27.387438 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:27.389505 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:27.389505 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:27.389505 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:27.389505 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:27.389505 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:27.389505 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:27.389505 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:27.389505 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:27.389505 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:27.389505 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:27.389505 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:27.389505 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:27.389505 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:27.389505 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:27.389505 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:27.389505 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:27.392220 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:27.392220 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:27.392220 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:27.392220 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:27.392220 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:27.392220 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:27.392220 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:27.392220 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:27.392220 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:27.392220 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:27.392220 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:25:27.392220 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:25:27.392220 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 153/301] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:25:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:25:27.392220 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e95db-8111-4afa-beb0-edc51cfb21ec None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:27.392945 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e95db-8111-4afa-beb0-edc51cfb21ec None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:27.393010 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e95db-8111-4afa-beb0-edc51cfb21ec None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:27.399815 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77781b5b-e15b-4d25-b2d1-6a32b99e980c None admin] RBAC: Authorizing `identity:get_user(user_id=dbde549ef59248c097945e1d2f33e546)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:27.401385 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77781b5b-e15b-4d25-b2d1-6a32b99e980c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:27.402379 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 154/302] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:27 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:27.403371 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 149/303] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:25:27 2022] GET /identity/v3/users/dbde549ef59248c097945e1d2f33e546 => generated 293 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:27.403913 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e95db-8111-4afa-beb0-edc51cfb21ec None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:27.410066 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73005aae-9545-47f8-b770-856925c9f404 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:27.410352 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73005aae-9545-47f8-b770-856925c9f404 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:27.411498 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73005aae-9545-47f8-b770-856925c9f404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:27.437655 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-73005aae-9545-47f8-b770-856925c9f404 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:27.439644 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-73005aae-9545-47f8-b770-856925c9f404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:27.549088 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:27.566241 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 150/304] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:25:27.568775 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e95db-8111-4afa-beb0-edc51cfb21ec None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:27.569234 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73005aae-9545-47f8-b770-856925c9f404 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:27.599018 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:27.619793 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6b6db-dae7-4e57-98bc-6412860d0628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:27.620802 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6b6db-dae7-4e57-98bc-6412860d0628 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:27.621266 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6b6db-dae7-4e57-98bc-6412860d0628 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:27.621672 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6b6db-dae7-4e57-98bc-6412860d0628 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:27.622940 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6b6db-dae7-4e57-98bc-6412860d0628 None admin] RBAC: Adding query filter params (name=member) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:27.623477 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6b6db-dae7-4e57-98bc-6412860d0628 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:27.625116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6b6db-dae7-4e57-98bc-6412860d0628 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:27.637055 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 155/305] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Sep 11 08:25:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:27.639461 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ebab6-5729-40f2-82ab-0fe29cd8c4f7 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:27.639963 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ebab6-5729-40f2-82ab-0fe29cd8c4f7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:27.640450 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ebab6-5729-40f2-82ab-0fe29cd8c4f7 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:27.643303 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 156/306] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:27.646119 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ebab6-5729-40f2-82ab-0fe29cd8c4f7 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:27.743979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73005aae-9545-47f8-b770-856925c9f404 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:27.790874 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb3281-a0c0-413d-bd19-ceb58d2d991e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:27.791533 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb3281-a0c0-413d-bd19-ceb58d2d991e None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:27.791820 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb3281-a0c0-413d-bd19-ceb58d2d991e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:27.792097 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb3281-a0c0-413d-bd19-ceb58d2d991e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:27.792821 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb3281-a0c0-413d-bd19-ceb58d2d991e None admin] RBAC: Adding query filter params (role.id=4c81d75b246b4f55b100a3a15eaba6a4, user.id=dbde549ef59248c097945e1d2f33e546, scope.system=all) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:27.793136 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb3281-a0c0-413d-bd19-ceb58d2d991e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:27.794616 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb3281-a0c0-413d-bd19-ceb58d2d991e None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:27.807282 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 151/307] 10.222.0.26 () {56 vars in 1308 bytes} [Sun Sep 11 08:25:27 2022] GET /identity/v3/role_assignments?user.id=dbde549ef59248c097945e1d2f33e546&scope.system=all&role.id=4c81d75b246b4f55b100a3a15eaba6a4 => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:27.807282 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029701a1-df95-4a4d-a812-20bfc475e4bb None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:27.807282 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029701a1-df95-4a4d-a812-20bfc475e4bb None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:27.807282 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029701a1-df95-4a4d-a812-20bfc475e4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:27.817266 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ebab6-5729-40f2-82ab-0fe29cd8c4f7 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:27.826251 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-029701a1-df95-4a4d-a812-20bfc475e4bb None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:27.827754 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-029701a1-df95-4a4d-a812-20bfc475e4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:27.870111 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e81f6-dcfd-4da3-ae78-d623731395a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:27.870687 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e81f6-dcfd-4da3-ae78-d623731395a0 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:27.870967 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e81f6-dcfd-4da3-ae78-d623731395a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:27.871274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e81f6-dcfd-4da3-ae78-d623731395a0 None admin] PATH_INFO: `/v3/users/ba11d7cc512f4f42a2d1c7841ef08e56` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:27.872571 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e81f6-dcfd-4da3-ae78-d623731395a0 None admin] RBAC: Authorizing `identity:get_user(user_id=ba11d7cc512f4f42a2d1c7841ef08e56)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:27.874080 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e81f6-dcfd-4da3-ae78-d623731395a0 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:27.875837 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 157/308] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:25:27 2022] GET /identity/v3/users/ba11d7cc512f4f42a2d1c7841ef08e56 => generated 293 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:27.876648 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e81f6-dcfd-4da3-ae78-d623731395a0 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:27.910330 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:27.923385 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 152/309] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:25:27.924509 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029701a1-df95-4a4d-a812-20bfc475e4bb None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:27.944054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:28.031394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e81f6-dcfd-4da3-ae78-d623731395a0 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:28.078795 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356741b-0860-4cd7-88e5-c0cbd1747825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:28.080339 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356741b-0860-4cd7-88e5-c0cbd1747825 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:28.080810 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356741b-0860-4cd7-88e5-c0cbd1747825 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:28.081276 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356741b-0860-4cd7-88e5-c0cbd1747825 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:28.082803 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a356741b-0860-4cd7-88e5-c0cbd1747825 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:28.084586 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a356741b-0860-4cd7-88e5-c0cbd1747825 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:28.087521 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 158/310] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:25:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:28.095292 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356741b-0860-4cd7-88e5-c0cbd1747825 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:28.116323 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029701a1-df95-4a4d-a812-20bfc475e4bb None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:28.162357 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835aa5c9-a987-4bb3-8841-8de488167f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:28.163595 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835aa5c9-a987-4bb3-8841-8de488167f4e None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:28.164063 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835aa5c9-a987-4bb3-8841-8de488167f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:28.165141 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835aa5c9-a987-4bb3-8841-8de488167f4e None admin] PATH_INFO: `/v3/system/users/ba11d7cc512f4f42a2d1c7841ef08e56/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:28.166961 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835aa5c9-a987-4bb3-8841-8de488167f4e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ba11d7cc512f4f42a2d1c7841ef08e56, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:28.168734 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835aa5c9-a987-4bb3-8841-8de488167f4e None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:28.252565 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:28.269556 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 153/311] 10.222.0.26 () {58 vars in 1334 bytes} [Sun Sep 11 08:25:27 2022] PUT /identity/v3/system/users/ba11d7cc512f4f42a2d1c7841ef08e56/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:25:28.269556 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835aa5c9-a987-4bb3-8841-8de488167f4e None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:28.276848 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356741b-0860-4cd7-88e5-c0cbd1747825 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:28.360796 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1afac2-be6b-443a-b381-926f3de58b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:28.362132 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1afac2-be6b-443a-b381-926f3de58b34 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:28.362835 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1afac2-be6b-443a-b381-926f3de58b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:28.363551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1afac2-be6b-443a-b381-926f3de58b34 None admin] PATH_INFO: `/v3/groups` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:28.364890 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1afac2-be6b-443a-b381-926f3de58b34 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:28.367663 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1afac2-be6b-443a-b381-926f3de58b34 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:28.372365 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:28.402371 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835aa5c9-a987-4bb3-8841-8de488167f4e None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:28.451237 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e46be-de9f-43f2-b1fb-de5153a6463d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:28.452356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e46be-de9f-43f2-b1fb-de5153a6463d None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:28.452947 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e46be-de9f-43f2-b1fb-de5153a6463d None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:28.453449 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e46be-de9f-43f2-b1fb-de5153a6463d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:28.454665 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 159/312] 10.222.0.26 () {60 vars in 1134 bytes} [Sun Sep 11 08:25:28 2022] POST /identity/v3/groups => generated 229 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:25:28.473388 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e46be-de9f-43f2-b1fb-de5153a6463d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:28.480540 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-bb5e46be-de9f-43f2-b1fb-de5153a6463d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 08:25:28.480540 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:28.480540 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:28.480540 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:28.480540 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:28.480540 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:28.480540 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:28.480540 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:28.480540 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:28.480540 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:28.480540 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:28.480540 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:28.480540 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:28.480540 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:28.480540 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:28.480540 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:28.481654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:28.481654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:28.481654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:28.481654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:28.481654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:28.481654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:28.481654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:28.481654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:28.481654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:28.481654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:28.481654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:28.481654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:28.481654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:28.481654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:28.481654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:28.481654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:28.482544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:28.482544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:28.482544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:28.482544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:28.482544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:28.482544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:28.482544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:28.482544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:28.482544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:28.482544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:28.482544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 08:25:28.482544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:25:28.484826 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 154/313] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:25:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:25:28.492573 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1afac2-be6b-443a-b381-926f3de58b34 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:28.626952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1afac2-be6b-443a-b381-926f3de58b34 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:28.667825 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630954d-3494-4497-8255-d99a9cf50054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:28.668487 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630954d-3494-4497-8255-d99a9cf50054 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:28.668778 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630954d-3494-4497-8255-d99a9cf50054 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:28.669057 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630954d-3494-4497-8255-d99a9cf50054 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:28.669772 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4630954d-3494-4497-8255-d99a9cf50054 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:28.670083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4630954d-3494-4497-8255-d99a9cf50054 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:28.671592 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4630954d-3494-4497-8255-d99a9cf50054 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:28.681757 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 160/314] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Sep 11 08:25:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:28.687784 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e46be-de9f-43f2-b1fb-de5153a6463d None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:28.822150 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e46be-de9f-43f2-b1fb-de5153a6463d None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:28.886132 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32703265-3ed0-4a8c-8b87-2a7628f77599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:28.887512 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32703265-3ed0-4a8c-8b87-2a7628f77599 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:28.888231 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32703265-3ed0-4a8c-8b87-2a7628f77599 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:28.888913 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32703265-3ed0-4a8c-8b87-2a7628f77599 None admin] PATH_INFO: `/v3/users/71db31096303405cbf552b1b23a795af` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:28.890833 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32703265-3ed0-4a8c-8b87-2a7628f77599 None admin] RBAC: Authorizing `identity:get_user(user_id=71db31096303405cbf552b1b23a795af)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:28.893791 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32703265-3ed0-4a8c-8b87-2a7628f77599 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:28.896885 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 155/315] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:25:28 2022] GET /identity/v3/users/71db31096303405cbf552b1b23a795af => generated 297 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:28.904535 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630954d-3494-4497-8255-d99a9cf50054 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:28.925672 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:29.047523 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630954d-3494-4497-8255-d99a9cf50054 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:29.088096 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbc47e-0abb-40fb-abdd-4f3d05982260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:29.088695 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbc47e-0abb-40fb-abdd-4f3d05982260 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:29.088914 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbc47e-0abb-40fb-abdd-4f3d05982260 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:29.089163 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbc47e-0abb-40fb-abdd-4f3d05982260 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:29.168147 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dbc47e-0abb-40fb-abdd-4f3d05982260 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:29.169769 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dbc47e-0abb-40fb-abdd-4f3d05982260 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:29.192781 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:29.293678 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 161/316] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:25:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 08:25:29.303511 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32703265-3ed0-4a8c-8b87-2a7628f77599 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:29.311661 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:29.437533 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32703265-3ed0-4a8c-8b87-2a7628f77599 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:29.475785 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7c804-183d-4953-b8a2-a60b50db1b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:29.477661 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7c804-183d-4953-b8a2-a60b50db1b11 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:29.478020 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7c804-183d-4953-b8a2-a60b50db1b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:29.478369 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7c804-183d-4953-b8a2-a60b50db1b11 None admin] PATH_INFO: `/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:29.479823 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7c804-183d-4953-b8a2-a60b50db1b11 None admin] RBAC: Authorizing `identity:get_project(project_id=16bd6bbfd5774162b2c2103efb3a6d76)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:29.481517 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7c804-183d-4953-b8a2-a60b50db1b11 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:29.483859 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 156/317] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:25:29 2022] GET /identity/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:29.490703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbc47e-0abb-40fb-abdd-4f3d05982260 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:29.610608 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbc47e-0abb-40fb-abdd-4f3d05982260 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:29.629776 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:29.654880 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42e4de-c8f0-4140-bf17-86c5cf1a272c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:29.655538 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42e4de-c8f0-4140-bf17-86c5cf1a272c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:29.655824 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42e4de-c8f0-4140-bf17-86c5cf1a272c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:29.656097 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42e4de-c8f0-4140-bf17-86c5cf1a272c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:29.656841 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42e4de-c8f0-4140-bf17-86c5cf1a272c None admin] RBAC: Adding query filter params (role.id=4c81d75b246b4f55b100a3a15eaba6a4, scope.project.id=16bd6bbfd5774162b2c2103efb3a6d76, user.id=71db31096303405cbf552b1b23a795af) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:29.657154 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42e4de-c8f0-4140-bf17-86c5cf1a272c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:29.658712 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42e4de-c8f0-4140-bf17-86c5cf1a272c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:29.666571 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 162/318] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:25:29 2022] GET /identity/v3/role_assignments?user.id=71db31096303405cbf552b1b23a795af&scope.project.id=16bd6bbfd5774162b2c2103efb3a6d76&role.id=4c81d75b246b4f55b100a3a15eaba6a4 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:30.460829 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc533c-e4a8-4e1f-a5ba-687151de739a None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:30.462168 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc533c-e4a8-4e1f-a5ba-687151de739a None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:30.462168 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc533c-e4a8-4e1f-a5ba-687151de739a None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:30.463301 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 157/319] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:25:30.469200 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86724793-a118-455d-986d-c8040532e4cd None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:30.469899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86724793-a118-455d-986d-c8040532e4cd None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:30.469899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86724793-a118-455d-986d-c8040532e4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:30.495896 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-86724793-a118-455d-986d-c8040532e4cd None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:30.498285 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-86724793-a118-455d-986d-c8040532e4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:30.615513 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 163/320] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:25:30.903104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09e71c-090f-4068-8e13-e87839ec1d86 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:30.903527 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09e71c-090f-4068-8e13-e87839ec1d86 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:30.903696 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09e71c-090f-4068-8e13-e87839ec1d86 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:30.905172 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 158/321] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:30.910652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b0906-de32-443f-b27a-f71fbc5da5c9 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:30.911025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b0906-de32-443f-b27a-f71fbc5da5c9 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:30.911431 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b0906-de32-443f-b27a-f71fbc5da5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:30.931043 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-096b0906-de32-443f-b27a-f71fbc5da5c9 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:30.932312 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-096b0906-de32-443f-b27a-f71fbc5da5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:31.004905 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 164/322] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 08:25:31.037557 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09e71c-090f-4068-8e13-e87839ec1d86 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:31.165487 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:31.214689 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09e71c-090f-4068-8e13-e87839ec1d86 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:31.253716 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f55363-1343-4da6-80b3-ee17260a203e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:31.254632 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f55363-1343-4da6-80b3-ee17260a203e None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:31.255062 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f55363-1343-4da6-80b3-ee17260a203e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:31.255520 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f55363-1343-4da6-80b3-ee17260a203e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:31.267892 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f55363-1343-4da6-80b3-ee17260a203e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:31.274375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-d4f55363-1343-4da6-80b3-ee17260a203e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 08:25:31.274375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:31.274375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:31.274375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:31.274375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:31.274375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:31.274375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:31.274375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:31.274375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:31.274375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:31.274375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:31.274375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:31.274375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:31.274375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:31.274375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:31.274375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:31.275521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:31.275521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:31.275521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:31.275521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:31.275521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:31.275521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:31.275521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:31.275521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:31.275521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:31.275521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:31.275521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:31.275521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:31.275521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:31.275521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:31.275521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:31.275521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:31.276544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:31.276544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:31.276544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:31.276544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:31.276544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:31.276544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:31.276544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:31.276544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:31.276544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:31.276544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:31.276544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 08:25:31.276544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:25:31.278567 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 159/323] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:25:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:25:31.279471 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b0906-de32-443f-b27a-f71fbc5da5c9 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:31.287640 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f55363-1343-4da6-80b3-ee17260a203e None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:31.333702 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:31.408149 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f55363-1343-4da6-80b3-ee17260a203e None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:31.410646 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b0906-de32-443f-b27a-f71fbc5da5c9 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:31.441467 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:31.446990 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1193cc8-2b4a-423c-837c-0561de38a28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:31.447658 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1193cc8-2b4a-423c-837c-0561de38a28f None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:31.447937 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1193cc8-2b4a-423c-837c-0561de38a28f None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:31.448209 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1193cc8-2b4a-423c-837c-0561de38a28f None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:31.448562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7d3af-d82f-4dd9-be65-33c697864293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:31.448886 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1193cc8-2b4a-423c-837c-0561de38a28f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:31.449185 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1193cc8-2b4a-423c-837c-0561de38a28f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:31.449279 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7d3af-d82f-4dd9-be65-33c697864293 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:31.449465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7d3af-d82f-4dd9-be65-33c697864293 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:31.449740 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7d3af-d82f-4dd9-be65-33c697864293 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:31.450577 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1193cc8-2b4a-423c-837c-0561de38a28f None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:31.450876 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb7d3af-d82f-4dd9-be65-33c697864293 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:31.452388 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb7d3af-d82f-4dd9-be65-33c697864293 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:31.456123 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 165/324] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:25:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:31.460321 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 160/325] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Sep 11 08:25:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:31.460497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7d3af-d82f-4dd9-be65-33c697864293 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:31.466177 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1193cc8-2b4a-423c-837c-0561de38a28f None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:31.574263 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7d3af-d82f-4dd9-be65-33c697864293 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:31.575546 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1193cc8-2b4a-423c-837c-0561de38a28f None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:31.582402 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:31.612217 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2fb0d-f54a-4884-892f-c7abfa2952cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:31.612882 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2fb0d-f54a-4884-892f-c7abfa2952cb None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:31.613170 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2fb0d-f54a-4884-892f-c7abfa2952cb None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:31.613295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76bad16-353c-49ab-ad78-6ba9745502ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:31.613497 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2fb0d-f54a-4884-892f-c7abfa2952cb None admin] PATH_INFO: `/v3/users/dbde549ef59248c097945e1d2f33e546` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:31.613825 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bad16-353c-49ab-ad78-6ba9745502ef None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:31.614104 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bad16-353c-49ab-ad78-6ba9745502ef None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:31.614379 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bad16-353c-49ab-ad78-6ba9745502ef None admin] PATH_INFO: `/v3/groups` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:31.614669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2fb0d-f54a-4884-892f-c7abfa2952cb None admin] RBAC: Authorizing `identity:get_user(user_id=dbde549ef59248c097945e1d2f33e546)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:31.615024 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76bad16-353c-49ab-ad78-6ba9745502ef None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:31.616149 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2fb0d-f54a-4884-892f-c7abfa2952cb None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:31.616503 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76bad16-353c-49ab-ad78-6ba9745502ef None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:31.617925 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 161/326] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:25:31 2022] GET /identity/v3/users/dbde549ef59248c097945e1d2f33e546 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:25:31.623440 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2fb0d-f54a-4884-892f-c7abfa2952cb None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:31.685013 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 166/327] 10.222.0.26 () {60 vars in 1134 bytes} [Sun Sep 11 08:25:31 2022] POST /identity/v3/groups => generated 226 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:25:31.709813 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:31.758622 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2fb0d-f54a-4884-892f-c7abfa2952cb None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:31.797178 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6327275-a411-4558-bc16-b07a78dd0f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:31.797865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6327275-a411-4558-bc16-b07a78dd0f88 None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:31.798149 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6327275-a411-4558-bc16-b07a78dd0f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:31.798427 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6327275-a411-4558-bc16-b07a78dd0f88 None admin] PATH_INFO: `/v3/system/users/dbde549ef59248c097945e1d2f33e546/roles/4c81d75b246b4f55b100a3a15eaba6a4` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:31.799971 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6327275-a411-4558-bc16-b07a78dd0f88 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=dbde549ef59248c097945e1d2f33e546, role_id=4c81d75b246b4f55b100a3a15eaba6a4)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:31.801391 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6327275-a411-4558-bc16-b07a78dd0f88 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:31.845266 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 162/328] 10.222.0.26 () {58 vars in 1334 bytes} [Sun Sep 11 08:25:31 2022] PUT /identity/v3/system/users/dbde549ef59248c097945e1d2f33e546/roles/4c81d75b246b4f55b100a3a15eaba6a4 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:25:31.892794 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02637e9-4411-4a55-89f8-623a8bd45569 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:31.893143 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02637e9-4411-4a55-89f8-623a8bd45569 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:31.893336 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02637e9-4411-4a55-89f8-623a8bd45569 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:31.894770 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 167/329] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:31.902775 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f15386-0122-443f-992b-71e8a0fd205e None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:31.903237 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f15386-0122-443f-992b-71e8a0fd205e None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:31.903734 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f15386-0122-443f-992b-71e8a0fd205e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:31.930980 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-82f15386-0122-443f-992b-71e8a0fd205e None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:31.932872 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-82f15386-0122-443f-992b-71e8a0fd205e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:32.035903 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 163/330] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:25:32.310233 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02637e9-4411-4a55-89f8-623a8bd45569 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:32.439594 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02637e9-4411-4a55-89f8-623a8bd45569 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:32.487052 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2343e-60ae-41ea-9961-d94198f8c3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:32.487777 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2343e-60ae-41ea-9961-d94198f8c3ff None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:32.488068 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2343e-60ae-41ea-9961-d94198f8c3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:32.488398 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2343e-60ae-41ea-9961-d94198f8c3ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:32.516673 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2343e-60ae-41ea-9961-d94198f8c3ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:32.521926 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-f7f2343e-60ae-41ea-9961-d94198f8c3ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:25:32.521926 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:32.521926 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:32.521926 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:32.521926 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:32.521926 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:32.521926 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:32.521926 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:32.521926 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:32.521926 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:32.521926 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:32.521926 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:32.521926 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:32.521926 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:32.521926 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:32.521926 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:32.522952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:32.522952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:32.522952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:32.522952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:32.522952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:32.522952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:32.522952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:32.522952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:32.522952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:32.522952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:32.522952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:32.522952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:32.522952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:32.522952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:32.522952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:32.522952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:32.524376 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:32.524376 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:32.524376 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:32.524376 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:32.524376 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:32.524376 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:32.524376 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:32.524376 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:32.524376 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:32.524376 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:32.524376 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:25:32.524376 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:25:32.526980 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 168/331] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:25:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:25:32.533762 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f15386-0122-443f-992b-71e8a0fd205e None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:32.628833 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:32.688698 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f15386-0122-443f-992b-71e8a0fd205e None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:32.746816 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781c5d5-1073-4ffa-9f68-cdaeabb1fd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:32.747789 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781c5d5-1073-4ffa-9f68-cdaeabb1fd22 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:32.748296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781c5d5-1073-4ffa-9f68-cdaeabb1fd22 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:32.748717 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781c5d5-1073-4ffa-9f68-cdaeabb1fd22 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:32.749783 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781c5d5-1073-4ffa-9f68-cdaeabb1fd22 None admin] RBAC: Adding query filter params (name=member) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:32.750261 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781c5d5-1073-4ffa-9f68-cdaeabb1fd22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:32.752543 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781c5d5-1073-4ffa-9f68-cdaeabb1fd22 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:32.765960 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 164/332] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Sep 11 08:25:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:32.771513 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2343e-60ae-41ea-9961-d94198f8c3ff None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:32.822314 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:32.943169 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2343e-60ae-41ea-9961-d94198f8c3ff None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:32.988478 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd07fc0-841a-4e0e-b18a-4ce1ea4ad7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:32.989125 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd07fc0-841a-4e0e-b18a-4ce1ea4ad7ff None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:32.989407 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd07fc0-841a-4e0e-b18a-4ce1ea4ad7ff None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:32.989678 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd07fc0-841a-4e0e-b18a-4ce1ea4ad7ff None admin] PATH_INFO: `/v3/users/ba11d7cc512f4f42a2d1c7841ef08e56` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:32.992956 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd07fc0-841a-4e0e-b18a-4ce1ea4ad7ff None admin] RBAC: Authorizing `identity:get_user(user_id=ba11d7cc512f4f42a2d1c7841ef08e56)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:32.995040 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd07fc0-841a-4e0e-b18a-4ce1ea4ad7ff None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:32.998079 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 169/333] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:25:32 2022] GET /identity/v3/users/ba11d7cc512f4f42a2d1c7841ef08e56 => generated 293 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:33.004259 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781c5d5-1073-4ffa-9f68-cdaeabb1fd22 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:33.224407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781c5d5-1073-4ffa-9f68-cdaeabb1fd22 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:33.263712 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:33.305603 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f976c6-c04c-4858-98c0-58faefbe1f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:33.306688 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f976c6-c04c-4858-98c0-58faefbe1f7a None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:33.312110 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f976c6-c04c-4858-98c0-58faefbe1f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:33.312591 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f976c6-c04c-4858-98c0-58faefbe1f7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:33.314120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f976c6-c04c-4858-98c0-58faefbe1f7a None admin] RBAC: Adding query filter params (role.id=3cecaf09e54b4f479cd391db74c49831, user.id=ba11d7cc512f4f42a2d1c7841ef08e56, scope.system=all) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:33.314625 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f976c6-c04c-4858-98c0-58faefbe1f7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:33.317524 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f976c6-c04c-4858-98c0-58faefbe1f7a None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:33.345476 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 165/334] 10.222.0.26 () {56 vars in 1308 bytes} [Sun Sep 11 08:25:33 2022] GET /identity/v3/role_assignments?user.id=ba11d7cc512f4f42a2d1c7841ef08e56&scope.system=all&role.id=3cecaf09e54b4f479cd391db74c49831 => generated 510 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:35.110352 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3e269-0681-4fb9-abac-b552669f66c1 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:35.111901 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3e269-0681-4fb9-abac-b552669f66c1 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:35.112588 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3e269-0681-4fb9-abac-b552669f66c1 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:35.116006 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 170/335] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:35.124844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79ee7b-c158-46e6-8f6e-6a4eadbd2877 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:35.126241 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79ee7b-c158-46e6-8f6e-6a4eadbd2877 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:35.126987 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79ee7b-c158-46e6-8f6e-6a4eadbd2877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:35.167408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-7b79ee7b-c158-46e6-8f6e-6a4eadbd2877 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:35.170026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7b79ee7b-c158-46e6-8f6e-6a4eadbd2877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:35.207981 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170650a9-abec-4ebe-b5f1-e30f6405199f None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:35.208877 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170650a9-abec-4ebe-b5f1-e30f6405199f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:35.209652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170650a9-abec-4ebe-b5f1-e30f6405199f None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:35.216839 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 171/336] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:35 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:25:35.225835 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5737da-bc72-4594-a8fe-80d83c1781a0 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:35.227224 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5737da-bc72-4594-a8fe-80d83c1781a0 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:35.227948 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5737da-bc72-4594-a8fe-80d83c1781a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:35.292936 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-6b5737da-bc72-4594-a8fe-80d83c1781a0 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:35.295418 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6b5737da-bc72-4594-a8fe-80d83c1781a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:35.325734 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 166/337] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 08:25:35.467383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 172/338] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:25:35.766973 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e06277-fcd8-4f6b-84f1-48c26f0a27e6 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:35.767878 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e06277-fcd8-4f6b-84f1-48c26f0a27e6 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:35.768586 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e06277-fcd8-4f6b-84f1-48c26f0a27e6 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:35.771119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 167/339] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:35.778739 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5accd9-a9ed-428f-81e9-4ac77f78555f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:35.779748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5accd9-a9ed-428f-81e9-4ac77f78555f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:35.780464 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5accd9-a9ed-428f-81e9-4ac77f78555f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:35.823935 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2a5accd9-a9ed-428f-81e9-4ac77f78555f None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:35.826390 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2a5accd9-a9ed-428f-81e9-4ac77f78555f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:35.837060 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e06277-fcd8-4f6b-84f1-48c26f0a27e6 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:35.869376 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:35.977393 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 173/340] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 08:25:36.013348 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e06277-fcd8-4f6b-84f1-48c26f0a27e6 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:36.027000 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:36.061431 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6f9fa-62c1-474e-88c4-d8cb40fb6bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:36.062439 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6f9fa-62c1-474e-88c4-d8cb40fb6bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:36.062950 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6f9fa-62c1-474e-88c4-d8cb40fb6bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:36.063458 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6f9fa-62c1-474e-88c4-d8cb40fb6bb5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:36.082317 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6f9fa-62c1-474e-88c4-d8cb40fb6bb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:36.096469 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-f0f6f9fa-62c1-474e-88c4-d8cb40fb6bb5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 08:25:36.096469 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:36.096469 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:36.096469 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:36.096469 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:36.096469 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:36.096469 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:36.096469 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:36.096469 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:36.096469 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:36.096469 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:36.096469 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:36.096469 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:36.096469 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:36.096469 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:36.096469 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:36.097450 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:36.097450 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:36.097450 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:36.097450 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:36.097450 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:36.097450 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:36.097450 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:36.097450 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:36.097450 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:36.097450 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:36.097450 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:36.097450 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:36.097450 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:36.097450 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:36.097450 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:36.097450 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:36.098243 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:36.098243 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:36.098243 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:36.098243 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:36.098243 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:36.098243 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:36.098243 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:36.098243 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:36.098243 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:36.098243 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:36.098243 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 08:25:36.098243 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:25:36.099387 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 168/341] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Sep 11 08:25:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:25:36.108359 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5accd9-a9ed-428f-81e9-4ac77f78555f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:36.183617 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6f9fa-62c1-474e-88c4-d8cb40fb6bb5 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:36.362558 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5accd9-a9ed-428f-81e9-4ac77f78555f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:36.464814 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6f9fa-62c1-474e-88c4-d8cb40fb6bb5 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:36.465422 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552608a-88e0-4ce6-82d2-da1ed533bc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:36.466160 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552608a-88e0-4ce6-82d2-da1ed533bc2f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:36.466547 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552608a-88e0-4ce6-82d2-da1ed533bc2f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:36.466931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552608a-88e0-4ce6-82d2-da1ed533bc2f None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:36.467754 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552608a-88e0-4ce6-82d2-da1ed533bc2f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:36.468187 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552608a-88e0-4ce6-82d2-da1ed533bc2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:36.469826 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552608a-88e0-4ce6-82d2-da1ed533bc2f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:36.486241 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 174/342] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:25:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:36.487454 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552608a-88e0-4ce6-82d2-da1ed533bc2f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:36.535772 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:36.538103 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5639ce1-9ab6-4e77-a5b9-32918434df2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:36.539143 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5639ce1-9ab6-4e77-a5b9-32918434df2e None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:36.540103 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5639ce1-9ab6-4e77-a5b9-32918434df2e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:36.540503 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5639ce1-9ab6-4e77-a5b9-32918434df2e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:36.573743 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5639ce1-9ab6-4e77-a5b9-32918434df2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:36.588844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-b5639ce1-9ab6-4e77-a5b9-32918434df2e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:25:36.588844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:36.588844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:36.588844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:36.588844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:36.588844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:36.588844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:36.588844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:36.588844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:36.588844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:36.588844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:36.588844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:36.588844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:36.588844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:36.588844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:36.588844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:36.589819 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:36.589819 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:36.589819 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:36.589819 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:36.589819 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:36.589819 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:36.589819 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:36.589819 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:36.589819 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:36.589819 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:36.589819 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:36.589819 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:36.589819 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:36.589819 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:36.589819 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:36.589819 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:36.590635 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:36.590635 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:36.590635 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:36.590635 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:36.590635 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:36.590635 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:36.590635 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:36.590635 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:36.590635 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:36.590635 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:36.590635 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:25:36.590635 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:25:36.591847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 169/343] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:25:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:25:36.592713 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5639ce1-9ab6-4e77-a5b9-32918434df2e None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:36.667440 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:36.781604 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552608a-88e0-4ce6-82d2-da1ed533bc2f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:36.824773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5639ce1-9ab6-4e77-a5b9-32918434df2e None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:36.892015 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35da733-e959-4ecf-8526-3ddc6321149d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:36.892851 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35da733-e959-4ecf-8526-3ddc6321149d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:36.893012 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba0055-df13-414d-9b0c-dcc7f840fb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:36.893356 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35da733-e959-4ecf-8526-3ddc6321149d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:36.893739 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35da733-e959-4ecf-8526-3ddc6321149d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:36.894623 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba0055-df13-414d-9b0c-dcc7f840fb18 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:36.895301 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba0055-df13-414d-9b0c-dcc7f840fb18 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:36.895927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba0055-df13-414d-9b0c-dcc7f840fb18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:36.913156 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35da733-e959-4ecf-8526-3ddc6321149d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:36.933452 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-d35da733-e959-4ecf-8526-3ddc6321149d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 08:25:36.933452 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:36.933452 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:36.933452 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:36.933452 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:36.933452 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:36.933452 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:36.933452 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:36.933452 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:36.933452 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:36.933452 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:36.933452 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:36.933452 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:36.933452 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:36.933452 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:36.933452 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:36.935428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:36.935428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:36.935428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:36.935428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:36.935428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:36.935428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:36.935428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:36.935428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:36.935428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:36.935428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:36.935428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:36.935428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:36.935428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:36.935428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:36.935428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:36.935428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:36.937231 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:36.937231 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:36.937231 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:36.937231 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:36.937231 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:36.937231 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:36.937231 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:36.937231 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:36.937231 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:36.937231 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:36.937231 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 08:25:36.937231 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:25:36.939367 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 175/344] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:25:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 448 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:25:36.940848 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35da733-e959-4ecf-8526-3ddc6321149d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:37.043066 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba0055-df13-414d-9b0c-dcc7f840fb18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:37.046714 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba0055-df13-414d-9b0c-dcc7f840fb18 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:37.112483 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:37.115523 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:37.154751 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35da733-e959-4ecf-8526-3ddc6321149d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:37.234135 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 170/345] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:25:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 08:25:37.239283 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20721c-40fc-4bfa-b419-c677d80e15b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:37.239551 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff8dcd-d09d-4dad-bb27-251d277a140d None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:37.239551 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff8dcd-d09d-4dad-bb27-251d277a140d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:37.239551 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff8dcd-d09d-4dad-bb27-251d277a140d None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:37.239551 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 171/346] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:37.241073 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20721c-40fc-4bfa-b419-c677d80e15b8 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:37.241634 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20721c-40fc-4bfa-b419-c677d80e15b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:37.242802 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20721c-40fc-4bfa-b419-c677d80e15b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:37.243885 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff8dcd-d09d-4dad-bb27-251d277a140d None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:37.244749 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f20721c-40fc-4bfa-b419-c677d80e15b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:37.245478 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f20721c-40fc-4bfa-b419-c677d80e15b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:37.253241 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f20721c-40fc-4bfa-b419-c677d80e15b8 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:37.278263 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 176/347] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Sep 11 08:25:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:37.280871 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90d4d2-2c4a-43b0-a317-b63611916e03 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:37.281609 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90d4d2-2c4a-43b0-a317-b63611916e03 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:37.282294 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90d4d2-2c4a-43b0-a317-b63611916e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:37.315290 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2d90d4d2-2c4a-43b0-a317-b63611916e03 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:37.317650 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2d90d4d2-2c4a-43b0-a317-b63611916e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:37.368161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff8dcd-d09d-4dad-bb27-251d277a140d None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:37.398496 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:37.409022 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f5b56-1749-40c7-8364-3ea60c65a34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:37.414222 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f5b56-1749-40c7-8364-3ea60c65a34c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:37.414222 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f5b56-1749-40c7-8364-3ea60c65a34c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:37.414222 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f5b56-1749-40c7-8364-3ea60c65a34c None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:37.414222 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f5b56-1749-40c7-8364-3ea60c65a34c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:37.414222 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f5b56-1749-40c7-8364-3ea60c65a34c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:37.414222 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f5b56-1749-40c7-8364-3ea60c65a34c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:37.427574 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 172/348] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Sep 11 08:25:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:37.428620 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f5b56-1749-40c7-8364-3ea60c65a34c None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:37.457143 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 177/349] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:25:37.458436 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90d4d2-2c4a-43b0-a317-b63611916e03 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:37.600103 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:37.618465 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f5b56-1749-40c7-8364-3ea60c65a34c None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:37.689660 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90d4d2-2c4a-43b0-a317-b63611916e03 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:37.701609 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd303ea2-d6a4-41d2-af63-d25e4c7f4906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:37.702762 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd303ea2-d6a4-41d2-af63-d25e4c7f4906 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:37.703231 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd303ea2-d6a4-41d2-af63-d25e4c7f4906 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:37.703966 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd303ea2-d6a4-41d2-af63-d25e4c7f4906 None admin] PATH_INFO: `/v3/projects/cfef4a17bab2408d8ab3549e927bff2d` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:37.712850 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd303ea2-d6a4-41d2-af63-d25e4c7f4906 None admin] RBAC: Authorizing `identity:get_project(project_id=cfef4a17bab2408d8ab3549e927bff2d)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:37.715594 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd303ea2-d6a4-41d2-af63-d25e4c7f4906 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:37.722904 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 173/350] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:25:37 2022] GET /identity/v3/projects/cfef4a17bab2408d8ab3549e927bff2d => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:37.724836 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd303ea2-d6a4-41d2-af63-d25e4c7f4906 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:37.824320 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3e14a-d372-45a8-9564-9f010a916983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:37.825321 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3e14a-d372-45a8-9564-9f010a916983 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:37.825767 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3e14a-d372-45a8-9564-9f010a916983 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:37.826206 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3e14a-d372-45a8-9564-9f010a916983 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:37.935822 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:38.028636 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3e14a-d372-45a8-9564-9f010a916983 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:38.030179 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3e14a-d372-45a8-9564-9f010a916983 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:38.034038 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd303ea2-d6a4-41d2-af63-d25e4c7f4906 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:38.109410 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8ed16-199d-496d-ba12-94f205658e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:38.110835 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8ed16-199d-496d-ba12-94f205658e79 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:38.111603 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8ed16-199d-496d-ba12-94f205658e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:38.112892 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8ed16-199d-496d-ba12-94f205658e79 None admin] PATH_INFO: `/v3/users/dbde549ef59248c097945e1d2f33e546` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:38.115589 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8ed16-199d-496d-ba12-94f205658e79 None admin] RBAC: Authorizing `identity:get_user(user_id=dbde549ef59248c097945e1d2f33e546)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:38.119080 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8ed16-199d-496d-ba12-94f205658e79 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:38.122517 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 174/351] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:25:37 2022] GET /identity/v3/users/dbde549ef59248c097945e1d2f33e546 => generated 293 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:38.125779 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8ed16-199d-496d-ba12-94f205658e79 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:38.200443 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:38.251988 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 178/352] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:25:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 794 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 08:25:38.252472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3e14a-d372-45a8-9564-9f010a916983 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:38.327776 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8ed16-199d-496d-ba12-94f205658e79 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:38.390124 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:38.423856 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d21202-5848-481f-8c7f-e92617b86bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:38.427363 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d21202-5848-481f-8c7f-e92617b86bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:38.428293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d21202-5848-481f-8c7f-e92617b86bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:38.429014 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d21202-5848-481f-8c7f-e92617b86bb8 None admin] PATH_INFO: `/v3/groups/eca5bad56e68442b90b6ef30229e2dad` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:38.441237 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d21202-5848-481f-8c7f-e92617b86bb8 None admin] RBAC: Authorizing `identity:get_group(group_id=eca5bad56e68442b90b6ef30229e2dad)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:38.446135 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d21202-5848-481f-8c7f-e92617b86bb8 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:38.449728 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 175/353] 10.222.0.26 () {56 vars in 1180 bytes} [Sun Sep 11 08:25:38 2022] GET /identity/v3/groups/eca5bad56e68442b90b6ef30229e2dad => generated 226 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:38.451700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d21202-5848-481f-8c7f-e92617b86bb8 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:38.478836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3e14a-d372-45a8-9564-9f010a916983 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:38.564605 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0012b36-42d3-4eef-93af-b71e46e1ae61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:38.564894 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0012b36-42d3-4eef-93af-b71e46e1ae61 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:38.565849 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0012b36-42d3-4eef-93af-b71e46e1ae61 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:38.565849 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0012b36-42d3-4eef-93af-b71e46e1ae61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:38.566736 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0012b36-42d3-4eef-93af-b71e46e1ae61 None admin] RBAC: Adding query filter params (role.id=4c81d75b246b4f55b100a3a15eaba6a4, user.id=dbde549ef59248c097945e1d2f33e546, scope.system=all) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:38.567286 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0012b36-42d3-4eef-93af-b71e46e1ae61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:38.569818 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0012b36-42d3-4eef-93af-b71e46e1ae61 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:38.599292 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 179/354] 10.222.0.26 () {56 vars in 1308 bytes} [Sun Sep 11 08:25:38 2022] GET /identity/v3/role_assignments?user.id=dbde549ef59248c097945e1d2f33e546&scope.system=all&role.id=4c81d75b246b4f55b100a3a15eaba6a4 => generated 510 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:38.599691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0012b36-42d3-4eef-93af-b71e46e1ae61 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:38.635764 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:38.654502 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d21202-5848-481f-8c7f-e92617b86bb8 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:38.726478 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0012b36-42d3-4eef-93af-b71e46e1ae61 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:38.736924 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21e488-4ba4-4f63-9a5d-12ec2fcc6f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:38.738478 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21e488-4ba4-4f63-9a5d-12ec2fcc6f56 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:38.739481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21e488-4ba4-4f63-9a5d-12ec2fcc6f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:38.740298 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21e488-4ba4-4f63-9a5d-12ec2fcc6f56 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:38.763461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da21e488-4ba4-4f63-9a5d-12ec2fcc6f56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:38.773696 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b5181-1eb6-408a-b750-341fe0372b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:38.774341 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b5181-1eb6-408a-b750-341fe0372b44 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:38.774618 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b5181-1eb6-408a-b750-341fe0372b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:38.774888 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b5181-1eb6-408a-b750-341fe0372b44 None admin] PATH_INFO: `/v3/projects/cfef4a17bab2408d8ab3549e927bff2d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:38.776106 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b5181-1eb6-408a-b750-341fe0372b44 None admin] RBAC: Authorizing `identity:get_project(project_id=cfef4a17bab2408d8ab3549e927bff2d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:38.777575 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b5181-1eb6-408a-b750-341fe0372b44 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:38.778566 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-da21e488-4ba4-4f63-9a5d-12ec2fcc6f56 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:25:38.778566 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:38.778566 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:38.778566 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:38.778566 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:38.778566 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:38.778566 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:38.778566 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:38.778566 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:38.778566 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:38.778566 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:38.778566 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:38.778566 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:38.778566 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:38.778566 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:38.778566 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:38.780329 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:38.780329 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:38.780329 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:38.780329 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:38.780329 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:38.780329 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:38.780329 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:38.780329 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:38.780329 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:38.780329 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:38.780329 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:38.780329 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:38.780329 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:38.780329 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:38.780329 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:38.780329 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:38.781833 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:38.781833 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:38.781833 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:38.781833 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:38.781833 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:38.781833 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:38.781833 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:38.781833 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:38.781833 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:38.781833 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:38.781833 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:25:38.781833 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:25:38.783037 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 180/355] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:25:38 2022] GET /identity/v3/projects/cfef4a17bab2408d8ab3549e927bff2d => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:38.783037 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b5181-1eb6-408a-b750-341fe0372b44 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:38.791081 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 176/356] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:25:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:25:38.793962 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524667a4-2fbb-4176-983f-57e1e4acad89 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:38.794795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524667a4-2fbb-4176-983f-57e1e4acad89 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:38.795669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524667a4-2fbb-4176-983f-57e1e4acad89 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:38.798817 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 177/357] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:38.805393 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524667a4-2fbb-4176-983f-57e1e4acad89 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:38.912767 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:38.920198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:38.921761 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b5181-1eb6-408a-b750-341fe0372b44 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:38.988046 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103bc42-ea29-466e-9fa9-f35baf1cfea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:38.988913 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103bc42-ea29-466e-9fa9-f35baf1cfea9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:38.989376 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103bc42-ea29-466e-9fa9-f35baf1cfea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:38.989855 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103bc42-ea29-466e-9fa9-f35baf1cfea9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:38.991223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103bc42-ea29-466e-9fa9-f35baf1cfea9 None admin] RBAC: Adding query filter params (group.id=eca5bad56e68442b90b6ef30229e2dad, role.id=897bff7604d1492993a708763e54e6d8, scope.project.id=cfef4a17bab2408d8ab3549e927bff2d) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:38.993441 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103bc42-ea29-466e-9fa9-f35baf1cfea9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:38.996731 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103bc42-ea29-466e-9fa9-f35baf1cfea9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:39.012085 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 181/358] 10.222.0.26 () {56 vars in 1376 bytes} [Sun Sep 11 08:25:38 2022] GET /identity/v3/role_assignments?group.id=eca5bad56e68442b90b6ef30229e2dad&scope.project.id=cfef4a17bab2408d8ab3549e927bff2d&role.id=897bff7604d1492993a708763e54e6d8 => generated 260 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:39.013917 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103bc42-ea29-466e-9fa9-f35baf1cfea9 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:39.041124 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524667a4-2fbb-4176-983f-57e1e4acad89 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:39.126856 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b2dc0-29d1-466a-bbd5-95b52e73425b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:39.128532 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b2dc0-29d1-466a-bbd5-95b52e73425b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:39.129347 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b2dc0-29d1-466a-bbd5-95b52e73425b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:39.130060 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b2dc0-29d1-466a-bbd5-95b52e73425b None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:39.131980 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b2dc0-29d1-466a-bbd5-95b52e73425b None admin] RBAC: Adding query filter params (name=member) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:39.132918 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b2dc0-29d1-466a-bbd5-95b52e73425b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:39.137456 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b2dc0-29d1-466a-bbd5-95b52e73425b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:39.156317 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 178/359] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Sep 11 08:25:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:39.160498 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8c645-70d1-4b2a-b092-60d9c73118de None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:39.161600 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8c645-70d1-4b2a-b092-60d9c73118de None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:39.162328 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8c645-70d1-4b2a-b092-60d9c73118de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:39.186691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103bc42-ea29-466e-9fa9-f35baf1cfea9 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:39.192575 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-33a8c645-70d1-4b2a-b092-60d9c73118de None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:39.194890 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-33a8c645-70d1-4b2a-b092-60d9c73118de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:39.250705 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df133d-f9f1-4204-a600-ec52ce629a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:39.251853 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df133d-f9f1-4204-a600-ec52ce629a6e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:39.252153 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df133d-f9f1-4204-a600-ec52ce629a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:39.252435 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df133d-f9f1-4204-a600-ec52ce629a6e None admin] PATH_INFO: `/v3/groups/eca5bad56e68442b90b6ef30229e2dad` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:39.254104 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df133d-f9f1-4204-a600-ec52ce629a6e None admin] RBAC: Authorizing `identity:get_group(group_id=eca5bad56e68442b90b6ef30229e2dad)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:39.256570 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df133d-f9f1-4204-a600-ec52ce629a6e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:39.257893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 182/360] 10.222.0.26 () {56 vars in 1180 bytes} [Sun Sep 11 08:25:39 2022] GET /identity/v3/groups/eca5bad56e68442b90b6ef30229e2dad => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:39.259818 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac7ac6-599c-439b-b467-95a69e22ef27 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:39.259818 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac7ac6-599c-439b-b467-95a69e22ef27 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:39.260139 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac7ac6-599c-439b-b467-95a69e22ef27 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:39.261683 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 183/361] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:39.262402 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac7ac6-599c-439b-b467-95a69e22ef27 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:39.346123 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:39.350201 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 179/362] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:25:39.353380 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2a5da-d19d-454e-8080-5dbc98f798c4 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:39.353939 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2a5da-d19d-454e-8080-5dbc98f798c4 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:39.354761 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2a5da-d19d-454e-8080-5dbc98f798c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:39.392501 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-dec2a5da-d19d-454e-8080-5dbc98f798c4 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:39.394755 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-dec2a5da-d19d-454e-8080-5dbc98f798c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:39.484265 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:39.486082 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac7ac6-599c-439b-b467-95a69e22ef27 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:39.526590 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f1a9c-877f-490a-9475-919bb3aa711d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:39.527147 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f1a9c-877f-490a-9475-919bb3aa711d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:39.527472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f1a9c-877f-490a-9475-919bb3aa711d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:39.527749 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f1a9c-877f-490a-9475-919bb3aa711d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:39.563959 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 180/363] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:25:39.566111 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2a5da-d19d-454e-8080-5dbc98f798c4 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:39.609648 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0f1a9c-877f-490a-9475-919bb3aa711d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:39.611190 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0f1a9c-877f-490a-9475-919bb3aa711d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:39.641239 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:39.725700 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 184/364] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:25:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 08:25:39.734153 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f1a9c-877f-490a-9475-919bb3aa711d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:39.842284 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2a5da-d19d-454e-8080-5dbc98f798c4 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:39.864530 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f1a9c-877f-490a-9475-919bb3aa711d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:39.907510 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b26d68-7c43-4d77-a4e9-af7a9825178d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:39.908399 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b26d68-7c43-4d77-a4e9-af7a9825178d None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:39.908806 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b26d68-7c43-4d77-a4e9-af7a9825178d None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:39.909366 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b26d68-7c43-4d77-a4e9-af7a9825178d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:39.910282 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b26d68-7c43-4d77-a4e9-af7a9825178d None admin] RBAC: Adding query filter params (group.id=eca5bad56e68442b90b6ef30229e2dad, role.id=3cecaf09e54b4f479cd391db74c49831, scope.project.id=cfef4a17bab2408d8ab3549e927bff2d) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:39.910982 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:39.911840 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b26d68-7c43-4d77-a4e9-af7a9825178d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:39.914236 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b26d68-7c43-4d77-a4e9-af7a9825178d None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:39.923533 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 181/365] 10.222.0.26 () {56 vars in 1376 bytes} [Sun Sep 11 08:25:39 2022] GET /identity/v3/role_assignments?group.id=eca5bad56e68442b90b6ef30229e2dad&scope.project.id=cfef4a17bab2408d8ab3549e927bff2d&role.id=3cecaf09e54b4f479cd391db74c49831 => generated 260 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:39.924256 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6c4ab-7846-44b3-beb3-d6ecf3a4f918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:39.927859 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b26d68-7c43-4d77-a4e9-af7a9825178d None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:39.927987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6c4ab-7846-44b3-beb3-d6ecf3a4f918 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:39.927987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6c4ab-7846-44b3-beb3-d6ecf3a4f918 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:39.927987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6c4ab-7846-44b3-beb3-d6ecf3a4f918 None admin] PATH_INFO: `/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:39.927987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6c4ab-7846-44b3-beb3-d6ecf3a4f918 None admin] RBAC: Authorizing `identity:get_project(project_id=16bd6bbfd5774162b2c2103efb3a6d76)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:39.930659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6c4ab-7846-44b3-beb3-d6ecf3a4f918 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:39.933332 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 185/366] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:25:39 2022] GET /identity/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:25:39.944831 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6c4ab-7846-44b3-beb3-d6ecf3a4f918 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:40.012408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:40.097258 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6c4ab-7846-44b3-beb3-d6ecf3a4f918 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:40.136675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042aa288-c8dc-4b7c-b47e-54b9e9edb0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:40.137590 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042aa288-c8dc-4b7c-b47e-54b9e9edb0b7 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:40.138015 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042aa288-c8dc-4b7c-b47e-54b9e9edb0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:40.138694 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042aa288-c8dc-4b7c-b47e-54b9e9edb0b7 None admin] PATH_INFO: `/v3/groups/eca5bad56e68442b90b6ef30229e2dad` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:40.141195 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042aa288-c8dc-4b7c-b47e-54b9e9edb0b7 None admin] RBAC: Authorizing `identity:get_group(group_id=eca5bad56e68442b90b6ef30229e2dad)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:40.142962 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042aa288-c8dc-4b7c-b47e-54b9e9edb0b7 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:40.144937 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 186/367] 10.222.0.26 () {56 vars in 1180 bytes} [Sun Sep 11 08:25:39 2022] GET /identity/v3/groups/eca5bad56e68442b90b6ef30229e2dad => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:40.145980 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042aa288-c8dc-4b7c-b47e-54b9e9edb0b7 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:40.208673 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b26d68-7c43-4d77-a4e9-af7a9825178d None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:40.267809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:40.273362 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd658b35-a089-48a7-b644-367f40d61011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:40.274034 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd658b35-a089-48a7-b644-367f40d61011 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:40.274310 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd658b35-a089-48a7-b644-367f40d61011 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:40.274581 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd658b35-a089-48a7-b644-367f40d61011 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:40.305590 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd658b35-a089-48a7-b644-367f40d61011 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:40.324546 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-bd658b35-a089-48a7-b644-367f40d61011 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 08:25:40.324546 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:40.324546 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:40.324546 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:40.324546 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:40.324546 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:40.324546 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:40.324546 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:40.324546 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:40.324546 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:40.324546 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:40.324546 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:40.324546 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:40.324546 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:40.324546 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:40.324546 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:40.326278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:40.326278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:40.326278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:40.326278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:40.326278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:40.326278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:40.326278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:40.326278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:40.326278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:40.326278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:40.326278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:40.326278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:40.326278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:40.326278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:40.326278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:40.326278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:40.330455 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:40.330455 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:40.330455 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:40.330455 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:40.330455 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:40.330455 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:40.330455 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:40.330455 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:40.330455 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:40.330455 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:40.330455 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 08:25:40.330455 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:25:40.330455 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 182/368] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Sep 11 08:25:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:25:40.330455 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd658b35-a089-48a7-b644-367f40d61011 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:40.338816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042aa288-c8dc-4b7c-b47e-54b9e9edb0b7 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:40.391115 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c38d5-08f9-4928-a003-fceea23a11d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:40.392667 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c38d5-08f9-4928-a003-fceea23a11d3 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:40.393600 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c38d5-08f9-4928-a003-fceea23a11d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:40.394344 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c38d5-08f9-4928-a003-fceea23a11d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:40.426497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c38d5-08f9-4928-a003-fceea23a11d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:40.438608 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-6f2c38d5-08f9-4928-a003-fceea23a11d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:25:40.438608 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:40.438608 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:40.438608 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:40.438608 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:40.438608 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:40.438608 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:40.438608 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:40.438608 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:40.438608 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:40.438608 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:40.438608 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:40.438608 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:40.438608 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:40.438608 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:40.438608 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:40.440333 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:40.440333 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:40.440333 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:40.440333 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:40.440333 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:40.440333 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:40.440333 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:40.440333 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:40.440333 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:40.440333 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:40.440333 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:40.440333 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:40.440333 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:40.440333 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:40.440333 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:40.440333 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:40.441897 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:40.441897 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:40.441897 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:40.441897 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:40.441897 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:40.441897 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:40.441897 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:40.441897 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:40.441897 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:40.441897 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:40.441897 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:25:40.441897 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:25:40.446952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 187/369] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:25:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:25:40.448819 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c38d5-08f9-4928-a003-fceea23a11d3 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:40.537535 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:40.553006 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd658b35-a089-48a7-b644-367f40d61011 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:40.612631 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d4e5a-9468-41e3-a754-9e568bdb76e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:40.613320 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d4e5a-9468-41e3-a754-9e568bdb76e2 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:40.613604 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d4e5a-9468-41e3-a754-9e568bdb76e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:40.613881 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d4e5a-9468-41e3-a754-9e568bdb76e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:40.615022 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d4e5a-9468-41e3-a754-9e568bdb76e2 None admin] RBAC: Adding query filter params (group.id=eca5bad56e68442b90b6ef30229e2dad, role.id=3cecaf09e54b4f479cd391db74c49831, scope.project.id=16bd6bbfd5774162b2c2103efb3a6d76) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:40.615369 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d4e5a-9468-41e3-a754-9e568bdb76e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:40.616871 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d4e5a-9468-41e3-a754-9e568bdb76e2 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:40.625128 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 183/370] 10.222.0.26 () {56 vars in 1376 bytes} [Sun Sep 11 08:25:40 2022] GET /identity/v3/role_assignments?group.id=eca5bad56e68442b90b6ef30229e2dad&scope.project.id=16bd6bbfd5774162b2c2103efb3a6d76&role.id=3cecaf09e54b4f479cd391db74c49831 => generated 260 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:40.627411 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d4e5a-9468-41e3-a754-9e568bdb76e2 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:40.681099 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c38d5-08f9-4928-a003-fceea23a11d3 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:40.737792 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:40.780828 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42ef23-f550-4116-8cb2-1447277d988a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:40.781725 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42ef23-f550-4116-8cb2-1447277d988a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:40.782169 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42ef23-f550-4116-8cb2-1447277d988a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:40.782453 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42ef23-f550-4116-8cb2-1447277d988a None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:40.783212 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42ef23-f550-4116-8cb2-1447277d988a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:40.783597 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42ef23-f550-4116-8cb2-1447277d988a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:40.785831 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42ef23-f550-4116-8cb2-1447277d988a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:40.820738 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 188/371] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:25:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:40.834428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42ef23-f550-4116-8cb2-1447277d988a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:40.900014 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d4e5a-9468-41e3-a754-9e568bdb76e2 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:40.984014 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c295337-ee53-414a-b9d2-4ad5927d1273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:40.984651 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c295337-ee53-414a-b9d2-4ad5927d1273 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:40.984933 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c295337-ee53-414a-b9d2-4ad5927d1273 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:40.985206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c295337-ee53-414a-b9d2-4ad5927d1273 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:40.985894 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c295337-ee53-414a-b9d2-4ad5927d1273 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:40.986202 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c295337-ee53-414a-b9d2-4ad5927d1273 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:40.987660 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c295337-ee53-414a-b9d2-4ad5927d1273 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:40.999855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 184/372] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:25:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:41.006022 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c295337-ee53-414a-b9d2-4ad5927d1273 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:41.045742 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42ef23-f550-4116-8cb2-1447277d988a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:41.049430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:41.091313 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25995af2-fc88-4fc4-9255-6a6feff9f927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:41.091962 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25995af2-fc88-4fc4-9255-6a6feff9f927 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:41.092246 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25995af2-fc88-4fc4-9255-6a6feff9f927 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:41.092525 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25995af2-fc88-4fc4-9255-6a6feff9f927 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:41.160680 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:41.202332 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25995af2-fc88-4fc4-9255-6a6feff9f927 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:41.206433 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25995af2-fc88-4fc4-9255-6a6feff9f927 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:41.247923 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c295337-ee53-414a-b9d2-4ad5927d1273 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:41.400461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b85ba8-0797-4354-8b84-320b702cc6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:41.401110 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b85ba8-0797-4354-8b84-320b702cc6f4 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:41.401431 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b85ba8-0797-4354-8b84-320b702cc6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:41.401681 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b85ba8-0797-4354-8b84-320b702cc6f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:41.478338 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 189/373] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:25:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 08:25:41.484964 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25995af2-fc88-4fc4-9255-6a6feff9f927 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:41.596386 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b85ba8-0797-4354-8b84-320b702cc6f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:41.597799 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b85ba8-0797-4354-8b84-320b702cc6f4 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:41.649178 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:41.664714 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:41.704404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25995af2-fc88-4fc4-9255-6a6feff9f927 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:41.782446 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 185/374] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:25:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 777 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 08:25:41.789001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b85ba8-0797-4354-8b84-320b702cc6f4 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:41.802075 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba639b0b-1976-43ae-822f-d6ed8d016c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:41.803143 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba639b0b-1976-43ae-822f-d6ed8d016c92 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:41.803719 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba639b0b-1976-43ae-822f-d6ed8d016c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:41.804207 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba639b0b-1976-43ae-822f-d6ed8d016c92 None admin] PATH_INFO: `/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:41.807017 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba639b0b-1976-43ae-822f-d6ed8d016c92 None admin] RBAC: Authorizing `identity:get_project(project_id=16bd6bbfd5774162b2c2103efb3a6d76)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:41.809824 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba639b0b-1976-43ae-822f-d6ed8d016c92 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:41.818630 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 190/375] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:25:41 2022] GET /identity/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76 => generated 302 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:41.824846 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba639b0b-1976-43ae-822f-d6ed8d016c92 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:41.918753 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b85ba8-0797-4354-8b84-320b702cc6f4 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:41.946173 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:41.965511 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159192b-b127-41c2-a79e-c1faa6ad4031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:41.966224 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159192b-b127-41c2-a79e-c1faa6ad4031 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:41.966514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159192b-b127-41c2-a79e-c1faa6ad4031 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:41.966790 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159192b-b127-41c2-a79e-c1faa6ad4031 None admin] PATH_INFO: `/v3/projects/10a12f84e22947cf95a2bfc7124d42aa` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:41.968089 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3159192b-b127-41c2-a79e-c1faa6ad4031 None admin] RBAC: Authorizing `identity:get_project(project_id=10a12f84e22947cf95a2bfc7124d42aa)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:41.969731 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3159192b-b127-41c2-a79e-c1faa6ad4031 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:41.971946 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 186/376] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:25:41 2022] GET /identity/v3/projects/10a12f84e22947cf95a2bfc7124d42aa => generated 344 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:41.979064 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159192b-b127-41c2-a79e-c1faa6ad4031 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:42.133911 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba639b0b-1976-43ae-822f-d6ed8d016c92 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:42.165038 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159192b-b127-41c2-a79e-c1faa6ad4031 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:42.209036 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326479f-056b-4efe-9d54-6b2b3280f7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:42.209935 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326479f-056b-4efe-9d54-6b2b3280f7bb None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:42.210360 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326479f-056b-4efe-9d54-6b2b3280f7bb None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:42.210812 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326479f-056b-4efe-9d54-6b2b3280f7bb None admin] PATH_INFO: `/v3/groups/f8fb3288700b48d0adc530e3a140b31b` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:42.217074 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c326479f-056b-4efe-9d54-6b2b3280f7bb None admin] RBAC: Authorizing `identity:get_group(group_id=f8fb3288700b48d0adc530e3a140b31b)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:42.218794 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c326479f-056b-4efe-9d54-6b2b3280f7bb None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:42.221167 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 187/377] 10.222.0.26 () {56 vars in 1180 bytes} [Sun Sep 11 08:25:41 2022] GET /identity/v3/groups/f8fb3288700b48d0adc530e3a140b31b => generated 229 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:25:42.230410 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326479f-056b-4efe-9d54-6b2b3280f7bb None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:42.232726 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a71a80-bb32-4be5-a743-b7ef5c002bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:42.233615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a71a80-bb32-4be5-a743-b7ef5c002bed None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:42.234084 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a71a80-bb32-4be5-a743-b7ef5c002bed None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:42.234506 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a71a80-bb32-4be5-a743-b7ef5c002bed None admin] PATH_INFO: `/v3/groups/eca5bad56e68442b90b6ef30229e2dad` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:42.236014 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a71a80-bb32-4be5-a743-b7ef5c002bed None admin] RBAC: Authorizing `identity:get_group(group_id=eca5bad56e68442b90b6ef30229e2dad)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:42.237670 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a71a80-bb32-4be5-a743-b7ef5c002bed None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:42.239872 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 191/378] 10.222.0.26 () {56 vars in 1180 bytes} [Sun Sep 11 08:25:41 2022] GET /identity/v3/groups/eca5bad56e68442b90b6ef30229e2dad => generated 226 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:25:42.247602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a71a80-bb32-4be5-a743-b7ef5c002bed None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:42.294987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:42.346633 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:42.453051 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326479f-056b-4efe-9d54-6b2b3280f7bb None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:42.481481 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a71a80-bb32-4be5-a743-b7ef5c002bed None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:42.506104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78386833-7060-4530-8cdb-72ca10bfb5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:42.507037 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78386833-7060-4530-8cdb-72ca10bfb5cd None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:42.507561 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78386833-7060-4530-8cdb-72ca10bfb5cd None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:42.508548 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78386833-7060-4530-8cdb-72ca10bfb5cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:42.509637 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78386833-7060-4530-8cdb-72ca10bfb5cd None admin] RBAC: Adding query filter params (group.id=f8fb3288700b48d0adc530e3a140b31b, role.id=d12af9f1dfb344cd8a6a493e165030ba, scope.project.id=10a12f84e22947cf95a2bfc7124d42aa) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:42.510141 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78386833-7060-4530-8cdb-72ca10bfb5cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:42.512083 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78386833-7060-4530-8cdb-72ca10bfb5cd None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:42.522008 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 188/379] 10.222.0.26 () {56 vars in 1376 bytes} [Sun Sep 11 08:25:42 2022] GET /identity/v3/role_assignments?group.id=f8fb3288700b48d0adc530e3a140b31b&scope.project.id=10a12f84e22947cf95a2bfc7124d42aa&role.id=d12af9f1dfb344cd8a6a493e165030ba => generated 260 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:42.542835 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e90be5-f41b-4ade-a06f-7af693cbfdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:42.543495 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e90be5-f41b-4ade-a06f-7af693cbfdbe None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:42.543783 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e90be5-f41b-4ade-a06f-7af693cbfdbe None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:42.544061 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e90be5-f41b-4ade-a06f-7af693cbfdbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:42.544823 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e90be5-f41b-4ade-a06f-7af693cbfdbe None admin] RBAC: Adding query filter params (group.id=eca5bad56e68442b90b6ef30229e2dad, role.id=897bff7604d1492993a708763e54e6d8, scope.project.id=16bd6bbfd5774162b2c2103efb3a6d76) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:42.545137 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e90be5-f41b-4ade-a06f-7af693cbfdbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:42.546687 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e90be5-f41b-4ade-a06f-7af693cbfdbe None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:42.559718 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 192/380] 10.222.0.26 () {56 vars in 1376 bytes} [Sun Sep 11 08:25:42 2022] GET /identity/v3/role_assignments?group.id=eca5bad56e68442b90b6ef30229e2dad&scope.project.id=16bd6bbfd5774162b2c2103efb3a6d76&role.id=897bff7604d1492993a708763e54e6d8 => generated 260 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:25:42.599315 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b564e9-02cf-4cb5-a8be-248c2f60333a None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:42.600278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b564e9-02cf-4cb5-a8be-248c2f60333a None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:42.600803 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b564e9-02cf-4cb5-a8be-248c2f60333a None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:42.603090 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 189/381] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:42.610332 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f74c36-6e5f-44fd-84ec-44a69da702e7 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:42.610679 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f74c36-6e5f-44fd-84ec-44a69da702e7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:42.610947 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f74c36-6e5f-44fd-84ec-44a69da702e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:42.648420 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-86f74c36-6e5f-44fd-84ec-44a69da702e7 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:42.650008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-86f74c36-6e5f-44fd-84ec-44a69da702e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:42.796275 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 193/382] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:25:43.471477 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b564e9-02cf-4cb5-a8be-248c2f60333a None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:43.740840 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b564e9-02cf-4cb5-a8be-248c2f60333a None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:43.792517 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:43.837992 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695d207-c9bd-447d-a4be-895a61dbeeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:43.839039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695d207-c9bd-447d-a4be-895a61dbeeaa None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:43.839545 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695d207-c9bd-447d-a4be-895a61dbeeaa None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:43.840012 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695d207-c9bd-447d-a4be-895a61dbeeaa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:43.873081 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695d207-c9bd-447d-a4be-895a61dbeeaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:43.884532 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-5695d207-c9bd-447d-a4be-895a61dbeeaa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 08:25:43.884532 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:43.884532 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:43.884532 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:43.884532 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:43.884532 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:43.884532 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:43.884532 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:43.884532 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:43.884532 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:43.884532 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:43.884532 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:43.884532 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:43.884532 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:43.884532 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:43.884532 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:43.886368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:43.886368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:43.886368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:43.886368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:43.886368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:43.886368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:43.886368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:43.886368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:43.886368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:43.886368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:43.886368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:43.886368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:43.886368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:43.886368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:43.886368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:43.886368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:43.888535 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:43.888535 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:43.888535 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:43.888535 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:43.888535 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:43.888535 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:43.888535 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:43.888535 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:43.888535 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:43.888535 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:43.888535 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 08:25:43.888535 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:25:43.888535 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 190/383] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Sep 11 08:25:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 417 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:25:43.893587 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f74c36-6e5f-44fd-84ec-44a69da702e7 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:43.933938 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:44.152250 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f74c36-6e5f-44fd-84ec-44a69da702e7 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:44.242554 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de53ace-a185-4d86-a569-268b81b0276e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:44.243608 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de53ace-a185-4d86-a569-268b81b0276e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:44.244064 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de53ace-a185-4d86-a569-268b81b0276e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:44.244534 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de53ace-a185-4d86-a569-268b81b0276e None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:44.245736 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de53ace-a185-4d86-a569-268b81b0276e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:44.246269 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de53ace-a185-4d86-a569-268b81b0276e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:44.248857 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de53ace-a185-4d86-a569-268b81b0276e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:44.271541 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 194/384] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:25:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:44.281089 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695d207-c9bd-447d-a4be-895a61dbeeaa None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:44.310895 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce749d1-6bf6-4ccd-a22f-fe652da401f7 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:44.311410 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce749d1-6bf6-4ccd-a22f-fe652da401f7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:44.311886 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce749d1-6bf6-4ccd-a22f-fe652da401f7 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:44.314374 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 195/385] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:44.320869 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1079c-793e-44f8-9cea-9744d610f25d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:44.321130 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1079c-793e-44f8-9cea-9744d610f25d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:44.321489 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1079c-793e-44f8-9cea-9744d610f25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:44.358149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-8de1079c-793e-44f8-9cea-9744d610f25d None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:44.361385 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8de1079c-793e-44f8-9cea-9744d610f25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:44.506185 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 196/386] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 08:25:44.520607 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695d207-c9bd-447d-a4be-895a61dbeeaa None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:44.574751 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9ff69-47c0-4366-9c3e-db4aacc6db58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:44.575478 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9ff69-47c0-4366-9c3e-db4aacc6db58 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:44.575762 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9ff69-47c0-4366-9c3e-db4aacc6db58 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:44.576036 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9ff69-47c0-4366-9c3e-db4aacc6db58 None admin] PATH_INFO: `/v3/groups/eca5bad56e68442b90b6ef30229e2dad` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:44.577348 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9ff69-47c0-4366-9c3e-db4aacc6db58 None admin] RBAC: Authorizing `identity:get_group(group_id=eca5bad56e68442b90b6ef30229e2dad)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:44.579126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9ff69-47c0-4366-9c3e-db4aacc6db58 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:44.581208 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 191/387] 10.222.0.26 () {56 vars in 1180 bytes} [Sun Sep 11 08:25:44 2022] GET /identity/v3/groups/eca5bad56e68442b90b6ef30229e2dad => generated 226 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:44.588223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1079c-793e-44f8-9cea-9744d610f25d None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:44.611416 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:44.848439 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1079c-793e-44f8-9cea-9744d610f25d None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:44.857329 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1705d6-0fc1-453b-99e5-cbc28573f308 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:44.858089 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1705d6-0fc1-453b-99e5-cbc28573f308 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:44.858089 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1705d6-0fc1-453b-99e5-cbc28573f308 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:44.859575 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 192/388] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:44.868066 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f2442-c28e-4334-9343-6506190bb26d None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:44.868551 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f2442-c28e-4334-9343-6506190bb26d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:44.868701 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f2442-c28e-4334-9343-6506190bb26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:44.904847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-973f2442-c28e-4334-9343-6506190bb26d None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:44.906772 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-973f2442-c28e-4334-9343-6506190bb26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:44.931723 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906ee49-0c10-46e4-b1f8-76f29516fd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:44.932797 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906ee49-0c10-46e4-b1f8-76f29516fd96 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:44.933274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906ee49-0c10-46e4-b1f8-76f29516fd96 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:44.933749 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906ee49-0c10-46e4-b1f8-76f29516fd96 None admin] PATH_INFO: `/v3/projects/cfef4a17bab2408d8ab3549e927bff2d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:44.939322 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7906ee49-0c10-46e4-b1f8-76f29516fd96 None admin] RBAC: Authorizing `identity:get_project(project_id=cfef4a17bab2408d8ab3549e927bff2d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:44.942022 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7906ee49-0c10-46e4-b1f8-76f29516fd96 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:44.948769 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 197/389] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:25:44 2022] GET /identity/v3/projects/cfef4a17bab2408d8ab3549e927bff2d => generated 298 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:25:44.956980 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906ee49-0c10-46e4-b1f8-76f29516fd96 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:44.995363 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:45.033908 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 193/390] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:25:45.099240 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:45.171033 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906ee49-0c10-46e4-b1f8-76f29516fd96 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:45.229417 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f2442-c28e-4334-9343-6506190bb26d None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:45.268489 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b5c73-ba72-4316-9c6a-6b125f2dc324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:45.269617 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b5c73-ba72-4316-9c6a-6b125f2dc324 None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:45.270089 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b5c73-ba72-4316-9c6a-6b125f2dc324 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:45.270582 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b5c73-ba72-4316-9c6a-6b125f2dc324 None admin] PATH_INFO: `/v3/projects/cfef4a17bab2408d8ab3549e927bff2d/groups/eca5bad56e68442b90b6ef30229e2dad/roles/897bff7604d1492993a708763e54e6d8` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:45.278353 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b5c73-ba72-4316-9c6a-6b125f2dc324 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfef4a17bab2408d8ab3549e927bff2d, group_id=eca5bad56e68442b90b6ef30229e2dad, role_id=897bff7604d1492993a708763e54e6d8)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:45.281058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b5c73-ba72-4316-9c6a-6b125f2dc324 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:45.393605 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 198/391] 10.222.0.26 () {58 vars in 1442 bytes} [Sun Sep 11 08:25:44 2022] PUT /identity/v3/projects/cfef4a17bab2408d8ab3549e927bff2d/groups/eca5bad56e68442b90b6ef30229e2dad/roles/897bff7604d1492993a708763e54e6d8 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:25:45.433887 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f2442-c28e-4334-9343-6506190bb26d None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:45.535941 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e5c64-6550-40d1-9550-17aba851373b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:45.537560 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e5c64-6550-40d1-9550-17aba851373b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:45.538355 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e5c64-6550-40d1-9550-17aba851373b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:45.539711 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e5c64-6550-40d1-9550-17aba851373b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:45.554992 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b5c73-ba72-4316-9c6a-6b125f2dc324 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:45.566309 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e5c64-6550-40d1-9550-17aba851373b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:45.576489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-114e5c64-6550-40d1-9550-17aba851373b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:25:45.576489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:45.576489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:45.576489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:45.576489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:45.576489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:45.576489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:45.576489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:45.576489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:45.576489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:45.576489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:45.576489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:45.576489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:45.576489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:45.576489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:45.576489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:45.578308 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:45.578308 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:45.578308 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:45.578308 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:45.578308 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:45.578308 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:45.578308 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:45.578308 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:45.578308 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:45.578308 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:45.578308 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:45.578308 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:45.578308 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:45.578308 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:45.578308 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:45.578308 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:45.580183 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:45.580183 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:45.580183 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:45.580183 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:45.580183 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:45.580183 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:45.580183 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:45.580183 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:45.580183 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:45.580183 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:45.580183 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:25:45.580183 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:25:45.580183 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 194/392] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:25:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:25:45.588189 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e5c64-6550-40d1-9550-17aba851373b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:45.668166 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:45.785355 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e5c64-6550-40d1-9550-17aba851373b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:45.832442 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b5c73-ba72-4316-9c6a-6b125f2dc324 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:45.876379 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517a58a-0f7c-41eb-acb3-16d6174201e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:45.877381 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517a58a-0f7c-41eb-acb3-16d6174201e3 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:45.877529 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517a58a-0f7c-41eb-acb3-16d6174201e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:45.877807 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517a58a-0f7c-41eb-acb3-16d6174201e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:45.878527 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5517a58a-0f7c-41eb-acb3-16d6174201e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:45.878839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5517a58a-0f7c-41eb-acb3-16d6174201e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:45.880337 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5517a58a-0f7c-41eb-acb3-16d6174201e3 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:45.907519 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 195/393] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Sep 11 08:25:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:25:45.915965 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517a58a-0f7c-41eb-acb3-16d6174201e3 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:45.921092 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57bb66c-30a9-4eab-80cc-ccb6ec29a5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:45.922523 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bb66c-30a9-4eab-80cc-ccb6ec29a5fd None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:45.923294 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bb66c-30a9-4eab-80cc-ccb6ec29a5fd None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:45.924039 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bb66c-30a9-4eab-80cc-ccb6ec29a5fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:45.929443 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:45.966677 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57bb66c-30a9-4eab-80cc-ccb6ec29a5fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:45.986144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-e57bb66c-30a9-4eab-80cc-ccb6ec29a5fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:25:45.986144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:45.986144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:45.986144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:45.986144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:45.986144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:45.986144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:45.986144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:45.986144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:45.986144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:45.986144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:45.986144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:45.986144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:45.986144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:45.986144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:45.986144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:45.987944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:45.987944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:45.987944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:45.987944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:45.987944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:45.987944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:45.987944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:45.987944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:45.987944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:45.987944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:45.987944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:45.987944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:45.987944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:45.987944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:45.987944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:45.987944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:45.989504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:45.989504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:45.989504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:45.989504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:45.989504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:45.989504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:45.989504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:45.989504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:45.989504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:45.989504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:45.989504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:25:45.989504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:25:45.995217 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 199/394] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:25:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 441 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:25:46.009978 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57bb66c-30a9-4eab-80cc-ccb6ec29a5fd None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:46.250292 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:46.260588 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517a58a-0f7c-41eb-acb3-16d6174201e3 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:46.284674 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57bb66c-30a9-4eab-80cc-ccb6ec29a5fd None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:46.312469 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1f13e-e084-45b3-806f-531a317860ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:46.313144 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1f13e-e084-45b3-806f-531a317860ae None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:46.313606 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1f13e-e084-45b3-806f-531a317860ae None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:46.313921 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1f13e-e084-45b3-806f-531a317860ae None admin] PATH_INFO: `/v3/groups/eca5bad56e68442b90b6ef30229e2dad` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:46.315195 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1f13e-e084-45b3-806f-531a317860ae None admin] RBAC: Authorizing `identity:get_group(group_id=eca5bad56e68442b90b6ef30229e2dad)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:46.316845 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1f13e-e084-45b3-806f-531a317860ae None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:46.319009 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 196/395] 10.222.0.26 () {56 vars in 1180 bytes} [Sun Sep 11 08:25:45 2022] GET /identity/v3/groups/eca5bad56e68442b90b6ef30229e2dad => generated 226 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:46.320423 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb9444-c03f-490e-9f1f-1b56ea56ce5f None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:46.320813 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb9444-c03f-490e-9f1f-1b56ea56ce5f None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:46.321101 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb9444-c03f-490e-9f1f-1b56ea56ce5f None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:46.326767 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 197/396] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:46.327918 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb9444-c03f-490e-9f1f-1b56ea56ce5f None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:46.359010 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8162c-1bf6-4502-af66-21e6340f2b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:46.360118 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8162c-1bf6-4502-af66-21e6340f2b41 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:46.360606 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8162c-1bf6-4502-af66-21e6340f2b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:46.361080 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8162c-1bf6-4502-af66-21e6340f2b41 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:46.362283 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8162c-1bf6-4502-af66-21e6340f2b41 None admin] RBAC: Adding query filter params (name=member) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:46.362814 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8162c-1bf6-4502-af66-21e6340f2b41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:46.365416 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8162c-1bf6-4502-af66-21e6340f2b41 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:46.380818 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 200/397] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Sep 11 08:25:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:25:46.382867 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b0b8f-c752-4b7e-b373-0ab96194f317 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:46.383365 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b0b8f-c752-4b7e-b373-0ab96194f317 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:46.383840 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b0b8f-c752-4b7e-b373-0ab96194f317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:46.414490 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-3f4b0b8f-c752-4b7e-b373-0ab96194f317 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:46.416465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3f4b0b8f-c752-4b7e-b373-0ab96194f317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:46.470437 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb9444-c03f-490e-9f1f-1b56ea56ce5f None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:46.516676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:46.535011 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bba87e-9a60-443a-b3ee-5947e5bddbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:46.545000 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bba87e-9a60-443a-b3ee-5947e5bddbce None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:46.545000 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bba87e-9a60-443a-b3ee-5947e5bddbce None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:46.545000 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bba87e-9a60-443a-b3ee-5947e5bddbce None admin] PATH_INFO: `/v3/projects/cfef4a17bab2408d8ab3549e927bff2d` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:46.545000 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bba87e-9a60-443a-b3ee-5947e5bddbce None admin] RBAC: Authorizing `identity:get_project(project_id=cfef4a17bab2408d8ab3549e927bff2d)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:46.545000 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bba87e-9a60-443a-b3ee-5947e5bddbce None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:46.557573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 198/398] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:25:46 2022] GET /identity/v3/projects/cfef4a17bab2408d8ab3549e927bff2d => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:46.557573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bba87e-9a60-443a-b3ee-5947e5bddbce None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:46.561994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 201/399] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:25:46.567488 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b0b8f-c752-4b7e-b373-0ab96194f317 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:46.653027 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:46.783630 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b0b8f-c752-4b7e-b373-0ab96194f317 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:46.849927 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ef1b2-d710-422d-a55c-5b77e05ca72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:46.852030 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ef1b2-d710-422d-a55c-5b77e05ca72f None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:46.852752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ef1b2-d710-422d-a55c-5b77e05ca72f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:46.853585 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ef1b2-d710-422d-a55c-5b77e05ca72f None admin] PATH_INFO: `/v3/projects/cfef4a17bab2408d8ab3549e927bff2d/groups/eca5bad56e68442b90b6ef30229e2dad/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:46.857668 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ef1b2-d710-422d-a55c-5b77e05ca72f None admin] RBAC: Authorizing `identity:create_grant(project_id=cfef4a17bab2408d8ab3549e927bff2d, group_id=eca5bad56e68442b90b6ef30229e2dad, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:46.860978 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ef1b2-d710-422d-a55c-5b77e05ca72f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:46.867554 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bba87e-9a60-443a-b3ee-5947e5bddbce None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:46.937547 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11864dbc-1771-482c-8d9b-ffdea0fea64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:46.939922 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11864dbc-1771-482c-8d9b-ffdea0fea64b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:46.940649 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11864dbc-1771-482c-8d9b-ffdea0fea64b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:46.941500 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11864dbc-1771-482c-8d9b-ffdea0fea64b None admin] PATH_INFO: `/v3/groups/eca5bad56e68442b90b6ef30229e2dad` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:46.942416 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 202/400] 10.222.0.26 () {58 vars in 1442 bytes} [Sun Sep 11 08:25:46 2022] PUT /identity/v3/projects/cfef4a17bab2408d8ab3549e927bff2d/groups/eca5bad56e68442b90b6ef30229e2dad/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:25:46.949165 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11864dbc-1771-482c-8d9b-ffdea0fea64b None admin] RBAC: Authorizing `identity:get_group(group_id=eca5bad56e68442b90b6ef30229e2dad)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:46.949445 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ef1b2-d710-422d-a55c-5b77e05ca72f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:46.952564 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11864dbc-1771-482c-8d9b-ffdea0fea64b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:46.956824 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 199/401] 10.222.0.26 () {56 vars in 1180 bytes} [Sun Sep 11 08:25:46 2022] GET /identity/v3/groups/eca5bad56e68442b90b6ef30229e2dad => generated 226 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:46.965261 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11864dbc-1771-482c-8d9b-ffdea0fea64b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:47.126288 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:47.174668 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:47.181887 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11864dbc-1771-482c-8d9b-ffdea0fea64b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:47.214925 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ef1b2-d710-422d-a55c-5b77e05ca72f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:47.260785 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c234574-1954-4888-9d5b-7d21fb295c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:47.261441 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c234574-1954-4888-9d5b-7d21fb295c16 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:47.261740 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c234574-1954-4888-9d5b-7d21fb295c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:47.262019 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c234574-1954-4888-9d5b-7d21fb295c16 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:47.272763 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d3211-e4fe-4716-a2b3-80773131f581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:47.275314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d3211-e4fe-4716-a2b3-80773131f581 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:47.275728 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c234574-1954-4888-9d5b-7d21fb295c16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:47.276387 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d3211-e4fe-4716-a2b3-80773131f581 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:47.277139 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d3211-e4fe-4716-a2b3-80773131f581 None admin] PATH_INFO: `/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:47.279647 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d3211-e4fe-4716-a2b3-80773131f581 None admin] RBAC: Authorizing `identity:get_project(project_id=16bd6bbfd5774162b2c2103efb3a6d76)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:47.280822 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-7c234574-1954-4888-9d5b-7d21fb295c16 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 08:25:47.280822 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:47.280822 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:47.280822 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:47.280822 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:47.280822 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:47.280822 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:47.280822 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:47.280822 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:47.280822 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:47.280822 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:47.280822 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:47.280822 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:47.280822 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:47.280822 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:47.280822 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:47.282552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:47.282552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:47.282552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:47.282552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:47.282552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:47.282552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:47.282552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:47.282552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:47.282552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:47.282552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:47.282552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:47.282552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:47.282552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:47.282552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:47.282552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:47.282552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:47.284230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:47.284230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:47.284230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:47.284230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:47.284230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:47.284230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:47.284230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:47.284230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:47.284230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:47.284230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:47.284230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 08:25:47.284230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:25:47.284230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 203/402] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Sep 11 08:25:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:25:47.284230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51167e6-4f3d-4da5-b2e2-43717594d6d9 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:47.287201 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51167e6-4f3d-4da5-b2e2-43717594d6d9 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:47.287201 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51167e6-4f3d-4da5-b2e2-43717594d6d9 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:47.289581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 204/403] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:47.290092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d3211-e4fe-4716-a2b3-80773131f581 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:47.291519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfa804-bc81-4037-8c5c-628573f3c55b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:47.291907 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfa804-bc81-4037-8c5c-628573f3c55b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:47.292245 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfa804-bc81-4037-8c5c-628573f3c55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:47.294813 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 200/404] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:25:46 2022] GET /identity/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76 => generated 302 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:47.296643 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d3211-e4fe-4716-a2b3-80773131f581 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:47.321801 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f3dfa804-bc81-4037-8c5c-628573f3c55b None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:47.323050 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f3dfa804-bc81-4037-8c5c-628573f3c55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:47.451834 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 205/405] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:25:47.454089 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfa804-bc81-4037-8c5c-628573f3c55b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:47.524946 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:47.525542 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d3211-e4fe-4716-a2b3-80773131f581 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:47.637398 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd236e-3139-4e23-b112-207451302b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:47.638461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd236e-3139-4e23-b112-207451302b61 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:47.638966 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd236e-3139-4e23-b112-207451302b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:47.639539 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd236e-3139-4e23-b112-207451302b61 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:47.640793 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd236e-3139-4e23-b112-207451302b61 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:47.641349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd236e-3139-4e23-b112-207451302b61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:47.644010 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd236e-3139-4e23-b112-207451302b61 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:47.655806 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfa804-bc81-4037-8c5c-628573f3c55b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:47.695805 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 201/406] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:25:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:47.706384 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c2d14-5684-4b6f-839a-8c949f0687d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:47.707438 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c2d14-5684-4b6f-839a-8c949f0687d4 None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:47.707927 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c2d14-5684-4b6f-839a-8c949f0687d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:47.708345 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd236e-3139-4e23-b112-207451302b61 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:47.708616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c2d14-5684-4b6f-839a-8c949f0687d4 None admin] PATH_INFO: `/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76/groups/eca5bad56e68442b90b6ef30229e2dad/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:47.710926 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c2d14-5684-4b6f-839a-8c949f0687d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=16bd6bbfd5774162b2c2103efb3a6d76, group_id=eca5bad56e68442b90b6ef30229e2dad, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:47.712683 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c2d14-5684-4b6f-839a-8c949f0687d4 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:47.754430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:47.807408 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 206/407] 10.222.0.26 () {58 vars in 1442 bytes} [Sun Sep 11 08:25:47 2022] PUT /identity/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76/groups/eca5bad56e68442b90b6ef30229e2dad/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:25:47.808675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c2d14-5684-4b6f-839a-8c949f0687d4 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:47.864844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd236e-3139-4e23-b112-207451302b61 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:48.004662 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d6fc7-2f96-4066-ba96-2e44c1c88343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:48.005778 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d6fc7-2f96-4066-ba96-2e44c1c88343 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:48.006293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d6fc7-2f96-4066-ba96-2e44c1c88343 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:48.006784 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d6fc7-2f96-4066-ba96-2e44c1c88343 None admin] PATH_INFO: `/v3/groups/eca5bad56e68442b90b6ef30229e2dad` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:48.012645 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d6fc7-2f96-4066-ba96-2e44c1c88343 None admin] RBAC: Authorizing `identity:get_group(group_id=eca5bad56e68442b90b6ef30229e2dad)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:48.015553 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d6fc7-2f96-4066-ba96-2e44c1c88343 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:48.018828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 202/408] 10.222.0.26 () {56 vars in 1180 bytes} [Sun Sep 11 08:25:47 2022] GET /identity/v3/groups/eca5bad56e68442b90b6ef30229e2dad => generated 226 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:48.028294 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d6fc7-2f96-4066-ba96-2e44c1c88343 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:48.068168 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:48.080989 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c2d14-5684-4b6f-839a-8c949f0687d4 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:48.162760 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d5b0e-01d7-4b71-b71d-19664203d91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:48.164939 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d5b0e-01d7-4b71-b71d-19664203d91d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:48.165425 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d5b0e-01d7-4b71-b71d-19664203d91d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:48.165909 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d5b0e-01d7-4b71-b71d-19664203d91d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:48.190206 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d5b0e-01d7-4b71-b71d-19664203d91d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:48.190398 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:48.199166 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d6fc7-2f96-4066-ba96-2e44c1c88343 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:48.204201 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-0e3d5b0e-01d7-4b71-b71d-19664203d91d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:25:48.204201 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:48.204201 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:48.204201 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:48.204201 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:48.204201 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:48.204201 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:48.204201 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:48.204201 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:48.204201 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:48.204201 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:48.204201 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:48.204201 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:48.204201 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:48.204201 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:48.204201 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:48.205133 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:48.205133 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:48.205133 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:48.205133 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:48.205133 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:48.205133 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:48.205133 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:48.205133 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:48.205133 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:48.205133 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:48.205133 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:48.205133 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:48.205133 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:48.205133 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:48.205133 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:48.205133 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:48.206078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:48.206078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:48.206078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:48.206078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:48.206078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:48.206078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:48.206078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:48.206078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:48.206078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:48.206078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:48.206078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:25:48.206078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:25:48.212291 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 207/409] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:25:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 404 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:25:48.221556 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d5b0e-01d7-4b71-b71d-19664203d91d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:48.272221 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7def6-fea8-420c-9029-5da20b3d175e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:48.273340 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7def6-fea8-420c-9029-5da20b3d175e None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:48.273794 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7def6-fea8-420c-9029-5da20b3d175e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:48.274261 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7def6-fea8-420c-9029-5da20b3d175e None admin] PATH_INFO: `/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:48.277651 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda7def6-fea8-420c-9029-5da20b3d175e None admin] RBAC: Authorizing `identity:get_project(project_id=16bd6bbfd5774162b2c2103efb3a6d76)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:48.279414 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda7def6-fea8-420c-9029-5da20b3d175e None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:48.283069 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 203/410] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:25:48 2022] GET /identity/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76 => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:48.295923 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7def6-fea8-420c-9029-5da20b3d175e None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:48.416863 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7def6-fea8-420c-9029-5da20b3d175e None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:48.464390 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d5b0e-01d7-4b71-b71d-19664203d91d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:48.467968 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f00a6-6525-4734-9a4b-31ee1a726f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:48.469568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f00a6-6525-4734-9a4b-31ee1a726f5c None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:48.475806 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f00a6-6525-4734-9a4b-31ee1a726f5c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:48.476666 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f00a6-6525-4734-9a4b-31ee1a726f5c None admin] PATH_INFO: `/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76/groups/eca5bad56e68442b90b6ef30229e2dad/roles/897bff7604d1492993a708763e54e6d8` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:48.484978 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f00a6-6525-4734-9a4b-31ee1a726f5c None admin] RBAC: Authorizing `identity:create_grant(project_id=16bd6bbfd5774162b2c2103efb3a6d76, group_id=eca5bad56e68442b90b6ef30229e2dad, role_id=897bff7604d1492993a708763e54e6d8)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:48.486560 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f00a6-6525-4734-9a4b-31ee1a726f5c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:48.549463 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d8fbc-9c83-42ad-9ffb-0a3268b7deb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:48.551172 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d8fbc-9c83-42ad-9ffb-0a3268b7deb0 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:48.552025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d8fbc-9c83-42ad-9ffb-0a3268b7deb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:48.558621 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d8fbc-9c83-42ad-9ffb-0a3268b7deb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:48.558621 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d8fbc-9c83-42ad-9ffb-0a3268b7deb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:48.558621 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d8fbc-9c83-42ad-9ffb-0a3268b7deb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:48.558621 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d8fbc-9c83-42ad-9ffb-0a3268b7deb0 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:48.577683 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 208/411] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:25:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:25:48.583711 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d8fbc-9c83-42ad-9ffb-0a3268b7deb0 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:48.607962 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 204/412] 10.222.0.26 () {58 vars in 1442 bytes} [Sun Sep 11 08:25:48 2022] PUT /identity/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76/groups/eca5bad56e68442b90b6ef30229e2dad/roles/897bff7604d1492993a708763e54e6d8 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:25:48.620567 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:48.729901 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83f725-0f08-46fb-8ddc-e3034b071cfd None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:48.730720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83f725-0f08-46fb-8ddc-e3034b071cfd None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:48.731206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83f725-0f08-46fb-8ddc-e3034b071cfd None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:48.734566 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 205/413] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:48.739983 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e4d5e-6d00-4ba9-beae-af6aa108dd0b None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:48.740722 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e4d5e-6d00-4ba9-beae-af6aa108dd0b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:48.741197 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e4d5e-6d00-4ba9-beae-af6aa108dd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:48.771762 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-726e4d5e-6d00-4ba9-beae-af6aa108dd0b None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:48.773051 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-726e4d5e-6d00-4ba9-beae-af6aa108dd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:48.807955 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:48.830077 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d8fbc-9c83-42ad-9ffb-0a3268b7deb0 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:48.899466 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 206/414] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 08:25:48.922629 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc806c1d-f03b-4237-ad26-8510063dbc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:48.923435 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc806c1d-f03b-4237-ad26-8510063dbc9c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:48.923718 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc806c1d-f03b-4237-ad26-8510063dbc9c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:48.924003 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc806c1d-f03b-4237-ad26-8510063dbc9c None admin] PATH_INFO: `/v3/groups/f8fb3288700b48d0adc530e3a140b31b` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:48.927527 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc806c1d-f03b-4237-ad26-8510063dbc9c None admin] RBAC: Authorizing `identity:get_group(group_id=f8fb3288700b48d0adc530e3a140b31b)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:48.931275 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc806c1d-f03b-4237-ad26-8510063dbc9c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:48.934028 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 209/415] 10.222.0.26 () {56 vars in 1180 bytes} [Sun Sep 11 08:25:48 2022] GET /identity/v3/groups/f8fb3288700b48d0adc530e3a140b31b => generated 229 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:48.941858 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e4d5e-6d00-4ba9-beae-af6aa108dd0b None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:49.187602 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e4d5e-6d00-4ba9-beae-af6aa108dd0b None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:49.201757 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc806c1d-f03b-4237-ad26-8510063dbc9c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:49.277095 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985dd542-0add-4864-b8e0-8ce8cb91e238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:49.279054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dd542-0add-4864-b8e0-8ce8cb91e238 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:49.279681 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dd542-0add-4864-b8e0-8ce8cb91e238 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:49.281916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dd542-0add-4864-b8e0-8ce8cb91e238 None admin] PATH_INFO: `/v3/projects/10a12f84e22947cf95a2bfc7124d42aa` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:49.284573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985dd542-0add-4864-b8e0-8ce8cb91e238 None admin] RBAC: Authorizing `identity:get_project(project_id=10a12f84e22947cf95a2bfc7124d42aa)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:49.290662 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985dd542-0add-4864-b8e0-8ce8cb91e238 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:49.301779 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 207/416] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:25:48 2022] GET /identity/v3/projects/10a12f84e22947cf95a2bfc7124d42aa => generated 344 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:49.333162 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985dd542-0add-4864-b8e0-8ce8cb91e238 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:49.425681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:49.430527 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:49.490874 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc806c1d-f03b-4237-ad26-8510063dbc9c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:49.560689 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985dd542-0add-4864-b8e0-8ce8cb91e238 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:49.603659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447a540-259a-47e1-91bb-1e94838867e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:49.604399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447a540-259a-47e1-91bb-1e94838867e4 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:49.604691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447a540-259a-47e1-91bb-1e94838867e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:49.604967 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447a540-259a-47e1-91bb-1e94838867e4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:49.607670 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee85e8d-ac2a-44b6-9161-d2c0d842e64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:49.608454 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee85e8d-ac2a-44b6-9161-d2c0d842e64f None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:49.608733 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee85e8d-ac2a-44b6-9161-d2c0d842e64f None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:49.609007 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee85e8d-ac2a-44b6-9161-d2c0d842e64f None admin] PATH_INFO: `/v3/projects/10a12f84e22947cf95a2bfc7124d42aa/groups/f8fb3288700b48d0adc530e3a140b31b/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:49.611922 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee85e8d-ac2a-44b6-9161-d2c0d842e64f None admin] RBAC: Authorizing `identity:create_grant(project_id=10a12f84e22947cf95a2bfc7124d42aa, group_id=f8fb3288700b48d0adc530e3a140b31b, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:49.613686 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee85e8d-ac2a-44b6-9161-d2c0d842e64f None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:49.631682 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9447a540-259a-47e1-91bb-1e94838867e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:49.637748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-9447a540-259a-47e1-91bb-1e94838867e4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 08:25:49.637748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:49.637748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:49.637748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:49.637748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:49.637748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:49.637748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:49.637748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:49.637748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:49.637748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:49.637748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:49.637748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:49.637748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:49.637748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:49.637748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:49.637748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:49.638695 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:49.638695 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:49.638695 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:49.638695 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:49.638695 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:49.638695 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:49.638695 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:49.638695 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:49.638695 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:49.638695 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:49.638695 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:49.638695 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:49.638695 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:49.638695 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:49.638695 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:49.638695 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:49.639532 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:49.639532 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:49.639532 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:49.639532 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:49.639532 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:49.639532 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:49.639532 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:49.639532 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:49.639532 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:49.639532 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:49.639532 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 08:25:49.639532 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:25:49.644067 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 210/417] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Sep 11 08:25:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 438 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:25:49.646937 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447a540-259a-47e1-91bb-1e94838867e4 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:49.697662 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 208/418] 10.222.0.26 () {58 vars in 1442 bytes} [Sun Sep 11 08:25:49 2022] PUT /identity/v3/projects/10a12f84e22947cf95a2bfc7124d42aa/groups/f8fb3288700b48d0adc530e3a140b31b/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:25:49.778487 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447a540-259a-47e1-91bb-1e94838867e4 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:49.822480 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc12cf-f7fd-4b64-908d-febb34b2b610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:49.823127 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc12cf-f7fd-4b64-908d-febb34b2b610 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:49.823445 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc12cf-f7fd-4b64-908d-febb34b2b610 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:49.823718 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc12cf-f7fd-4b64-908d-febb34b2b610 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:49.824418 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc12cf-f7fd-4b64-908d-febb34b2b610 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:49.824726 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc12cf-f7fd-4b64-908d-febb34b2b610 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:49.826275 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc12cf-f7fd-4b64-908d-febb34b2b610 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:49.837309 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 211/419] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:25:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:25:49.843492 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee85e8d-ac2a-44b6-9161-d2c0d842e64f None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:49.956375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:49.979276 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee85e8d-ac2a-44b6-9161-d2c0d842e64f None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:50.038248 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46690eee-d774-4218-8a7a-5e1015ba9c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:50.039409 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46690eee-d774-4218-8a7a-5e1015ba9c08 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:50.039692 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46690eee-d774-4218-8a7a-5e1015ba9c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:50.039965 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46690eee-d774-4218-8a7a-5e1015ba9c08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:50.131785 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46690eee-d774-4218-8a7a-5e1015ba9c08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:50.133343 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46690eee-d774-4218-8a7a-5e1015ba9c08 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:50.255692 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:50.276102 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 209/420] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:25:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 08:25:50.281606 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc12cf-f7fd-4b64-908d-febb34b2b610 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:50.299715 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:50.436393 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc12cf-f7fd-4b64-908d-febb34b2b610 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:50.466580 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c25ecb-3bb2-40e2-8597-80f96f41b52e None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:50.467239 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c25ecb-3bb2-40e2-8597-80f96f41b52e None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:50.467855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c25ecb-3bb2-40e2-8597-80f96f41b52e None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:50.469669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 210/421] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:50.475556 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857b382-4de8-43c2-94db-73db7f6ab35f None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:50.476176 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857b382-4de8-43c2-94db-73db7f6ab35f None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:50.476782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857b382-4de8-43c2-94db-73db7f6ab35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:50.486971 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e86a0a-abab-4335-bf8c-f1a4b6ebd927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:50.487661 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e86a0a-abab-4335-bf8c-f1a4b6ebd927 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:50.487941 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e86a0a-abab-4335-bf8c-f1a4b6ebd927 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:50.488216 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e86a0a-abab-4335-bf8c-f1a4b6ebd927 None admin] PATH_INFO: `/v3/projects/cfef4a17bab2408d8ab3549e927bff2d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:50.492145 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e86a0a-abab-4335-bf8c-f1a4b6ebd927 None admin] RBAC: Authorizing `identity:get_project(project_id=cfef4a17bab2408d8ab3549e927bff2d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:50.493669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e86a0a-abab-4335-bf8c-f1a4b6ebd927 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:50.495721 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 212/422] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:25:50 2022] GET /identity/v3/projects/cfef4a17bab2408d8ab3549e927bff2d => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:50.499342 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-b857b382-4de8-43c2-94db-73db7f6ab35f None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:50.500839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b857b382-4de8-43c2-94db-73db7f6ab35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:50.501155 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e86a0a-abab-4335-bf8c-f1a4b6ebd927 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:50.605570 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 211/423] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:25:50.634555 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:50.676112 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e86a0a-abab-4335-bf8c-f1a4b6ebd927 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:50.729545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb1d3a-c26d-4c77-a923-c90936b275b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:50.730596 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb1d3a-c26d-4c77-a923-c90936b275b5 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:50.731092 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb1d3a-c26d-4c77-a923-c90936b275b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:50.731796 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb1d3a-c26d-4c77-a923-c90936b275b5 None admin] PATH_INFO: `/v3/groups/eca5bad56e68442b90b6ef30229e2dad` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:50.733748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb1d3a-c26d-4c77-a923-c90936b275b5 None admin] RBAC: Authorizing `identity:get_group(group_id=eca5bad56e68442b90b6ef30229e2dad)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:50.736344 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb1d3a-c26d-4c77-a923-c90936b275b5 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:50.739662 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 213/424] 10.222.0.26 () {56 vars in 1180 bytes} [Sun Sep 11 08:25:50 2022] GET /identity/v3/groups/eca5bad56e68442b90b6ef30229e2dad => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:25:50.748468 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857b382-4de8-43c2-94db-73db7f6ab35f None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:50.894300 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857b382-4de8-43c2-94db-73db7f6ab35f None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:50.920718 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:50.948584 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9518c-dbe4-4ff4-ae3b-686f01811bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:50.949220 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9518c-dbe4-4ff4-ae3b-686f01811bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:50.949500 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9518c-dbe4-4ff4-ae3b-686f01811bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:50.949778 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9518c-dbe4-4ff4-ae3b-686f01811bb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:50.950966 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c9518c-dbe4-4ff4-ae3b-686f01811bb6 None admin] RBAC: Adding query filter params (group.id=eca5bad56e68442b90b6ef30229e2dad, role.id=897bff7604d1492993a708763e54e6d8, scope.project.id=cfef4a17bab2408d8ab3549e927bff2d) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:50.951319 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c9518c-dbe4-4ff4-ae3b-686f01811bb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:50.951779 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb1d3a-c26d-4c77-a923-c90936b275b5 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:50.952964 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c9518c-dbe4-4ff4-ae3b-686f01811bb6 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:50.973343 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 212/425] 10.222.0.26 () {56 vars in 1376 bytes} [Sun Sep 11 08:25:50 2022] GET /identity/v3/role_assignments?group.id=eca5bad56e68442b90b6ef30229e2dad&scope.project.id=cfef4a17bab2408d8ab3549e927bff2d&role.id=897bff7604d1492993a708763e54e6d8 => generated 611 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:51.193577 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb1d3a-c26d-4c77-a923-c90936b275b5 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:51.262179 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52488a9f-48e9-4ffd-9197-877d27538ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:51.262830 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52488a9f-48e9-4ffd-9197-877d27538ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:51.263115 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52488a9f-48e9-4ffd-9197-877d27538ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:51.263446 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52488a9f-48e9-4ffd-9197-877d27538ff0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:51.276027 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52488a9f-48e9-4ffd-9197-877d27538ff0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:51.281620 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-52488a9f-48e9-4ffd-9197-877d27538ff0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:25:51.281620 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:51.281620 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:51.281620 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:51.281620 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:51.281620 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:51.281620 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:51.281620 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:51.281620 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:51.281620 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:51.281620 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:51.281620 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:51.281620 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:51.281620 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:51.281620 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:51.281620 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:51.284056 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:51.284056 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:51.284056 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:51.284056 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:51.284056 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:51.284056 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:51.284056 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:51.284056 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:51.284056 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:51.284056 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:51.284056 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:51.284056 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:51.284056 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:51.284056 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:51.284056 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:51.284056 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:51.285606 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:51.285606 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:51.285606 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:51.285606 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:51.285606 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:51.285606 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:51.285606 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:51.285606 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:51.285606 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:51.285606 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:51.285606 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:25:51.285606 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:25:51.285606 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 214/426] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:25:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:25:51.297307 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9518c-dbe4-4ff4-ae3b-686f01811bb6 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:51.493454 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9518c-dbe4-4ff4-ae3b-686f01811bb6 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:51.532256 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab64b4-f09f-48da-9b44-1c7bd76eef37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:51.532936 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab64b4-f09f-48da-9b44-1c7bd76eef37 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:51.533177 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab64b4-f09f-48da-9b44-1c7bd76eef37 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:51.533441 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab64b4-f09f-48da-9b44-1c7bd76eef37 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:51.534122 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab64b4-f09f-48da-9b44-1c7bd76eef37 None admin] RBAC: Adding query filter params (name=member) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:51.534441 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab64b4-f09f-48da-9b44-1c7bd76eef37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:51.535929 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab64b4-f09f-48da-9b44-1c7bd76eef37 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:51.546836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79925e-80ff-46b8-aa1f-9d43887fb6e0 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:51.547222 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79925e-80ff-46b8-aa1f-9d43887fb6e0 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:51.547498 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79925e-80ff-46b8-aa1f-9d43887fb6e0 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:51.549004 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 215/427] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:51.549294 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 213/428] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Sep 11 08:25:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:51.559307 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79925e-80ff-46b8-aa1f-9d43887fb6e0 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:51.561214 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362de88-cd32-48f0-a059-7214517872b0 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:51.561486 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362de88-cd32-48f0-a059-7214517872b0 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:51.561757 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362de88-cd32-48f0-a059-7214517872b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:51.571673 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:51.584251 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-d362de88-cd32-48f0-a059-7214517872b0 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:51.585789 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d362de88-cd32-48f0-a059-7214517872b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:51.628475 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:51.688045 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 214/429] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:25:51.725218 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5aa7d-aa0d-49df-88e0-e4f684c8a5b9 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:51.725687 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5aa7d-aa0d-49df-88e0-e4f684c8a5b9 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:51.726678 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5aa7d-aa0d-49df-88e0-e4f684c8a5b9 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:51.730990 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 215/430] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:51.736502 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb15d1-710e-4ecb-961d-4512fb3311c6 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:51.736789 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb15d1-710e-4ecb-961d-4512fb3311c6 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:51.737229 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb15d1-710e-4ecb-961d-4512fb3311c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:51.758620 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-bacb15d1-710e-4ecb-961d-4512fb3311c6 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:51.760101 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-bacb15d1-710e-4ecb-961d-4512fb3311c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:51.765733 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79925e-80ff-46b8-aa1f-9d43887fb6e0 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:51.822779 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd9518-f323-4988-82ef-1c7a9f9a6767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:51.823487 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd9518-f323-4988-82ef-1c7a9f9a6767 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:51.823776 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd9518-f323-4988-82ef-1c7a9f9a6767 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:51.824055 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd9518-f323-4988-82ef-1c7a9f9a6767 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:51.847437 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 216/431] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 08:25:51.922476 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd9518-f323-4988-82ef-1c7a9f9a6767 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:51.924022 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd9518-f323-4988-82ef-1c7a9f9a6767 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:51.927176 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:52.014085 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb15d1-710e-4ecb-961d-4512fb3311c6 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:52.048888 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 216/432] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:25:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 08:25:52.057881 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd9518-f323-4988-82ef-1c7a9f9a6767 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:52.171503 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd9518-f323-4988-82ef-1c7a9f9a6767 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:52.174053 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:52.181350 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:52.189216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb15d1-710e-4ecb-961d-4512fb3311c6 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:52.207900 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e83bd-2f38-4d25-a229-ece8081861e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:52.208672 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e83bd-2f38-4d25-a229-ece8081861e4 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:52.209189 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e83bd-2f38-4d25-a229-ece8081861e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:52.209465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e83bd-2f38-4d25-a229-ece8081861e4 None admin] PATH_INFO: `/v3/projects/cfef4a17bab2408d8ab3549e927bff2d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:52.211820 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e83bd-2f38-4d25-a229-ece8081861e4 None admin] RBAC: Authorizing `identity:get_project(project_id=cfef4a17bab2408d8ab3549e927bff2d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:52.213323 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e83bd-2f38-4d25-a229-ece8081861e4 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:52.215228 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 217/433] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:25:52 2022] GET /identity/v3/projects/cfef4a17bab2408d8ab3549e927bff2d => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:52.216000 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e83bd-2f38-4d25-a229-ece8081861e4 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:52.243580 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a339f5-da2a-4715-87ce-d2d6431567f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:52.244230 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a339f5-da2a-4715-87ce-d2d6431567f2 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:52.244620 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a339f5-da2a-4715-87ce-d2d6431567f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:52.244900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a339f5-da2a-4715-87ce-d2d6431567f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:52.263466 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a339f5-da2a-4715-87ce-d2d6431567f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:52.273973 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-b4a339f5-da2a-4715-87ce-d2d6431567f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:25:52.273973 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:52.273973 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:52.273973 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:52.273973 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:52.273973 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:52.273973 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:52.273973 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:52.273973 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:52.273973 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:52.273973 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:52.273973 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:52.273973 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:52.273973 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:52.273973 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:52.273973 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:52.275192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:52.275192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:52.275192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:52.275192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:52.275192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:52.275192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:52.275192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:52.275192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:52.275192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:52.275192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:52.275192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:52.275192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:52.275192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:52.275192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:52.275192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:52.275192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:52.276231 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:52.276231 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:52.276231 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:52.276231 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:52.276231 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:52.276231 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:52.276231 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:52.276231 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:52.276231 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:52.276231 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:52.276231 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 08:25:52.276231 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:25:52.276887 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 217/434] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:25:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:25:52.277980 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a339f5-da2a-4715-87ce-d2d6431567f2 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:52.343054 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e83bd-2f38-4d25-a229-ece8081861e4 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:52.384308 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576ecef-5eb0-4118-923d-47cd0d129683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:52.385256 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576ecef-5eb0-4118-923d-47cd0d129683 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:52.385704 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576ecef-5eb0-4118-923d-47cd0d129683 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:52.386149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576ecef-5eb0-4118-923d-47cd0d129683 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:52.400202 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576ecef-5eb0-4118-923d-47cd0d129683 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:52.405788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-d576ecef-5eb0-4118-923d-47cd0d129683 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 08:25:52.405788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:52.405788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:52.405788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:52.405788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:52.405788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:52.405788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:52.405788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:52.405788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:52.405788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:52.405788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:52.405788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:52.405788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:52.405788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:52.405788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:52.405788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:52.406970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:52.406970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:52.406970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:52.406970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:52.406970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:52.406970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:52.406970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:52.406970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:52.406970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:52.406970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:52.406970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:52.406970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:52.406970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:52.406970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:52.406970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:52.406970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:52.408018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:52.408018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:52.408018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:52.408018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:52.408018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:52.408018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:52.408018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:52.408018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:52.408018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:52.408018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:52.408018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 08:25:52.408018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:25:52.410466 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 218/435] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Sep 11 08:25:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:25:52.411704 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576ecef-5eb0-4118-923d-47cd0d129683 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:52.448123 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a339f5-da2a-4715-87ce-d2d6431567f2 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:52.472423 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:52.493930 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ba89d-2756-495d-96e4-3f8776688e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:52.494587 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ba89d-2756-495d-96e4-3f8776688e49 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:52.494950 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ba89d-2756-495d-96e4-3f8776688e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:52.495269 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ba89d-2756-495d-96e4-3f8776688e49 None admin] PATH_INFO: `/v3/groups/eca5bad56e68442b90b6ef30229e2dad` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:52.496490 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ba89d-2756-495d-96e4-3f8776688e49 None admin] RBAC: Authorizing `identity:get_group(group_id=eca5bad56e68442b90b6ef30229e2dad)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:52.497971 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ba89d-2756-495d-96e4-3f8776688e49 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:52.499675 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 218/436] 10.222.0.26 () {56 vars in 1180 bytes} [Sun Sep 11 08:25:52 2022] GET /identity/v3/groups/eca5bad56e68442b90b6ef30229e2dad => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:52.500475 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ba89d-2756-495d-96e4-3f8776688e49 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:52.536927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:52.585190 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576ecef-5eb0-4118-923d-47cd0d129683 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:52.631335 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ba89d-2756-495d-96e4-3f8776688e49 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:52.641325 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc29073-aa03-4ac8-b2c5-eb3b2e0161e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:52.642093 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc29073-aa03-4ac8-b2c5-eb3b2e0161e9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:52.642557 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc29073-aa03-4ac8-b2c5-eb3b2e0161e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:52.643023 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc29073-aa03-4ac8-b2c5-eb3b2e0161e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:52.644195 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc29073-aa03-4ac8-b2c5-eb3b2e0161e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:52.644748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc29073-aa03-4ac8-b2c5-eb3b2e0161e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:52.647053 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc29073-aa03-4ac8-b2c5-eb3b2e0161e9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:52.663300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 219/437] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Sep 11 08:25:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:52.663300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc29073-aa03-4ac8-b2c5-eb3b2e0161e9 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:52.695804 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa67732-a8ef-4bed-82e7-99290a392a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:52.696599 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa67732-a8ef-4bed-82e7-99290a392a69 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:52.696796 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa67732-a8ef-4bed-82e7-99290a392a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:52.696942 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa67732-a8ef-4bed-82e7-99290a392a69 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:52.697623 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa67732-a8ef-4bed-82e7-99290a392a69 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:52.697928 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa67732-a8ef-4bed-82e7-99290a392a69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:52.699359 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa67732-a8ef-4bed-82e7-99290a392a69 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:52.709010 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 219/438] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:25:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:52.712333 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa67732-a8ef-4bed-82e7-99290a392a69 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:52.825273 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:52.836360 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc29073-aa03-4ac8-b2c5-eb3b2e0161e9 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:52.874388 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:52.892542 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa67732-a8ef-4bed-82e7-99290a392a69 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:52.894819 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815d2cb-57e2-4b9c-b19a-d87f27a66fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:52.895861 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815d2cb-57e2-4b9c-b19a-d87f27a66fff None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:52.896331 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815d2cb-57e2-4b9c-b19a-d87f27a66fff None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:52.896808 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815d2cb-57e2-4b9c-b19a-d87f27a66fff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:52.897901 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815d2cb-57e2-4b9c-b19a-d87f27a66fff None admin] RBAC: Adding query filter params (group.id=eca5bad56e68442b90b6ef30229e2dad, role.id=3cecaf09e54b4f479cd391db74c49831, scope.project.id=cfef4a17bab2408d8ab3549e927bff2d) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:52.898369 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815d2cb-57e2-4b9c-b19a-d87f27a66fff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:52.900792 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815d2cb-57e2-4b9c-b19a-d87f27a66fff None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:52.911101 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 220/439] 10.222.0.26 () {56 vars in 1376 bytes} [Sun Sep 11 08:25:52 2022] GET /identity/v3/role_assignments?group.id=eca5bad56e68442b90b6ef30229e2dad&scope.project.id=cfef4a17bab2408d8ab3549e927bff2d&role.id=3cecaf09e54b4f479cd391db74c49831 => generated 611 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:52.912295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815d2cb-57e2-4b9c-b19a-d87f27a66fff None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:52.966750 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6265a5b-c069-4a5c-ad13-0a967bd65ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:52.968330 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6265a5b-c069-4a5c-ad13-0a967bd65ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:52.969248 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6265a5b-c069-4a5c-ad13-0a967bd65ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:52.969990 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6265a5b-c069-4a5c-ad13-0a967bd65ff6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:53.112257 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6265a5b-c069-4a5c-ad13-0a967bd65ff6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:53.114887 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6265a5b-c069-4a5c-ad13-0a967bd65ff6 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:53.138307 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815d2cb-57e2-4b9c-b19a-d87f27a66fff None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:53.192201 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacaa392-5603-439d-a97c-39fc785b7ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:53.193167 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacaa392-5603-439d-a97c-39fc785b7ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:53.193616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacaa392-5603-439d-a97c-39fc785b7ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:53.194056 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacaa392-5603-439d-a97c-39fc785b7ca0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:53.238219 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:53.267011 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:53.278366 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 220/440] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:25:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 08:25:53.279837 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06215f-292d-4e15-9e01-fbe36c73eaba None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:53.280123 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06215f-292d-4e15-9e01-fbe36c73eaba None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:53.280425 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06215f-292d-4e15-9e01-fbe36c73eaba None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:53.281697 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 221/441] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:53.286335 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06215f-292d-4e15-9e01-fbe36c73eaba None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:53.305160 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacaa392-5603-439d-a97c-39fc785b7ca0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:53.307998 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacaa392-5603-439d-a97c-39fc785b7ca0 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:53.434680 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06215f-292d-4e15-9e01-fbe36c73eaba None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:53.462438 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 221/442] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:25:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 08:25:53.462438 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c9e7c-ae72-44af-8002-f2ae7a10e21e None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:53.462438 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c9e7c-ae72-44af-8002-f2ae7a10e21e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:53.462438 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c9e7c-ae72-44af-8002-f2ae7a10e21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:53.480224 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-fb9c9e7c-ae72-44af-8002-f2ae7a10e21e None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:53.481480 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-fb9c9e7c-ae72-44af-8002-f2ae7a10e21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:53.492460 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680fbf9-01b3-4121-bec9-d73380c6e310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:53.493288 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680fbf9-01b3-4121-bec9-d73380c6e310 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:53.493288 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680fbf9-01b3-4121-bec9-d73380c6e310 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:53.493759 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680fbf9-01b3-4121-bec9-d73380c6e310 None admin] PATH_INFO: `/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:53.495608 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680fbf9-01b3-4121-bec9-d73380c6e310 None admin] RBAC: Authorizing `identity:get_project(project_id=16bd6bbfd5774162b2c2103efb3a6d76)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:53.497992 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680fbf9-01b3-4121-bec9-d73380c6e310 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:53.503316 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 222/443] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:25:53 2022] GET /identity/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:25:53.503316 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680fbf9-01b3-4121-bec9-d73380c6e310 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:53.562847 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:53.582326 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 222/444] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:25:53.588232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c9e7c-ae72-44af-8002-f2ae7a10e21e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:53.588429 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:53.663483 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680fbf9-01b3-4121-bec9-d73380c6e310 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:53.717700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e56a2-933a-4df2-8c13-6949518abccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:53.718911 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e56a2-933a-4df2-8c13-6949518abccc None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:53.719610 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e56a2-933a-4df2-8c13-6949518abccc None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:53.720153 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e56a2-933a-4df2-8c13-6949518abccc None admin] PATH_INFO: `/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:53.721765 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e56a2-933a-4df2-8c13-6949518abccc None admin] RBAC: Authorizing `identity:get_project(project_id=16bd6bbfd5774162b2c2103efb3a6d76)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:53.723911 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e56a2-933a-4df2-8c13-6949518abccc None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:53.726453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 223/445] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:25:53 2022] GET /identity/v3/projects/16bd6bbfd5774162b2c2103efb3a6d76 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:53.732463 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e56a2-933a-4df2-8c13-6949518abccc None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:53.736949 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c9e7c-ae72-44af-8002-f2ae7a10e21e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:53.800926 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602899bc-4dbf-45c6-bfe6-473a65307eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:53.801844 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602899bc-4dbf-45c6-bfe6-473a65307eba None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:53.802292 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602899bc-4dbf-45c6-bfe6-473a65307eba None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:53.802719 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602899bc-4dbf-45c6-bfe6-473a65307eba None admin] PATH_INFO: `/v3/groups/eca5bad56e68442b90b6ef30229e2dad` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:53.804750 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602899bc-4dbf-45c6-bfe6-473a65307eba None admin] RBAC: Authorizing `identity:get_group(group_id=eca5bad56e68442b90b6ef30229e2dad)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:53.806372 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602899bc-4dbf-45c6-bfe6-473a65307eba None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:53.813345 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 223/446] 10.222.0.26 () {56 vars in 1180 bytes} [Sun Sep 11 08:25:53 2022] GET /identity/v3/groups/eca5bad56e68442b90b6ef30229e2dad => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:53.814540 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602899bc-4dbf-45c6-bfe6-473a65307eba None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:53.876274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:53.902857 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e56a2-933a-4df2-8c13-6949518abccc None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:53.932261 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602899bc-4dbf-45c6-bfe6-473a65307eba None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:53.950007 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:53.965976 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a9614-8df7-4f10-8833-8490d5b9e0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:53.967370 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a9614-8df7-4f10-8833-8490d5b9e0fe None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:53.967954 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a9614-8df7-4f10-8833-8490d5b9e0fe None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:53.968411 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a9614-8df7-4f10-8833-8490d5b9e0fe None admin] PATH_INFO: `/v3/groups/eca5bad56e68442b90b6ef30229e2dad` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:53.972086 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a9614-8df7-4f10-8833-8490d5b9e0fe None admin] RBAC: Authorizing `identity:get_group(group_id=eca5bad56e68442b90b6ef30229e2dad)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:53.974863 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a9614-8df7-4f10-8833-8490d5b9e0fe None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:53.977648 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbc737-efe5-4589-94dd-2cc3303cec8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:53.978520 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbc737-efe5-4589-94dd-2cc3303cec8a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:53.978896 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbc737-efe5-4589-94dd-2cc3303cec8a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:53.979331 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbc737-efe5-4589-94dd-2cc3303cec8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:53.980367 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cbc737-efe5-4589-94dd-2cc3303cec8a None admin] RBAC: Adding query filter params (group.id=eca5bad56e68442b90b6ef30229e2dad, role.id=3cecaf09e54b4f479cd391db74c49831, scope.project.id=16bd6bbfd5774162b2c2103efb3a6d76) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:53.980808 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cbc737-efe5-4589-94dd-2cc3303cec8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:53.982368 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cbc737-efe5-4589-94dd-2cc3303cec8a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:53.989497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 224/447] 10.222.0.26 () {56 vars in 1376 bytes} [Sun Sep 11 08:25:53 2022] GET /identity/v3/role_assignments?group.id=eca5bad56e68442b90b6ef30229e2dad&scope.project.id=16bd6bbfd5774162b2c2103efb3a6d76&role.id=3cecaf09e54b4f479cd391db74c49831 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:53.990590 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbc737-efe5-4589-94dd-2cc3303cec8a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:53.992207 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 224/448] 10.222.0.26 () {56 vars in 1180 bytes} [Sun Sep 11 08:25:53 2022] GET /identity/v3/groups/eca5bad56e68442b90b6ef30229e2dad => generated 226 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:53.993990 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a9614-8df7-4f10-8833-8490d5b9e0fe None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:54.142552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbc737-efe5-4589-94dd-2cc3303cec8a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:54.142995 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a9614-8df7-4f10-8833-8490d5b9e0fe None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:54.171589 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:54.183764 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2d0dd-698f-4100-863d-4622e9548a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:54.184351 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2d0dd-698f-4100-863d-4622e9548a77 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:54.184626 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2d0dd-698f-4100-863d-4622e9548a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:54.185206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2d0dd-698f-4100-863d-4622e9548a77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:54.185625 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2d0dd-698f-4100-863d-4622e9548a77 None admin] RBAC: Adding query filter params (group.id=eca5bad56e68442b90b6ef30229e2dad, role.id=897bff7604d1492993a708763e54e6d8, scope.project.id=16bd6bbfd5774162b2c2103efb3a6d76) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:54.186047 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2d0dd-698f-4100-863d-4622e9548a77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:54.188518 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2d0dd-698f-4100-863d-4622e9548a77 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:54.191095 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0db14f-5d3f-4b63-81c8-1539acb85baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:54.191776 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0db14f-5d3f-4b63-81c8-1539acb85baa None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:54.192050 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0db14f-5d3f-4b63-81c8-1539acb85baa None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:54.192326 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0db14f-5d3f-4b63-81c8-1539acb85baa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:54.194655 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 225/449] 10.222.0.26 () {56 vars in 1376 bytes} [Sun Sep 11 08:25:53 2022] GET /identity/v3/role_assignments?group.id=eca5bad56e68442b90b6ef30229e2dad&scope.project.id=16bd6bbfd5774162b2c2103efb3a6d76&role.id=897bff7604d1492993a708763e54e6d8 => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:25:54.210202 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0db14f-5d3f-4b63-81c8-1539acb85baa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:25:54.216697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-ac0db14f-5d3f-4b63-81c8-1539acb85baa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:25:54.216697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:54.216697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:54.216697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:54.216697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:54.216697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:54.216697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:54.216697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:54.216697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:54.216697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:54.216697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:54.216697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:54.216697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:25:54.216697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:25:54.216697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:25:54.216697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:25:54.217694 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:25:54.217694 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:25:54.217694 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:25:54.217694 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:25:54.217694 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:54.217694 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:54.217694 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:54.217694 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:54.217694 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:54.217694 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:54.217694 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:54.217694 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:54.217694 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:54.217694 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:54.217694 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:54.217694 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:54.218998 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:54.218998 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:54.218998 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:54.218998 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:54.218998 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:25:54.218998 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:25:54.218998 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:25:54.218998 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:25:54.218998 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:25:54.218998 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:25:54.218998 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:25:54.218998 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:25:54.218998 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 225/450] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:25:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:25:54.224660 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2d0dd-698f-4100-863d-4622e9548a77 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:54.308632 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:54.372149 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2d0dd-698f-4100-863d-4622e9548a77 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:54.412173 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57971c46-f360-4f67-8c60-4bd4ffc00e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:54.412798 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57971c46-f360-4f67-8c60-4bd4ffc00e29 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:54.413087 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57971c46-f360-4f67-8c60-4bd4ffc00e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:54.413958 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57971c46-f360-4f67-8c60-4bd4ffc00e29 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:54.414643 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57971c46-f360-4f67-8c60-4bd4ffc00e29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:54.414950 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57971c46-f360-4f67-8c60-4bd4ffc00e29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:54.416483 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57971c46-f360-4f67-8c60-4bd4ffc00e29 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:54.426821 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 226/451] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:25:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:54.432825 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0db14f-5d3f-4b63-81c8-1539acb85baa None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:54.549711 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0db14f-5d3f-4b63-81c8-1539acb85baa None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:54.587691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6311251-1aee-480b-a5ff-4961953c003e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:54.588494 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6311251-1aee-480b-a5ff-4961953c003e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:54.588794 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6311251-1aee-480b-a5ff-4961953c003e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:54.589144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6311251-1aee-480b-a5ff-4961953c003e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:54.645808 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:54.666644 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6311251-1aee-480b-a5ff-4961953c003e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:54.668293 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6311251-1aee-480b-a5ff-4961953c003e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:54.768330 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 226/452] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:25:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 08:25:54.774753 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57971c46-f360-4f67-8c60-4bd4ffc00e29 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:54.910378 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57971c46-f360-4f67-8c60-4bd4ffc00e29 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:54.933066 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:54.950307 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437de6c-0c63-4236-b9e6-b9a26ef17c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:54.950975 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437de6c-0c63-4236-b9e6-b9a26ef17c74 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:54.951430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437de6c-0c63-4236-b9e6-b9a26ef17c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:54.951713 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437de6c-0c63-4236-b9e6-b9a26ef17c74 None admin] PATH_INFO: `/v3/projects/10a12f84e22947cf95a2bfc7124d42aa` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:54.953028 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2437de6c-0c63-4236-b9e6-b9a26ef17c74 None admin] RBAC: Authorizing `identity:get_project(project_id=10a12f84e22947cf95a2bfc7124d42aa)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:54.954790 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2437de6c-0c63-4236-b9e6-b9a26ef17c74 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:54.956594 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 227/453] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:25:54 2022] GET /identity/v3/projects/10a12f84e22947cf95a2bfc7124d42aa => generated 344 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:54.963194 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6311251-1aee-480b-a5ff-4961953c003e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:55.056441 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:55.078381 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6311251-1aee-480b-a5ff-4961953c003e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:55.117765 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27f82f-5947-48c8-9460-e18a791195c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:55.118400 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27f82f-5947-48c8-9460-e18a791195c2 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:55.118676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27f82f-5947-48c8-9460-e18a791195c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:55.118950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27f82f-5947-48c8-9460-e18a791195c2 None admin] PATH_INFO: `/v3/groups/f8fb3288700b48d0adc530e3a140b31b` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:55.120139 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27f82f-5947-48c8-9460-e18a791195c2 None admin] RBAC: Authorizing `identity:get_group(group_id=f8fb3288700b48d0adc530e3a140b31b)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:55.121589 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27f82f-5947-48c8-9460-e18a791195c2 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:55.123181 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 227/454] 10.222.0.26 () {56 vars in 1180 bytes} [Sun Sep 11 08:25:54 2022] GET /identity/v3/groups/f8fb3288700b48d0adc530e3a140b31b => generated 229 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:55.129277 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437de6c-0c63-4236-b9e6-b9a26ef17c74 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:55.265021 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437de6c-0c63-4236-b9e6-b9a26ef17c74 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:55.301747 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd1c0b-f9b4-4c87-87df-38fffbf8266a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:55.302363 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd1c0b-f9b4-4c87-87df-38fffbf8266a None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:55.302650 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd1c0b-f9b4-4c87-87df-38fffbf8266a None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:55.302932 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd1c0b-f9b4-4c87-87df-38fffbf8266a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:55.303723 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd1c0b-f9b4-4c87-87df-38fffbf8266a None admin] RBAC: Adding query filter params (group.id=f8fb3288700b48d0adc530e3a140b31b, role.id=d12af9f1dfb344cd8a6a493e165030ba, scope.project.id=10a12f84e22947cf95a2bfc7124d42aa) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:55.304039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd1c0b-f9b4-4c87-87df-38fffbf8266a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:55.305521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd1c0b-f9b4-4c87-87df-38fffbf8266a None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:55.312159 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 228/455] 10.222.0.26 () {56 vars in 1376 bytes} [Sun Sep 11 08:25:55 2022] GET /identity/v3/role_assignments?group.id=f8fb3288700b48d0adc530e3a140b31b&scope.project.id=10a12f84e22947cf95a2bfc7124d42aa&role.id=d12af9f1dfb344cd8a6a493e165030ba => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:58.616728 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c2de3-fe26-4078-b7d9-42013068c0e2 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:58.617425 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c2de3-fe26-4078-b7d9-42013068c0e2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:58.617677 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c2de3-fe26-4078-b7d9-42013068c0e2 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:58.621024 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 228/456] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:58.627232 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd4776-68cd-4089-a85a-f92326e1944c None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:58.627990 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd4776-68cd-4089-a85a-f92326e1944c None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:58.627990 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd4776-68cd-4089-a85a-f92326e1944c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:58.655045 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-25dd4776-68cd-4089-a85a-f92326e1944c None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:58.656298 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-25dd4776-68cd-4089-a85a-f92326e1944c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:58.787631 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:58.815995 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 229/457] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 08:25:59.207399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c2de3-fe26-4078-b7d9-42013068c0e2 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:59.441948 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c2de3-fe26-4078-b7d9-42013068c0e2 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:59.545527 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff70cf9-0d6a-4e8a-b80e-1e66f0d652bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:59.546463 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff70cf9-0d6a-4e8a-b80e-1e66f0d652bd None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:59.546872 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff70cf9-0d6a-4e8a-b80e-1e66f0d652bd None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:59.547307 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff70cf9-0d6a-4e8a-b80e-1e66f0d652bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:59.574413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff70cf9-0d6a-4e8a-b80e-1e66f0d652bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:59.577163 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff70cf9-0d6a-4e8a-b80e-1e66f0d652bd None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:59.602392 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:25:59.616040 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-2ff70cf9-0d6a-4e8a-b80e-1e66f0d652bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:25:59.616040 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:25:59.616040 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:25:59.616040 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:25:59.616040 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:25:59.616040 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:25:59.616040 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:25:59.616040 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:25:59.616040 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:25:59.616040 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:25:59.616040 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:25:59.616040 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:25:59.616040 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:25:59.616040 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:25:59.616040 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:25:59.616040 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:25:59.619018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:25:59.619018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:25:59.619018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:25:59.619018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:25:59.619018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:25:59.619018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:25:59.619018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:25:59.619018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:25:59.619018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:25:59.619018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:25:59.619018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:25:59.619018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:25:59.619018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:25:59.619018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:25:59.619018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:25:59.619018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:25:59.619018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:25:59.620616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:25:59.620616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:25:59.620616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:25:59.620616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 229/458] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:25:59.625133 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd4776-68cd-4089-a85a-f92326e1944c None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:59.627073 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d43df7-33d9-433c-b1c3-7a5216ef2003 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:59.627534 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d43df7-33d9-433c-b1c3-7a5216ef2003 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:59.627946 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d43df7-33d9-433c-b1c3-7a5216ef2003 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:59.630388 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 230/459] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:25:59.637737 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8aa304-79b9-482a-9471-1643cd20a3b5 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:59.638569 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8aa304-79b9-482a-9471-1643cd20a3b5 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:59.639241 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8aa304-79b9-482a-9471-1643cd20a3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:59.696727 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-1e8aa304-79b9-482a-9471-1643cd20a3b5 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:59.697951 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1e8aa304-79b9-482a-9471-1643cd20a3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:59.787521 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 231/460] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 08:25:59.789248 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c183a54-0fd6-4f79-b11e-1aef5e0fd1f2 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:59.789531 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c183a54-0fd6-4f79-b11e-1aef5e0fd1f2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:59.789987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c183a54-0fd6-4f79-b11e-1aef5e0fd1f2 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:59.793419 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 232/461] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:25:59.799677 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2c662-c513-43ec-87d4-d72d4f04b9c2 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:59.800193 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2c662-c513-43ec-87d4-d72d4f04b9c2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:59.800618 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2c662-c513-43ec-87d4-d72d4f04b9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:59.822306 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-27c2c662-c513-43ec-87d4-d72d4f04b9c2 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:25:59.825559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-27c2c662-c513-43ec-87d4-d72d4f04b9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:25:59.830512 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd4776-68cd-4089-a85a-f92326e1944c None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:25:59.900030 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45f0d5-eb00-464a-93ca-8390f7ea20ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:25:59.900911 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45f0d5-eb00-464a-93ca-8390f7ea20ab None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:59.901339 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45f0d5-eb00-464a-93ca-8390f7ea20ab None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:59.901760 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45f0d5-eb00-464a-93ca-8390f7ea20ab None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:59.902588 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45f0d5-eb00-464a-93ca-8390f7ea20ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:25:59.903038 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45f0d5-eb00-464a-93ca-8390f7ea20ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:25:59.904707 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45f0d5-eb00-464a-93ca-8390f7ea20ab None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:25:59.904836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 233/462] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 08:25:59.918120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 230/463] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:25:59.924097 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2c662-c513-43ec-87d4-d72d4f04b9c2 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:25:59.992831 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd6fe4-0f1b-4c55-a9f9-45fc4b6b5461 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:25:59.993350 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd6fe4-0f1b-4c55-a9f9-45fc4b6b5461 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:25:59.993775 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd6fe4-0f1b-4c55-a9f9-45fc4b6b5461 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:25:59.995748 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 231/464] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:00.005929 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:00.012757 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319866c-1c88-4dd4-bb20-a03f03bed5b1 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:00.013130 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319866c-1c88-4dd4-bb20-a03f03bed5b1 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:00.013624 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319866c-1c88-4dd4-bb20-a03f03bed5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:00.066405 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-0319866c-1c88-4dd4-bb20-a03f03bed5b1 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:00.068350 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-0319866c-1c88-4dd4-bb20-a03f03bed5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:00.121244 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2c662-c513-43ec-87d4-d72d4f04b9c2 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:00.185996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:00.207907 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b2eca-6588-41dd-a6ab-52672e50d69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:00.208946 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b2eca-6588-41dd-a6ab-52672e50d69e None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:00.209445 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b2eca-6588-41dd-a6ab-52672e50d69e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:00.209986 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b2eca-6588-41dd-a6ab-52672e50d69e None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:00.211010 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b2eca-6588-41dd-a6ab-52672e50d69e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:00.214212 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b2eca-6588-41dd-a6ab-52672e50d69e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:00.221689 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 232/465] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:26:00.223292 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319866c-1c88-4dd4-bb20-a03f03bed5b1 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:00.328289 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 234/466] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Sep 11 08:25:59 2022] POST /identity/v3/users => generated 246 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:26:00.336339 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b2eca-6588-41dd-a6ab-52672e50d69e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:00.414821 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319866c-1c88-4dd4-bb20-a03f03bed5b1 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:00.474360 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e624b-45ce-487e-918b-d4b9c7449d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:00.475311 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e624b-45ce-487e-918b-d4b9c7449d05 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:00.476330 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e624b-45ce-487e-918b-d4b9c7449d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:00.476769 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e624b-45ce-487e-918b-d4b9c7449d05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:00.490299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e624b-45ce-487e-918b-d4b9c7449d05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:00.492141 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e624b-45ce-487e-918b-d4b9c7449d05 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:00.510322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-706e624b-45ce-487e-918b-d4b9c7449d05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:00.510322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:00.510322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:00.510322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:00.510322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:00.510322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:00.510322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:00.510322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:00.510322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:00.510322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:00.510322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:00.510322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:00.510322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:00.510322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:00.510322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:00.510322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:00.511553 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:00.511553 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:00.511553 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:00.511553 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:00.511553 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:00.511553 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:00.511553 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:00.511553 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:00.511553 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:00.511553 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:00.511553 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:00.511553 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:00.511553 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:00.511553 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:00.511553 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:00.511553 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:00.511553 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:00.512601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:00.512601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:00.512601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:00.514340 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 233/467] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:00.515968 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf3f58-bc88-4ee9-896d-f4b9126de4f6 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:00.516482 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf3f58-bc88-4ee9-896d-f4b9126de4f6 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:00.516979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf3f58-bc88-4ee9-896d-f4b9126de4f6 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:00.518705 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 234/468] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:00.524563 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf3f58-bc88-4ee9-896d-f4b9126de4f6 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:00.547616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b2eca-6588-41dd-a6ab-52672e50d69e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:00.557219 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:00.572713 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:00.598442 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3ad8d-fcbf-4be8-9c6f-dd56d75a2ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:00.598650 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3ad8d-fcbf-4be8-9c6f-dd56d75a2ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:00.599409 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3ad8d-fcbf-4be8-9c6f-dd56d75a2ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:00.599704 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3ad8d-fcbf-4be8-9c6f-dd56d75a2ff4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:00.613898 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3ad8d-fcbf-4be8-9c6f-dd56d75a2ff4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:00.615996 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3ad8d-fcbf-4be8-9c6f-dd56d75a2ff4 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:00.635083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-a1b3ad8d-fcbf-4be8-9c6f-dd56d75a2ff4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:00.635083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:00.635083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:00.635083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:00.635083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:00.635083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:00.635083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:00.635083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:00.635083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:00.635083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:00.635083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:00.635083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:00.635083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:00.635083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:00.635083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:00.635083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:00.636689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:00.636689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:00.636689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:00.636689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:00.636689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:00.636689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:00.636689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:00.636689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:00.636689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:00.636689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:00.636689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:00.636689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:00.636689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:00.636689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:00.636689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:00.636689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:00.636689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:00.637544 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:00.637544 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:00.637544 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:00.637544 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 235/469] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:00.637895 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31484b-e492-4eff-ae42-2949032dcedb None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:00.638178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31484b-e492-4eff-ae42-2949032dcedb None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:00.638454 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31484b-e492-4eff-ae42-2949032dcedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:00.658946 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2e31484b-e492-4eff-ae42-2949032dcedb None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:00.660215 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2e31484b-e492-4eff-ae42-2949032dcedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:00.697070 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf3f58-bc88-4ee9-896d-f4b9126de4f6 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:00.749240 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 236/470] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:26:00.750286 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31484b-e492-4eff-ae42-2949032dcedb None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:00.763596 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab00bb6-5578-443a-bf20-77fe79f8f918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:00.765072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab00bb6-5578-443a-bf20-77fe79f8f918 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:00.765806 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab00bb6-5578-443a-bf20-77fe79f8f918 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:00.766540 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab00bb6-5578-443a-bf20-77fe79f8f918 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:00.768009 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab00bb6-5578-443a-bf20-77fe79f8f918 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:00.768638 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab00bb6-5578-443a-bf20-77fe79f8f918 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:00.771994 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab00bb6-5578-443a-bf20-77fe79f8f918 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:00.793234 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 235/471] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:00.794689 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab00bb6-5578-443a-bf20-77fe79f8f918 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:00.915395 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:00.920585 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31484b-e492-4eff-ae42-2949032dcedb None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:00.933378 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:00.953290 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab00bb6-5578-443a-bf20-77fe79f8f918 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:00.962972 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590b8e8-2df7-4e5a-8b50-dde3547e5699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:00.964039 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590b8e8-2df7-4e5a-8b50-dde3547e5699 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:00.964575 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590b8e8-2df7-4e5a-8b50-dde3547e5699 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:00.965076 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590b8e8-2df7-4e5a-8b50-dde3547e5699 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:00.977606 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590b8e8-2df7-4e5a-8b50-dde3547e5699 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:00.979686 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590b8e8-2df7-4e5a-8b50-dde3547e5699 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:00.997213 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e7b55-f40a-4ff4-b6d0-b3d563e4de5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:00.997831 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e7b55-f40a-4ff4-b6d0-b3d563e4de5b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:00.998106 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e7b55-f40a-4ff4-b6d0-b3d563e4de5b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:00.998379 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e7b55-f40a-4ff4-b6d0-b3d563e4de5b None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:00.999034 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e7b55-f40a-4ff4-b6d0-b3d563e4de5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:00.999360 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e7b55-f40a-4ff4-b6d0-b3d563e4de5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:01.000011 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-f590b8e8-2df7-4e5a-8b50-dde3547e5699 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:01.000011 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:01.000011 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:01.000011 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:01.000011 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:01.000011 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:01.000011 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:01.000011 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:01.000011 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:01.000011 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:01.000011 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:01.000011 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:01.000011 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:01.000011 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:01.000011 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:01.000011 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:01.000893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:01.000893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:01.000893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:01.000893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:01.000893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:01.000893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:01.000893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:01.000893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:01.000893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:01.000893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:01.000893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:01.000893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:01.000893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:01.000893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:01.000893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:01.000893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:01.000893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:01.001792 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:01.001792 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:01.001792 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:01.001970 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e7b55-f40a-4ff4-b6d0-b3d563e4de5b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:01.003803 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 237/472] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:01.004893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590b8e8-2df7-4e5a-8b50-dde3547e5699 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:01.024906 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 236/473] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:01.025922 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e7b55-f40a-4ff4-b6d0-b3d563e4de5b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:01.140270 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590b8e8-2df7-4e5a-8b50-dde3547e5699 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:01.155873 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e7b55-f40a-4ff4-b6d0-b3d563e4de5b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:01.187306 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12703a95-4ecd-47d2-9510-b1a05e171e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:01.188258 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12703a95-4ecd-47d2-9510-b1a05e171e5a None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:01.188567 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12703a95-4ecd-47d2-9510-b1a05e171e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:01.188840 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12703a95-4ecd-47d2-9510-b1a05e171e5a None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:01.189947 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12703a95-4ecd-47d2-9510-b1a05e171e5a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:01.192078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12703a95-4ecd-47d2-9510-b1a05e171e5a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:01.196772 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f4bfa-3bd8-4e5e-9dea-d3ae9d5de907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:01.197409 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f4bfa-3bd8-4e5e-9dea-d3ae9d5de907 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:01.197681 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f4bfa-3bd8-4e5e-9dea-d3ae9d5de907 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:01.197958 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f4bfa-3bd8-4e5e-9dea-d3ae9d5de907 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:01.198627 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f4bfa-3bd8-4e5e-9dea-d3ae9d5de907 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:01.198931 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f4bfa-3bd8-4e5e-9dea-d3ae9d5de907 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:01.200496 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f4bfa-3bd8-4e5e-9dea-d3ae9d5de907 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:01.220801 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 237/474] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:01.221698 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f4bfa-3bd8-4e5e-9dea-d3ae9d5de907 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:01.230726 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:01.352963 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 238/475] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Sep 11 08:26:01 2022] POST /identity/v3/users => generated 248 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:26:01.355239 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12703a95-4ecd-47d2-9510-b1a05e171e5a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:01.371836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:01.401046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f4bfa-3bd8-4e5e-9dea-d3ae9d5de907 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:01.483968 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c3299-3848-46ac-a96a-06667ccda458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:01.485605 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c3299-3848-46ac-a96a-06667ccda458 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:01.486422 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c3299-3848-46ac-a96a-06667ccda458 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:01.487101 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c3299-3848-46ac-a96a-06667ccda458 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:01.488696 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c3299-3848-46ac-a96a-06667ccda458 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:01.491635 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c3299-3848-46ac-a96a-06667ccda458 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:01.535605 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.sql.core [None req-014c3299-3848-46ac-a96a-06667ccda458 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 11 08:26:01.535605 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 11 08:26:01.535605 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [parameters: {'id': 'a778cb491d904d3698f6b03f7ae1d922', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 11 08:26:01.535605 dv-cinder-856941-2-smb devstack@keystone.service[81645]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81645) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 11 08:26:01.565742 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-014c3299-3848-46ac-a96a-06667ccda458 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 11 08:26:01.565742 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:01.565742 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 08:26:01.565742 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 08:26:01.565742 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 08:26:01.565742 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 08:26:01.565742 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 08:26:01.565742 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 08:26:01.565742 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 08:26:01.565742 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application conn.query(q) Sep 11 08:26:01.565742 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 08:26:01.565742 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 08:26:01.565742 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 08:26:01.565742 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application result.read() Sep 11 08:26:01.565742 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 08:26:01.567349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 08:26:01.567349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 08:26:01.567349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 08:26:01.567349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 08:26:01.567349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 08:26:01.567349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 08:26:01.567349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 08:26:01.567349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 11 08:26:01.567349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:01.567349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 11 08:26:01.567349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:01.567349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:01.567349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 11 08:26:01.567349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 11 08:26:01.567349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 11 08:26:01.567349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return ref.to_dict() Sep 11 08:26:01.567349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 08:26:01.567349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application next(self.gen) Sep 11 08:26:01.569054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 11 08:26:01.569054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application yield resource Sep 11 08:26:01.569054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 08:26:01.569054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application next(self.gen) Sep 11 08:26:01.569054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 11 08:26:01.569054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self.session.rollback() Sep 11 08:26:01.569054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 11 08:26:01.569054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self.force_reraise() Sep 11 08:26:01.569054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 11 08:26:01.569054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise self.value Sep 11 08:26:01.569054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 11 08:26:01.569054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 11 08:26:01.569054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 11 08:26:01.569054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application session.commit() Sep 11 08:26:01.569054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 11 08:26:01.569054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 11 08:26:01.569054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 11 08:26:01.571164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._prepare_impl() Sep 11 08:26:01.571164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 11 08:26:01.571164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self.session.flush() Sep 11 08:26:01.571164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 11 08:26:01.571164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._flush(objects) Sep 11 08:26:01.571164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 11 08:26:01.571164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 11 08:26:01.571164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 11 08:26:01.571164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application compat.raise_( Sep 11 08:26:01.571164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 08:26:01.571164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception Sep 11 08:26:01.571164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 11 08:26:01.571164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application flush_context.execute() Sep 11 08:26:01.571164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 11 08:26:01.571164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rec.execute(self) Sep 11 08:26:01.571164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 11 08:26:01.571164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 11 08:26:01.575225 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 11 08:26:01.575225 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 11 08:26:01.575225 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 11 08:26:01.575225 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 11 08:26:01.575225 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 11 08:26:01.575225 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 11 08:26:01.575225 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 11 08:26:01.575225 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 11 08:26:01.575225 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 11 08:26:01.575225 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 11 08:26:01.575225 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 11 08:26:01.575225 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 11 08:26:01.575225 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 11 08:26:01.575225 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 11 08:26:01.575225 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 08:26:01.575225 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception Sep 11 08:26:01.578938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 08:26:01.578938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 08:26:01.578938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 08:26:01.578938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 08:26:01.578938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 08:26:01.578938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 08:26:01.578938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 08:26:01.578938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application conn.query(q) Sep 11 08:26:01.578938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 08:26:01.578938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 08:26:01.578938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 08:26:01.578938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application result.read() Sep 11 08:26:01.578938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 08:26:01.578938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 08:26:01.578938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 08:26:01.578938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 08:26:01.584264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 08:26:01.584264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 08:26:01.584264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 08:26:01.584264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 08:26:01.584264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 11 08:26:01.584264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 11 08:26:01.584264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [parameters: {'id': 'a778cb491d904d3698f6b03f7ae1d922', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 11 08:26:01.584264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 11 08:26:01.584264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:01.584264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 08:26:01.584264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:01.584264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:01.584264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:01.584264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:01.584264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:01.584264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:01.587865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:01.587865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:01.587865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:01.587865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:01.587865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:01.587865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:01.587865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 11 08:26:01.587865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 11 08:26:01.587865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:01.587865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:01.587865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 11 08:26:01.587865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 11 08:26:01.587865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 11 08:26:01.587865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 11 08:26:01.587865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 11 08:26:01.587865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:01.592729 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12703a95-4ecd-47d2-9510-b1a05e171e5a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:01.592964 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 238/476] 10.222.0.26 () {60 vars in 1131 bytes} [Sun Sep 11 08:26:01 2022] POST /identity/v3/roles => generated 144 bytes in 361 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:01.592964 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c3299-3848-46ac-a96a-06667ccda458 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:01.674047 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76029e67-d2a1-4529-936f-ad22672b040b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:01.675171 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76029e67-d2a1-4529-936f-ad22672b040b None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:01.675662 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76029e67-d2a1-4529-936f-ad22672b040b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:01.676191 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76029e67-d2a1-4529-936f-ad22672b040b None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:01.677401 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76029e67-d2a1-4529-936f-ad22672b040b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:01.680673 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76029e67-d2a1-4529-936f-ad22672b040b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:01.750069 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:01.802537 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c3299-3848-46ac-a96a-06667ccda458 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:01.843451 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 239/477] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Sep 11 08:26:01 2022] POST /identity/v3/users => generated 248 bytes in 484 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:26:01.844639 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76029e67-d2a1-4529-936f-ad22672b040b None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:01.872559 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365da10-1273-4239-9acf-df80f3c488ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:01.874029 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365da10-1273-4239-9acf-df80f3c488ee None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:01.874804 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365da10-1273-4239-9acf-df80f3c488ee None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:01.875659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365da10-1273-4239-9acf-df80f3c488ee None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:01.877327 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365da10-1273-4239-9acf-df80f3c488ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:01.880468 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365da10-1273-4239-9acf-df80f3c488ee None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:01.927435 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:01.977269 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76029e67-d2a1-4529-936f-ad22672b040b None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:02.023554 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f59d31-8e82-477b-91fd-67c6d8bd8216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:02.023554 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f59d31-8e82-477b-91fd-67c6d8bd8216 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:02.023554 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f59d31-8e82-477b-91fd-67c6d8bd8216 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:02.023554 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f59d31-8e82-477b-91fd-67c6d8bd8216 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:02.030702 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 239/478] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Sep 11 08:26:01 2022] POST /identity/v3/users => generated 249 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:26:02.044171 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f59d31-8e82-477b-91fd-67c6d8bd8216 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:26:02.051152 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-50f59d31-8e82-477b-91fd-67c6d8bd8216 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 08:26:02.051152 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:02.051152 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:02.051152 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:02.051152 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:02.051152 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:02.051152 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:02.051152 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:02.051152 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:02.051152 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:02.051152 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:02.051152 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:02.051152 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:26:02.051152 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:26:02.051152 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:26:02.051152 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:26:02.052945 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:26:02.052945 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:26:02.052945 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:26:02.052945 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:26:02.052945 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:02.052945 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:02.052945 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:02.052945 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:02.052945 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:02.052945 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:02.052945 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:02.052945 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:02.052945 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:02.052945 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:02.052945 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:02.052945 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:02.055293 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:02.055293 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:02.055293 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:02.055293 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:02.055293 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:26:02.055293 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:26:02.055293 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:26:02.055293 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:26:02.055293 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:26:02.055293 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:26:02.055293 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 08:26:02.055293 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:02.055293 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 240/479] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Sep 11 08:26:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:02.061370 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365da10-1273-4239-9acf-df80f3c488ee None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:02.293985 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365da10-1273-4239-9acf-df80f3c488ee None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:02.336554 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:02.353230 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b32b23-8631-4269-b2fa-44717c320076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:02.354312 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b32b23-8631-4269-b2fa-44717c320076 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:02.354736 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b32b23-8631-4269-b2fa-44717c320076 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:02.355184 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b32b23-8631-4269-b2fa-44717c320076 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:02.356484 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b32b23-8631-4269-b2fa-44717c320076 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:02.356932 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b32b23-8631-4269-b2fa-44717c320076 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:02.359125 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b32b23-8631-4269-b2fa-44717c320076 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:02.376312 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 240/480] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:26:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:03.537330 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054c4ce-dd58-46ab-8227-2577fda2ba05 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:03.538168 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054c4ce-dd58-46ab-8227-2577fda2ba05 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:03.538168 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054c4ce-dd58-46ab-8227-2577fda2ba05 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:03.539597 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 241/481] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:03.546031 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f3cff-c63b-4a08-9895-b423f6fda07d None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:03.546943 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f3cff-c63b-4a08-9895-b423f6fda07d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:03.546943 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f3cff-c63b-4a08-9895-b423f6fda07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:03.588995 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-aa2f3cff-c63b-4a08-9895-b423f6fda07d None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:03.591075 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-aa2f3cff-c63b-4a08-9895-b423f6fda07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:03.744369 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 241/482] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 08:26:04.120140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054c4ce-dd58-46ab-8227-2577fda2ba05 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:04.269243 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054c4ce-dd58-46ab-8227-2577fda2ba05 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:04.301943 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:04.322827 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72989e-a041-45fd-870f-b5fadf38622d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:04.323509 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72989e-a041-45fd-870f-b5fadf38622d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:04.323794 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72989e-a041-45fd-870f-b5fadf38622d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:04.324070 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72989e-a041-45fd-870f-b5fadf38622d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:04.342193 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c72989e-a041-45fd-870f-b5fadf38622d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:26:04.348025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-5c72989e-a041-45fd-870f-b5fadf38622d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:04.348025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:04.348025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:04.348025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:04.348025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:04.348025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:04.348025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:04.348025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:04.348025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:04.348025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:04.348025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:04.348025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:04.348025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:26:04.348025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:26:04.348025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:26:04.348025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:26:04.352182 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:26:04.352182 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:26:04.352182 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:26:04.352182 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:26:04.352182 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:04.352182 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:04.352182 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:04.352182 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:04.352182 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:04.352182 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:04.352182 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:04.352182 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:04.352182 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:04.352182 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:04.352182 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:04.352182 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:04.355221 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:04.355221 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:04.355221 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:04.355221 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:04.355221 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:26:04.355221 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:26:04.355221 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:26:04.355221 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:26:04.355221 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:26:04.355221 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:26:04.355221 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:04.355221 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:04.355221 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 242/483] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Sep 11 08:26:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:26:04.357799 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f3cff-c63b-4a08-9895-b423f6fda07d None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:04.502222 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a31a28-f417-48e9-92cc-f83a0d7f9794 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:04.502222 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a31a28-f417-48e9-92cc-f83a0d7f9794 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:04.502222 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a31a28-f417-48e9-92cc-f83a0d7f9794 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:04.510662 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 243/484] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:04.513829 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7e811-31b6-4830-9745-5947d1d3c5f8 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:04.514571 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7e811-31b6-4830-9745-5947d1d3c5f8 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:04.515326 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7e811-31b6-4830-9745-5947d1d3c5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:04.546693 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-76f7e811-31b6-4830-9745-5947d1d3c5f8 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:04.549939 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-76f7e811-31b6-4830-9745-5947d1d3c5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:04.626560 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f3cff-c63b-4a08-9895-b423f6fda07d None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:04.685551 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:04.711963 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 244/485] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:26:04.745379 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619f54c-8274-40d0-ac97-5312029c0462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:04.746004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619f54c-8274-40d0-ac97-5312029c0462 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:04.746289 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619f54c-8274-40d0-ac97-5312029c0462 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:04.746556 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619f54c-8274-40d0-ac97-5312029c0462 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:04.747238 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619f54c-8274-40d0-ac97-5312029c0462 None admin] RBAC: Adding query filter params (name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:04.747568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619f54c-8274-40d0-ac97-5312029c0462 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:04.748958 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619f54c-8274-40d0-ac97-5312029c0462 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:04.764504 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 242/486] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Sep 11 08:26:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:04.770940 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7e811-31b6-4830-9745-5947d1d3c5f8 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:05.012328 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7e811-31b6-4830-9745-5947d1d3c5f8 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:05.046611 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:05.100926 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f72bc8-9541-47d3-b270-516ecf5275b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:05.102063 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f72bc8-9541-47d3-b270-516ecf5275b5 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:05.102545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f72bc8-9541-47d3-b270-516ecf5275b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:05.103004 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f72bc8-9541-47d3-b270-516ecf5275b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:05.126639 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f72bc8-9541-47d3-b270-516ecf5275b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:05.129753 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f72bc8-9541-47d3-b270-516ecf5275b5 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:05.160493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-89f72bc8-9541-47d3-b270-516ecf5275b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:05.160493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:05.160493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:05.160493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:05.160493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:05.160493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:05.160493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:05.160493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:05.160493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:05.160493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:05.160493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:05.160493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:05.160493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:05.160493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:05.160493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:05.160493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:05.161497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:05.161497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:05.161497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:05.161497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:05.161497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:05.161497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:05.161497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:05.161497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:05.161497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:05.161497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:05.161497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:05.161497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:05.161497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:05.161497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:05.161497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:05.161497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:05.161497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:05.164511 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:05.164511 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:05.164511 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:05.164511 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 245/487] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:05.172422 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619f54c-8274-40d0-ac97-5312029c0462 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:05.200074 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f72bc8-9541-47d3-b270-516ecf5275b5 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:05.369208 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619f54c-8274-40d0-ac97-5312029c0462 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:05.407726 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f72bc8-9541-47d3-b270-516ecf5275b5 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:05.438305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f4c25-6c70-479d-b89f-23c28af10898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:05.439328 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f4c25-6c70-479d-b89f-23c28af10898 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:05.440402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f4c25-6c70-479d-b89f-23c28af10898 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:05.440938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f4c25-6c70-479d-b89f-23c28af10898 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:05.442428 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f4c25-6c70-479d-b89f-23c28af10898 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:05.442956 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f4c25-6c70-479d-b89f-23c28af10898 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:05.447751 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f4c25-6c70-479d-b89f-23c28af10898 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:05.476947 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 243/488] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:05.479329 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4edcc-b623-4a5c-b0c4-3b543fab89ff None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:05.479795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4edcc-b623-4a5c-b0c4-3b543fab89ff None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:05.480262 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4edcc-b623-4a5c-b0c4-3b543fab89ff None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:05.481190 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff35c9-3665-477f-82b9-0405b1acec24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:05.482291 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff35c9-3665-477f-82b9-0405b1acec24 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:05.482832 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 244/489] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:05.483211 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff35c9-3665-477f-82b9-0405b1acec24 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:05.483712 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff35c9-3665-477f-82b9-0405b1acec24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:05.484327 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4edcc-b623-4a5c-b0c4-3b543fab89ff None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:05.509140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff35c9-3665-477f-82b9-0405b1acec24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:26:05.520743 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-21ff35c9-3665-477f-82b9-0405b1acec24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:05.520743 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:05.520743 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:05.520743 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:05.520743 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:05.520743 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:05.520743 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:05.520743 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:05.520743 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:05.520743 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:05.520743 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:05.520743 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:05.520743 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:26:05.520743 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:26:05.520743 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:26:05.520743 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:26:05.521730 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:26:05.521730 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:26:05.521730 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:26:05.521730 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:26:05.521730 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:05.521730 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:05.521730 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:05.521730 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:05.521730 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:05.521730 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:05.521730 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:05.521730 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:05.521730 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:05.521730 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:05.521730 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:05.521730 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:05.522574 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:05.522574 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:05.522574 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:05.522574 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:05.522574 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:26:05.522574 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:26:05.522574 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:26:05.522574 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:26:05.522574 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:26:05.522574 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:26:05.522574 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:05.522574 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:05.529892 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 246/490] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Sep 11 08:26:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:26:05.532484 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b347f8-7380-4935-810b-39c122fd0d56 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:05.532997 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b347f8-7380-4935-810b-39c122fd0d56 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:05.533474 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b347f8-7380-4935-810b-39c122fd0d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:05.572787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:05.578986 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-b9b347f8-7380-4935-810b-39c122fd0d56 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:05.582286 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b9b347f8-7380-4935-810b-39c122fd0d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:05.617524 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:05.699469 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4edcc-b623-4a5c-b0c4-3b543fab89ff None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:05.716910 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 247/491] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:26:05.718249 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b347f8-7380-4935-810b-39c122fd0d56 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:05.769929 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87326325-1524-4258-9846-a6e1066a4ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:05.771078 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87326325-1524-4258-9846-a6e1066a4ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:05.772988 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87326325-1524-4258-9846-a6e1066a4ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:05.773490 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87326325-1524-4258-9846-a6e1066a4ac0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:05.799003 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87326325-1524-4258-9846-a6e1066a4ac0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:05.801352 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87326325-1524-4258-9846-a6e1066a4ac0 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:05.819933 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-87326325-1524-4258-9846-a6e1066a4ac0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 08:26:05.819933 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:05.819933 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:05.819933 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:05.819933 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:05.819933 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:05.819933 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:05.819933 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:05.819933 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:05.819933 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:05.819933 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:05.819933 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:05.819933 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:26:05.819933 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:26:05.819933 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:26:05.819933 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:26:05.821052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:05.821052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:05.821052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:26:05.821052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:05.821052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:26:05.821052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:05.821052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:05.821052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:05.821052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:05.821052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:05.821052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:05.821052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:05.821052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:05.821052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:05.821052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:05.821052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:05.821052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:05.821052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:05.822004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:05.822004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:05.822004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:26:05.822004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:26:05.822004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:26:05.822004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:26:05.822004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:26:05.822004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:26:05.822004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 08:26:05.822004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:05.824705 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 245/492] 10.222.0.26 () {56 vars in 1093 bytes} [Sun Sep 11 08:26:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:05.826589 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20f88b-4b34-47c4-9e79-51a9e97373d1 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:05.827198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20f88b-4b34-47c4-9e79-51a9e97373d1 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:05.827967 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20f88b-4b34-47c4-9e79-51a9e97373d1 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:05.830146 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 246/493] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:05.831462 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20f88b-4b34-47c4-9e79-51a9e97373d1 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:05.918921 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b347f8-7380-4935-810b-39c122fd0d56 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:05.946146 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:05.951530 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20f88b-4b34-47c4-9e79-51a9e97373d1 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:05.970759 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08bdc14-b403-48fb-8d14-b2da1dffbe19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:05.971472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bdc14-b403-48fb-8d14-b2da1dffbe19 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:05.971755 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bdc14-b403-48fb-8d14-b2da1dffbe19 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:05.972025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bdc14-b403-48fb-8d14-b2da1dffbe19 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:05.972707 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08bdc14-b403-48fb-8d14-b2da1dffbe19 None admin] RBAC: Adding query filter params (name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:05.973009 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08bdc14-b403-48fb-8d14-b2da1dffbe19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:05.974550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08bdc14-b403-48fb-8d14-b2da1dffbe19 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:05.988967 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 248/494] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Sep 11 08:26:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:05.990426 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de627f2d-8974-45dc-857c-044e07f68586 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:05.990718 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de627f2d-8974-45dc-857c-044e07f68586 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:05.991101 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de627f2d-8974-45dc-857c-044e07f68586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:05.992480 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8f55f-25b3-4542-80a1-264cdaa2b609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:05.993352 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8f55f-25b3-4542-80a1-264cdaa2b609 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:05.993831 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8f55f-25b3-4542-80a1-264cdaa2b609 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:05.994300 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8f55f-25b3-4542-80a1-264cdaa2b609 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:05.995241 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8f55f-25b3-4542-80a1-264cdaa2b609 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:05.995797 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8f55f-25b3-4542-80a1-264cdaa2b609 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:05.997514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8f55f-25b3-4542-80a1-264cdaa2b609 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:06.011827 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-de627f2d-8974-45dc-857c-044e07f68586 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:06.012192 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-de627f2d-8974-45dc-857c-044e07f68586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:06.026192 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:06.039336 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 247/495] 10.222.0.26 () {56 vars in 1133 bytes} [Sun Sep 11 08:26:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:06.039789 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8f55f-25b3-4542-80a1-264cdaa2b609 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:06.121225 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 249/496] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:26:06.122039 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de627f2d-8974-45dc-857c-044e07f68586 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:06.198527 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8f55f-25b3-4542-80a1-264cdaa2b609 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:06.236267 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3166c0-39b7-43c5-96a1-ddf9a96cd180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:06.237076 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3166c0-39b7-43c5-96a1-ddf9a96cd180 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:06.237363 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3166c0-39b7-43c5-96a1-ddf9a96cd180 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:06.237651 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3166c0-39b7-43c5-96a1-ddf9a96cd180 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:06.249570 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3166c0-39b7-43c5-96a1-ddf9a96cd180 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:06.250830 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de627f2d-8974-45dc-857c-044e07f68586 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:06.251091 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3166c0-39b7-43c5-96a1-ddf9a96cd180 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:06.268419 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-bd3166c0-39b7-43c5-96a1-ddf9a96cd180 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:06.268419 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:06.268419 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:06.268419 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:06.268419 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:06.268419 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:06.268419 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:06.268419 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:06.268419 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:06.268419 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:06.268419 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:06.268419 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:06.268419 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:06.268419 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:06.268419 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:06.268419 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:06.269408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:06.269408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:06.269408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:06.269408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:06.269408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:06.269408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:06.269408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:06.269408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:06.269408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:06.269408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:06.269408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:06.269408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:06.269408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:06.269408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:06.269408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:06.269408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:06.269408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:06.270245 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:06.270245 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:06.270245 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:06.270245 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 248/497] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:06.270470 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3166c0-39b7-43c5-96a1-ddf9a96cd180 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:06.284571 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:06.297816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572627c4-7ea2-40ea-b1cd-4e3707ece494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:06.299421 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572627c4-7ea2-40ea-b1cd-4e3707ece494 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:06.299421 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572627c4-7ea2-40ea-b1cd-4e3707ece494 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:06.299421 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572627c4-7ea2-40ea-b1cd-4e3707ece494 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:06.312364 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572627c4-7ea2-40ea-b1cd-4e3707ece494 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:26:06.317404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-572627c4-7ea2-40ea-b1cd-4e3707ece494 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:06.317404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:06.317404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:06.317404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:06.317404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:06.317404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:06.317404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:06.317404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:06.317404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:06.317404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:06.317404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:06.317404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:06.317404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:26:06.317404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:26:06.317404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:26:06.317404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:26:06.318384 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:26:06.318384 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:26:06.318384 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:26:06.318384 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:26:06.318384 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:06.318384 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:06.318384 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:06.318384 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:06.318384 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:06.318384 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:06.318384 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:06.318384 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:06.318384 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:06.318384 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:06.318384 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:06.318384 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:06.319768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:06.319768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:06.319768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:06.319768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:06.319768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:26:06.319768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:26:06.319768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:26:06.319768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:26:06.319768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:26:06.319768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:26:06.319768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:06.319768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:06.319768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 250/498] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Sep 11 08:26:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:06.320463 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fe563-f1da-4b5f-b9ca-f807a9130e3b None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:06.321031 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fe563-f1da-4b5f-b9ca-f807a9130e3b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:06.321031 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fe563-f1da-4b5f-b9ca-f807a9130e3b None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:06.322481 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 251/499] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:06.323163 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3fe563-f1da-4b5f-b9ca-f807a9130e3b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:06.336438 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:06.450718 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3166c0-39b7-43c5-96a1-ddf9a96cd180 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:06.462740 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3fe563-f1da-4b5f-b9ca-f807a9130e3b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:06.496996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ae3e7-8ffd-4132-970e-fa6696dc5c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:06.497673 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ae3e7-8ffd-4132-970e-fa6696dc5c1a None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:06.497980 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ae3e7-8ffd-4132-970e-fa6696dc5c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:06.498412 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ae3e7-8ffd-4132-970e-fa6696dc5c1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:06.513879 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620393e8-0550-49d4-b14c-28348f65a3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:06.514574 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620393e8-0550-49d4-b14c-28348f65a3c5 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:06.514857 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620393e8-0550-49d4-b14c-28348f65a3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:06.515573 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620393e8-0550-49d4-b14c-28348f65a3c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:06.516345 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620393e8-0550-49d4-b14c-28348f65a3c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:06.517223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620393e8-0550-49d4-b14c-28348f65a3c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:06.519547 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620393e8-0550-49d4-b14c-28348f65a3c5 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:06.534522 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 252/500] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:06.535846 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ca83e-661b-4ed5-8ecb-8a2bacfe72d1 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:06.536130 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ca83e-661b-4ed5-8ecb-8a2bacfe72d1 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:06.536406 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ca83e-661b-4ed5-8ecb-8a2bacfe72d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:06.556305 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-b09ca83e-661b-4ed5-8ecb-8a2bacfe72d1 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:06.557834 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b09ca83e-661b-4ed5-8ecb-8a2bacfe72d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:06.586352 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ae3e7-8ffd-4132-970e-fa6696dc5c1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:06.587859 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ae3e7-8ffd-4132-970e-fa6696dc5c1a None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:06.598368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:06.637312 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:06.645233 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 253/501] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:26:06.646083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ca83e-661b-4ed5-8ecb-8a2bacfe72d1 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:06.760909 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 249/502] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:26:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 08:26:06.760909 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ae3e7-8ffd-4132-970e-fa6696dc5c1a None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:06.813948 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ca83e-661b-4ed5-8ecb-8a2bacfe72d1 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:06.876120 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa69d16-402d-417c-92fd-6536d11b58b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:06.877345 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa69d16-402d-417c-92fd-6536d11b58b2 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:06.877805 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa69d16-402d-417c-92fd-6536d11b58b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:06.878258 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa69d16-402d-417c-92fd-6536d11b58b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:06.879417 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa69d16-402d-417c-92fd-6536d11b58b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:06.879936 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa69d16-402d-417c-92fd-6536d11b58b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:06.882320 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa69d16-402d-417c-92fd-6536d11b58b2 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:06.896000 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 254/503] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Sep 11 08:26:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:06.898194 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa69d16-402d-417c-92fd-6536d11b58b2 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:06.931797 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ae3e7-8ffd-4132-970e-fa6696dc5c1a None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:06.945625 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:06.973651 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:06.976803 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af14968-553d-4a91-8a5d-352892890c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:06.977561 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af14968-553d-4a91-8a5d-352892890c4e None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:06.977915 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af14968-553d-4a91-8a5d-352892890c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:06.978355 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af14968-553d-4a91-8a5d-352892890c4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:06.991975 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af14968-553d-4a91-8a5d-352892890c4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:26:06.997104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-3af14968-553d-4a91-8a5d-352892890c4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:06.997104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:06.997104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:06.997104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:06.997104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:06.997104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:06.997104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:06.997104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:06.997104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:06.997104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:06.997104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:06.997104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:06.997104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:26:06.997104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:26:06.997104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:26:06.997104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:26:06.998139 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:26:06.998139 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:26:06.998139 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:26:06.998139 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:26:06.998139 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:06.998139 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:06.998139 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:06.998139 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:06.998139 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:06.998139 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:06.998139 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:06.998139 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:06.998139 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:06.998139 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:06.998139 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:06.998139 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:06.998949 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:06.998949 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:06.998949 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:06.998949 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:06.998949 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:26:06.998949 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:26:06.998949 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:26:06.998949 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:26:06.998949 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:26:06.998949 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:26:06.998949 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:06.998949 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:06.998949 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 250/504] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Sep 11 08:26:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:06.999650 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af14968-553d-4a91-8a5d-352892890c4e None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:07.031282 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa69d16-402d-417c-92fd-6536d11b58b2 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:07.077785 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55329dec-982f-428b-b40d-9f6680c9ec64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:07.079053 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55329dec-982f-428b-b40d-9f6680c9ec64 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:07.079555 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55329dec-982f-428b-b40d-9f6680c9ec64 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:07.080005 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55329dec-982f-428b-b40d-9f6680c9ec64 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:07.093591 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55329dec-982f-428b-b40d-9f6680c9ec64 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:07.096268 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55329dec-982f-428b-b40d-9f6680c9ec64 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:07.118533 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-55329dec-982f-428b-b40d-9f6680c9ec64 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 08:26:07.118533 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:07.118533 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:07.118533 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:07.118533 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:07.118533 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:07.118533 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:07.118533 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:07.118533 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:07.118533 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:07.118533 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:07.118533 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:07.118533 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:26:07.118533 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:26:07.118533 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:26:07.118533 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:26:07.119635 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:07.119635 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:07.119635 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:26:07.119635 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:07.119635 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:26:07.119635 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:07.119635 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:07.119635 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:07.119635 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:07.119635 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:07.119635 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:07.119635 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:07.119635 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:07.119635 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:07.119635 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:07.119635 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:07.119635 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:07.119635 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:07.120551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:07.120551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:07.120551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:26:07.120551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:26:07.120551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:26:07.120551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:26:07.120551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:26:07.120551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:26:07.120551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 08:26:07.120551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:07.120551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 255/505] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:26:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:07.121267 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55329dec-982f-428b-b40d-9f6680c9ec64 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:07.141601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af14968-553d-4a91-8a5d-352892890c4e None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:07.180132 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4429b-3846-4049-b3f4-ba6d1f248d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:07.181210 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4429b-3846-4049-b3f4-ba6d1f248d02 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:07.181730 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4429b-3846-4049-b3f4-ba6d1f248d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:07.182236 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4429b-3846-4049-b3f4-ba6d1f248d02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:07.202622 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd4429b-3846-4049-b3f4-ba6d1f248d02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:07.205750 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd4429b-3846-4049-b3f4-ba6d1f248d02 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:07.222585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-3dd4429b-3846-4049-b3f4-ba6d1f248d02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:07.222585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:07.222585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:07.222585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:07.222585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:07.222585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:07.222585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:07.222585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:07.222585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:07.222585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:07.222585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:07.222585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:07.222585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:07.222585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:07.222585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:07.222585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:07.224281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:07.224281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:07.224281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:07.224281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:07.224281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:07.224281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:07.224281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:07.224281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:07.224281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:07.224281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:07.224281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:07.224281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:07.224281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:07.224281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:07.224281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:07.224281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:07.224281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:07.225999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:07.225999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:07.225999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:07.225999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 251/506] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:07.225999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4429b-3846-4049-b3f4-ba6d1f248d02 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:07.248770 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:07.250553 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55329dec-982f-428b-b40d-9f6680c9ec64 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:07.268664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:07.287106 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcec9e5-fe78-404a-82f2-b3f4b4107c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:07.287547 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcec9e5-fe78-404a-82f2-b3f4b4107c79 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:07.288405 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcec9e5-fe78-404a-82f2-b3f4b4107c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:07.288683 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcec9e5-fe78-404a-82f2-b3f4b4107c79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:07.300769 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcec9e5-fe78-404a-82f2-b3f4b4107c79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:07.302586 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcec9e5-fe78-404a-82f2-b3f4b4107c79 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:07.319551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-5dcec9e5-fe78-404a-82f2-b3f4b4107c79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:07.319551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:07.319551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:07.319551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:07.319551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:07.319551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:07.319551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:07.319551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:07.319551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:07.319551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:07.319551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:07.319551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:07.319551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:07.319551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:07.319551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:07.319551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:07.320550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:07.320550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:07.320550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:07.320550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:07.320550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:07.320550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:07.320550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:07.320550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:07.320550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:07.320550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:07.320550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:07.320550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:07.320550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:07.320550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:07.320550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:07.320550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:07.320550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:07.321419 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:07.321419 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:07.321419 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:07.321419 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 256/507] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:07.321632 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcec9e5-fe78-404a-82f2-b3f4b4107c79 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:07.349502 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4429b-3846-4049-b3f4-ba6d1f248d02 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:07.386004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c486da-99e6-4a7e-ab6b-70a45e94f717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:07.386655 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c486da-99e6-4a7e-ab6b-70a45e94f717 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:07.386937 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c486da-99e6-4a7e-ab6b-70a45e94f717 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:07.387215 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c486da-99e6-4a7e-ab6b-70a45e94f717 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:07.399473 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c486da-99e6-4a7e-ab6b-70a45e94f717 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:07.400944 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c486da-99e6-4a7e-ab6b-70a45e94f717 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:07.416461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-d3c486da-99e6-4a7e-ab6b-70a45e94f717 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:07.416461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:07.416461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:07.416461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:07.416461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:07.416461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:07.416461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:07.416461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:07.416461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:07.416461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:07.416461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:07.416461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:07.416461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:07.416461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:07.416461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:07.416461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:07.418216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:07.418216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:07.418216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:07.418216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:07.418216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:07.418216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:07.418216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:07.418216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:07.418216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:07.418216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:07.418216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:07.418216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:07.418216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:07.418216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:07.418216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:07.418216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:07.418216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:07.420308 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:07.420308 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:07.420308 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:07.420308 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 252/508] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:07.420308 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c486da-99e6-4a7e-ab6b-70a45e94f717 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:07.437855 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcec9e5-fe78-404a-82f2-b3f4b4107c79 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:07.475554 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4675f0c-0911-41e6-a6cd-7fa555e9e77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:07.476169 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4675f0c-0911-41e6-a6cd-7fa555e9e77f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:07.476454 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4675f0c-0911-41e6-a6cd-7fa555e9e77f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:07.476721 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4675f0c-0911-41e6-a6cd-7fa555e9e77f None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:07.477515 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4675f0c-0911-41e6-a6cd-7fa555e9e77f None admin] RBAC: Adding query filter params (name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:07.478569 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4675f0c-0911-41e6-a6cd-7fa555e9e77f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:07.479132 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4675f0c-0911-41e6-a6cd-7fa555e9e77f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:07.489275 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 257/509] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Sep 11 08:26:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:07.490136 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4675f0c-0911-41e6-a6cd-7fa555e9e77f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:07.512439 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:07.523712 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:07.543316 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c486da-99e6-4a7e-ab6b-70a45e94f717 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:07.587558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64088a-c29b-4c1a-8cb9-4047c13971a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:07.588168 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64088a-c29b-4c1a-8cb9-4047c13971a2 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:07.588446 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64088a-c29b-4c1a-8cb9-4047c13971a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:07.588796 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64088a-c29b-4c1a-8cb9-4047c13971a2 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:07.589565 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64088a-c29b-4c1a-8cb9-4047c13971a2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:07.589886 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64088a-c29b-4c1a-8cb9-4047c13971a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:07.591359 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64088a-c29b-4c1a-8cb9-4047c13971a2 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:07.601762 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4675f0c-0911-41e6-a6cd-7fa555e9e77f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:07.609550 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 253/510] 10.222.0.26 () {56 vars in 1137 bytes} [Sun Sep 11 08:26:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:07.610411 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64088a-c29b-4c1a-8cb9-4047c13971a2 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:07.639503 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab108d-0433-42b8-bae7-2897329ddfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:07.640312 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab108d-0433-42b8-bae7-2897329ddfc8 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:07.640465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab108d-0433-42b8-bae7-2897329ddfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:07.640781 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab108d-0433-42b8-bae7-2897329ddfc8 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:07.641390 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab108d-0433-42b8-bae7-2897329ddfc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:07.641697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab108d-0433-42b8-bae7-2897329ddfc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:07.643116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab108d-0433-42b8-bae7-2897329ddfc8 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:07.656817 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 258/511] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:07.657675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab108d-0433-42b8-bae7-2897329ddfc8 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:07.729303 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64088a-c29b-4c1a-8cb9-4047c13971a2 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:07.760370 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:07.763925 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:07.768802 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820cdb60-a02c-485b-bef3-f5611372482b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:07.769430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cdb60-a02c-485b-bef3-f5611372482b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:07.769786 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cdb60-a02c-485b-bef3-f5611372482b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:07.770142 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cdb60-a02c-485b-bef3-f5611372482b None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:07.770806 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820cdb60-a02c-485b-bef3-f5611372482b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:07.771113 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820cdb60-a02c-485b-bef3-f5611372482b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:07.773116 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820cdb60-a02c-485b-bef3-f5611372482b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:07.773620 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab108d-0433-42b8-bae7-2897329ddfc8 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:07.786612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 254/512] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:07.788398 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820cdb60-a02c-485b-bef3-f5611372482b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:07.812384 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4b001-22c9-4233-aee2-4aa27a5af22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:07.812921 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4b001-22c9-4233-aee2-4aa27a5af22c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:07.813204 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4b001-22c9-4233-aee2-4aa27a5af22c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:07.813480 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4b001-22c9-4233-aee2-4aa27a5af22c None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:07.814152 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d4b001-22c9-4233-aee2-4aa27a5af22c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:07.814759 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d4b001-22c9-4233-aee2-4aa27a5af22c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:07.816996 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d4b001-22c9-4233-aee2-4aa27a5af22c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:07.834418 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 259/513] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:07.835338 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4b001-22c9-4233-aee2-4aa27a5af22c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:07.907001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820cdb60-a02c-485b-bef3-f5611372482b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:07.945365 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3c838-3492-4901-9dd9-06e1cbe37e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:07.946018 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3c838-3492-4901-9dd9-06e1cbe37e40 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:07.946299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3c838-3492-4901-9dd9-06e1cbe37e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:07.946572 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3c838-3492-4901-9dd9-06e1cbe37e40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:07.959409 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3c838-3492-4901-9dd9-06e1cbe37e40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:07.961356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3c838-3492-4901-9dd9-06e1cbe37e40 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:07.966879 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4b001-22c9-4233-aee2-4aa27a5af22c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:07.977046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-09b3c838-3492-4901-9dd9-06e1cbe37e40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:07.977046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:07.977046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:07.977046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:07.977046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:07.977046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:07.977046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:07.977046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:07.977046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:07.977046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:07.977046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:07.977046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:07.977046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:07.977046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:07.977046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:07.977046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:07.978120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:07.978120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:07.978120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:07.978120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:07.978120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:07.978120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:07.978120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:07.978120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:07.978120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:07.978120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:07.978120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:07.978120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:07.978120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:07.978120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:07.978120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:07.978120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:07.978120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:07.978993 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:07.978993 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:07.978993 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:07.978993 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 255/514] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:07.979469 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3c838-3492-4901-9dd9-06e1cbe37e40 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:08.016728 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b147cae-5f28-4786-bed9-c65dda5bfbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:08.017700 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b147cae-5f28-4786-bed9-c65dda5bfbb3 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:08.018170 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b147cae-5f28-4786-bed9-c65dda5bfbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:08.018671 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b147cae-5f28-4786-bed9-c65dda5bfbb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:08.028203 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:08.054008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:08.098324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3c838-3492-4901-9dd9-06e1cbe37e40 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:08.117626 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b147cae-5f28-4786-bed9-c65dda5bfbb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:08.119290 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b147cae-5f28-4786-bed9-c65dda5bfbb3 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:08.148972 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882a575-536c-4392-846a-391540cd10c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:08.150045 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882a575-536c-4392-846a-391540cd10c2 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:08.150543 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882a575-536c-4392-846a-391540cd10c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:08.151035 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882a575-536c-4392-846a-391540cd10c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:08.162769 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882a575-536c-4392-846a-391540cd10c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:08.165289 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882a575-536c-4392-846a-391540cd10c2 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:08.187533 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-3882a575-536c-4392-846a-391540cd10c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:08.187533 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:08.187533 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:08.187533 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:08.187533 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:08.187533 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:08.187533 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:08.187533 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:08.187533 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:08.187533 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:08.187533 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:08.187533 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:08.187533 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:26:08.187533 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:26:08.187533 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:26:08.189319 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:26:08.189319 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:08.189319 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:08.189319 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:08.189319 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:08.189319 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:08.189319 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:08.189319 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:08.189319 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:08.189319 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:08.189319 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:08.189319 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:08.189319 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:08.189319 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:08.189319 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:08.189319 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:08.189319 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:08.191347 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:26:08.191347 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:26:08.191347 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:26:08.191347 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:26:08.191347 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:26:08.191347 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:26:08.191347 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:08.191347 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:08.191347 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 256/515] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:26:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:08.191347 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882a575-536c-4392-846a-391540cd10c2 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:08.247983 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 260/516] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:26:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 08:26:08.248842 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b147cae-5f28-4786-bed9-c65dda5bfbb3 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:08.314697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:08.319240 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882a575-536c-4392-846a-391540cd10c2 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:08.321229 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:08.362633 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c894c12-f28f-4f22-bb8f-7ad3090411d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:08.363192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c894c12-f28f-4f22-bb8f-7ad3090411d4 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:08.363567 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c894c12-f28f-4f22-bb8f-7ad3090411d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:08.363845 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c894c12-f28f-4f22-bb8f-7ad3090411d4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:08.376953 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c894c12-f28f-4f22-bb8f-7ad3090411d4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:08.379597 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c894c12-f28f-4f22-bb8f-7ad3090411d4 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:08.380205 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b147cae-5f28-4786-bed9-c65dda5bfbb3 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:08.396016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-2c894c12-f28f-4f22-bb8f-7ad3090411d4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 08:26:08.396016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:08.396016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:08.396016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:08.396016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:08.396016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:08.396016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:08.396016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:08.396016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:08.396016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:08.396016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:08.396016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:08.396016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:26:08.396016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:26:08.396016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:26:08.396016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:26:08.397970 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:08.397970 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:08.397970 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:26:08.397970 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:08.397970 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:26:08.397970 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:08.397970 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:08.397970 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:08.397970 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:08.397970 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:08.397970 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:08.397970 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:08.397970 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:08.397970 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:08.397970 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:08.397970 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:08.397970 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:08.397970 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:08.399864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:08.399864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:08.399864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:26:08.399864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:26:08.399864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:26:08.399864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:26:08.399864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:26:08.399864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:26:08.399864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 08:26:08.399864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:08.399864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 257/517] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Sep 11 08:26:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:08.399864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c894c12-f28f-4f22-bb8f-7ad3090411d4 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:08.434003 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1432960-c39a-4f8b-b575-f76043c94fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:08.435174 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1432960-c39a-4f8b-b575-f76043c94fed None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:08.435738 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1432960-c39a-4f8b-b575-f76043c94fed None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:08.436242 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1432960-c39a-4f8b-b575-f76043c94fed None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:08.437405 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1432960-c39a-4f8b-b575-f76043c94fed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:08.439942 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1432960-c39a-4f8b-b575-f76043c94fed None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:08.504408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c894c12-f28f-4f22-bb8f-7ad3090411d4 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:08.541135 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3549f8e-7354-4c79-9bea-8c192c0d76d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:08.541755 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3549f8e-7354-4c79-9bea-8c192c0d76d2 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:08.542031 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3549f8e-7354-4c79-9bea-8c192c0d76d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:08.542308 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3549f8e-7354-4c79-9bea-8c192c0d76d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:08.542958 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3549f8e-7354-4c79-9bea-8c192c0d76d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:08.543269 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3549f8e-7354-4c79-9bea-8c192c0d76d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:08.544694 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3549f8e-7354-4c79-9bea-8c192c0d76d2 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:08.558043 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 258/518] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:08.570850 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3549f8e-7354-4c79-9bea-8c192c0d76d2 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:08.570998 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 261/519] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Sep 11 08:26:08 2022] POST /identity/v3/users => generated 247 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:26:08.570998 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1432960-c39a-4f8b-b575-f76043c94fed None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:08.602057 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:08.714680 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3549f8e-7354-4c79-9bea-8c192c0d76d2 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:08.715496 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1432960-c39a-4f8b-b575-f76043c94fed None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:08.729264 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:08.761209 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab71e9-09a6-4f1e-99c3-b29d6b0fea1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:08.763115 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab71e9-09a6-4f1e-99c3-b29d6b0fea1f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:08.763472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab71e9-09a6-4f1e-99c3-b29d6b0fea1f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:08.763719 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3dec0-0859-4dbd-a868-9e713a6b645b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:08.764664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab71e9-09a6-4f1e-99c3-b29d6b0fea1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:08.764782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3dec0-0859-4dbd-a868-9e713a6b645b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:08.764992 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3dec0-0859-4dbd-a868-9e713a6b645b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:08.765276 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3dec0-0859-4dbd-a868-9e713a6b645b None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:08.765999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3dec0-0859-4dbd-a868-9e713a6b645b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:08.767133 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3dec0-0859-4dbd-a868-9e713a6b645b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:08.768579 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3dec0-0859-4dbd-a868-9e713a6b645b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:08.778433 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab71e9-09a6-4f1e-99c3-b29d6b0fea1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:08.780335 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab71e9-09a6-4f1e-99c3-b29d6b0fea1f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:08.792684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 259/520] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:26:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:08.795682 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3dec0-0859-4dbd-a868-9e713a6b645b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:08.804295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-16ab71e9-09a6-4f1e-99c3-b29d6b0fea1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:08.804295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:08.804295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:08.804295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:08.804295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:08.804295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:08.804295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:08.804295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:08.804295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:08.804295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:08.804295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:08.804295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:08.804295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:08.804295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:08.804295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:08.804295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:08.805456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:08.805456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:08.805456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:08.805456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:08.805456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:08.805456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:08.805456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:08.805456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:08.805456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:08.805456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:08.805456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:08.805456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:08.805456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:08.805456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:08.805456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:08.805456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:08.805456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:08.807032 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:08.807032 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:08.807032 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:08.807032 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 262/521] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:08.807032 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab71e9-09a6-4f1e-99c3-b29d6b0fea1f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:08.924807 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab71e9-09a6-4f1e-99c3-b29d6b0fea1f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:08.930290 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:08.961052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3dec0-0859-4dbd-a868-9e713a6b645b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:08.965553 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2129485-f0a0-40fe-a73a-62c0ad43c6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:08.966284 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2129485-f0a0-40fe-a73a-62c0ad43c6c7 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:08.966569 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2129485-f0a0-40fe-a73a-62c0ad43c6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:08.966844 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2129485-f0a0-40fe-a73a-62c0ad43c6c7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:08.976011 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2129485-f0a0-40fe-a73a-62c0ad43c6c7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:08.977498 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2129485-f0a0-40fe-a73a-62c0ad43c6c7 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:08.990083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-b2129485-f0a0-40fe-a73a-62c0ad43c6c7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 11 08:26:08.990083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:08.990083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:08.990083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:08.990083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:08.990083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:08.990083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:08.990083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:08.990083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:08.990083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:08.990083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:08.990083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:08.990083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:26:08.990083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:26:08.990083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:26:08.990083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:26:08.991032 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:08.991032 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:08.991032 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:26:08.991032 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:08.991032 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:26:08.991032 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:08.991032 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:08.991032 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:08.991032 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:08.991032 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:08.991032 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:08.991032 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:08.991032 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:08.991032 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:08.991032 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:08.991032 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:08.991032 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:08.991032 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:08.996727 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:08.996727 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:08.996727 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:26:08.996727 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:26:08.996727 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:26:08.996727 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:26:08.996727 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:26:08.996727 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:26:08.996727 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 11 08:26:08.996727 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:08.996727 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 263/522] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:26:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:08.996727 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2129485-f0a0-40fe-a73a-62c0ad43c6c7 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:09.020694 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8708f1-34d1-4c64-8263-ec7b12822dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:09.020912 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:09.021310 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8708f1-34d1-4c64-8263-ec7b12822dec None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:09.021830 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8708f1-34d1-4c64-8263-ec7b12822dec None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:09.021964 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8708f1-34d1-4c64-8263-ec7b12822dec None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:09.023267 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8708f1-34d1-4c64-8263-ec7b12822dec None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:09.023591 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8708f1-34d1-4c64-8263-ec7b12822dec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:09.025048 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8708f1-34d1-4c64-8263-ec7b12822dec None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:09.045743 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 260/523] 10.222.0.26 () {56 vars in 1139 bytes} [Sun Sep 11 08:26:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:09.046777 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8708f1-34d1-4c64-8263-ec7b12822dec None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:09.141940 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2129485-f0a0-40fe-a73a-62c0ad43c6c7 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:09.172377 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8708f1-34d1-4c64-8263-ec7b12822dec None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:09.180081 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bfc61-c607-4408-88e0-ded50e71e0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:09.180081 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bfc61-c607-4408-88e0-ded50e71e0c0 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:09.180081 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bfc61-c607-4408-88e0-ded50e71e0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:09.183393 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bfc61-c607-4408-88e0-ded50e71e0c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:09.183393 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721bfc61-c607-4408-88e0-ded50e71e0c0 None admin] RBAC: Adding query filter params (role.id=b936dc45662c4ac195fdbf9e8ac589b0, scope.project.id=b6ed5f989f4248d7bab2548eb350fe17, user.id=e62bb9d2e13649b5af239bb56001ce16) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:09.183393 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721bfc61-c607-4408-88e0-ded50e71e0c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:09.183393 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721bfc61-c607-4408-88e0-ded50e71e0c0 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:09.188941 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 264/524] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:26:08 2022] GET /identity/v3/role_assignments?user.id=e62bb9d2e13649b5af239bb56001ce16&scope.project.id=b6ed5f989f4248d7bab2548eb350fe17&role.id=b936dc45662c4ac195fdbf9e8ac589b0 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:09.200266 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bfc61-c607-4408-88e0-ded50e71e0c0 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:09.222736 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b506697-71c7-4f1b-beb2-7acd081723d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:09.223436 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b506697-71c7-4f1b-beb2-7acd081723d3 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:09.223714 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b506697-71c7-4f1b-beb2-7acd081723d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:09.224046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b506697-71c7-4f1b-beb2-7acd081723d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:09.224788 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b506697-71c7-4f1b-beb2-7acd081723d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:09.225137 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b506697-71c7-4f1b-beb2-7acd081723d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:09.226642 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b506697-71c7-4f1b-beb2-7acd081723d3 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:09.237657 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:09.242493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 261/525] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:09.243757 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b506697-71c7-4f1b-beb2-7acd081723d3 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:09.342488 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:09.367993 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bfc61-c607-4408-88e0-ded50e71e0c0 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:09.398326 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b506697-71c7-4f1b-beb2-7acd081723d3 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:09.424366 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f962e-991c-4f4c-998f-772e185b6f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:09.425003 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f962e-991c-4f4c-998f-772e185b6f16 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:09.425284 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f962e-991c-4f4c-998f-772e185b6f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:09.425556 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f962e-991c-4f4c-998f-772e185b6f16 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:09.426606 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f962e-991c-4f4c-998f-772e185b6f16 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:09.426919 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f962e-991c-4f4c-998f-772e185b6f16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:09.429005 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f962e-991c-4f4c-998f-772e185b6f16 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:09.450114 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e68988-df6e-43ab-8ff8-8dc38088ba10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:09.451121 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e68988-df6e-43ab-8ff8-8dc38088ba10 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:09.451824 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e68988-df6e-43ab-8ff8-8dc38088ba10 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:09.452255 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e68988-df6e-43ab-8ff8-8dc38088ba10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:09.477339 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 265/526] 10.222.0.26 () {56 vars in 1137 bytes} [Sun Sep 11 08:26:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:09.478371 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f962e-991c-4f4c-998f-772e185b6f16 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:09.557012 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:09.561379 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e68988-df6e-43ab-8ff8-8dc38088ba10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:09.563618 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e68988-df6e-43ab-8ff8-8dc38088ba10 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:09.618455 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f962e-991c-4f4c-998f-772e185b6f16 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:09.665991 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544b603-9d71-45ed-90d7-0b597965e7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:09.667607 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544b603-9d71-45ed-90d7-0b597965e7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:09.668046 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544b603-9d71-45ed-90d7-0b597965e7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:09.668462 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544b603-9d71-45ed-90d7-0b597965e7d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:09.680702 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544b603-9d71-45ed-90d7-0b597965e7d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:09.682392 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544b603-9d71-45ed-90d7-0b597965e7d3 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:09.697565 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-4544b603-9d71-45ed-90d7-0b597965e7d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:09.697565 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:09.697565 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:09.697565 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:09.697565 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:09.697565 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:09.697565 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:09.697565 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:09.697565 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:09.697565 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:09.697565 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:09.697565 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:09.697565 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:26:09.697565 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:26:09.697565 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:26:09.698652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:26:09.698652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:09.698652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:09.698652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:09.698652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:09.698652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:09.698652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:09.698652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:09.698652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:09.698652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:09.698652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:09.698652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:09.698652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:09.698652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:09.698652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:09.698652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:09.698652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:09.699519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:26:09.699519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:26:09.699519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:26:09.699519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:26:09.699519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:26:09.699519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:26:09.699519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:09.699519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:09.701960 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 266/527] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:26:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:09.703385 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544b603-9d71-45ed-90d7-0b597965e7d3 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:09.708278 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:09.730433 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 262/528] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:26:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 08:26:09.731674 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e68988-df6e-43ab-8ff8-8dc38088ba10 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:09.862766 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:09.868139 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e68988-df6e-43ab-8ff8-8dc38088ba10 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:09.876923 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544b603-9d71-45ed-90d7-0b597965e7d3 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:09.912489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5252f6f-13ff-4554-a616-2fb84f6852db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:09.914290 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5252f6f-13ff-4554-a616-2fb84f6852db None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:09.914773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5252f6f-13ff-4554-a616-2fb84f6852db None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:09.915714 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5252f6f-13ff-4554-a616-2fb84f6852db None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:09.916640 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5252f6f-13ff-4554-a616-2fb84f6852db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:09.917432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5252f6f-13ff-4554-a616-2fb84f6852db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:09.919086 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5252f6f-13ff-4554-a616-2fb84f6852db None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:09.936793 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c887c4-f07d-4949-afb0-6dc654337bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:09.937896 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c887c4-f07d-4949-afb0-6dc654337bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:09.938320 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c887c4-f07d-4949-afb0-6dc654337bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:09.938545 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 263/529] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:26:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:09.938752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c887c4-f07d-4949-afb0-6dc654337bc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:09.939971 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5252f6f-13ff-4554-a616-2fb84f6852db None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:10.046340 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c887c4-f07d-4949-afb0-6dc654337bc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:10.048582 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c887c4-f07d-4949-afb0-6dc654337bc7 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:10.051356 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:10.101270 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5252f6f-13ff-4554-a616-2fb84f6852db None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:10.159514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ecb78-c745-46c3-91be-155e231fc8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:10.160538 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ecb78-c745-46c3-91be-155e231fc8c1 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:10.160968 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ecb78-c745-46c3-91be-155e231fc8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:10.161365 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ecb78-c745-46c3-91be-155e231fc8c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:10.176531 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ecb78-c745-46c3-91be-155e231fc8c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:10.178850 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ecb78-c745-46c3-91be-155e231fc8c1 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:10.197575 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-2c4ecb78-c745-46c3-91be-155e231fc8c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:10.197575 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:10.197575 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:10.197575 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:10.197575 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:10.197575 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:10.197575 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:10.197575 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:10.197575 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:10.197575 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:10.197575 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:10.197575 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:10.197575 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:10.197575 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:10.197575 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:10.197575 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:10.198559 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:10.198559 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:10.198559 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:10.198559 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:10.198559 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:10.198559 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:10.198559 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:10.198559 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:10.198559 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:10.198559 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:10.198559 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:10.198559 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:10.198559 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:10.198559 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:10.198559 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:10.198559 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:10.198559 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:10.199447 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:10.199447 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:10.199447 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:10.201424 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 264/530] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:10.203052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ecb78-c745-46c3-91be-155e231fc8c1 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:10.219825 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 267/531] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:26:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 08:26:10.221471 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c887c4-f07d-4949-afb0-6dc654337bc7 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:10.223220 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:10.321173 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ecb78-c745-46c3-91be-155e231fc8c1 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:10.359093 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccdd31-c417-4829-86b1-3e942ad1cfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:10.359974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccdd31-c417-4829-86b1-3e942ad1cfd4 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:10.360428 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccdd31-c417-4829-86b1-3e942ad1cfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:10.360843 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccdd31-c417-4829-86b1-3e942ad1cfd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:10.361730 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ccdd31-c417-4829-86b1-3e942ad1cfd4 None admin] RBAC: Adding query filter params (role.id=b936dc45662c4ac195fdbf9e8ac589b0, scope.project.id=b6ed5f989f4248d7bab2548eb350fe17, user.id=211fa4ad83be44cd8164e0e47278273a) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:10.362191 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ccdd31-c417-4829-86b1-3e942ad1cfd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:10.363914 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ccdd31-c417-4829-86b1-3e942ad1cfd4 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:10.370587 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 265/532] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:26:10 2022] GET /identity/v3/role_assignments?user.id=211fa4ad83be44cd8164e0e47278273a&scope.project.id=b6ed5f989f4248d7bab2548eb350fe17&role.id=b936dc45662c4ac195fdbf9e8ac589b0 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:10.371745 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccdd31-c417-4829-86b1-3e942ad1cfd4 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:10.408124 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c887c4-f07d-4949-afb0-6dc654337bc7 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:10.411178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:10.460984 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:10.472795 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ef8f0-125e-4e06-b4d0-db3b07cab630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:10.473714 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ef8f0-125e-4e06-b4d0-db3b07cab630 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:10.474133 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ef8f0-125e-4e06-b4d0-db3b07cab630 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:10.474544 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ef8f0-125e-4e06-b4d0-db3b07cab630 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:10.475650 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ef8f0-125e-4e06-b4d0-db3b07cab630 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:10.476601 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ef8f0-125e-4e06-b4d0-db3b07cab630 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:10.478594 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ef8f0-125e-4e06-b4d0-db3b07cab630 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:10.490326 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccdd31-c417-4829-86b1-3e942ad1cfd4 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:10.502233 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 268/533] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:10.510892 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ef8f0-125e-4e06-b4d0-db3b07cab630 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:10.567976 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74635b-3d5d-4fb0-92b2-84607fb163a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:10.569553 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74635b-3d5d-4fb0-92b2-84607fb163a4 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:10.570372 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74635b-3d5d-4fb0-92b2-84607fb163a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:10.570812 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74635b-3d5d-4fb0-92b2-84607fb163a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:10.593716 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb74635b-3d5d-4fb0-92b2-84607fb163a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:10.595509 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb74635b-3d5d-4fb0-92b2-84607fb163a4 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:10.612211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-eb74635b-3d5d-4fb0-92b2-84607fb163a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:10.612211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:10.612211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:10.612211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:10.612211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:10.612211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:10.612211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:10.612211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:10.612211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:10.612211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:10.612211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:10.612211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:10.612211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:10.612211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:10.612211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:10.612211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:10.613177 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:10.613177 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:10.613177 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:10.613177 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:10.613177 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:10.613177 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:10.613177 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:10.613177 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:10.613177 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:10.613177 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:10.613177 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:10.613177 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:10.613177 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:10.613177 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:10.613177 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:10.613177 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:10.613177 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:10.614120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:10.614120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:10.614120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:10.616486 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 266/534] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:10.624782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74635b-3d5d-4fb0-92b2-84607fb163a4 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:10.777263 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ef8f0-125e-4e06-b4d0-db3b07cab630 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:10.869336 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e544c-7b10-46b0-8c15-670b5f0e1009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:10.870249 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e544c-7b10-46b0-8c15-670b5f0e1009 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:10.870695 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e544c-7b10-46b0-8c15-670b5f0e1009 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:10.871140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e544c-7b10-46b0-8c15-670b5f0e1009 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:10.878212 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74635b-3d5d-4fb0-92b2-84607fb163a4 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:10.891279 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e544c-7b10-46b0-8c15-670b5f0e1009 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:10.891279 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e544c-7b10-46b0-8c15-670b5f0e1009 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:10.928775 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-147e544c-7b10-46b0-8c15-670b5f0e1009 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:10.928775 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:10.928775 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:10.928775 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:10.928775 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:10.928775 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:10.928775 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:10.928775 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:10.928775 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:10.928775 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:10.928775 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:10.928775 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:10.928775 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:26:10.928775 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:26:10.928775 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:26:10.929691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:26:10.929691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:10.929691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:10.929691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:10.929691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:10.929691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:10.929691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:10.929691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:10.929691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:10.929691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:10.929691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:10.929691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:10.929691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:10.929691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:10.929691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:10.929691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:10.929691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:10.930556 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:26:10.930556 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:26:10.930556 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:26:10.930556 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:26:10.930556 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:26:10.930556 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:26:10.930556 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:10.930556 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:10.931457 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 269/535] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:26:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:10.940434 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e544c-7b10-46b0-8c15-670b5f0e1009 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:10.955893 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:10.982532 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c10f05-9e3d-4705-b7a1-89f8c66863eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:10.983757 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c10f05-9e3d-4705-b7a1-89f8c66863eb None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:10.984251 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c10f05-9e3d-4705-b7a1-89f8c66863eb None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:10.984818 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c10f05-9e3d-4705-b7a1-89f8c66863eb None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:10.986276 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c10f05-9e3d-4705-b7a1-89f8c66863eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:10.987409 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c10f05-9e3d-4705-b7a1-89f8c66863eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:10.989206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c10f05-9e3d-4705-b7a1-89f8c66863eb None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:11.003627 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:11.012280 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 267/536] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:11.020145 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d9e78-a30a-479a-a4f0-41bc74cc29df None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:11.020145 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d9e78-a30a-479a-a4f0-41bc74cc29df None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:11.020145 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d9e78-a30a-479a-a4f0-41bc74cc29df None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:11.020145 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 268/537] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:11.021613 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d9e78-a30a-479a-a4f0-41bc74cc29df None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:11.153619 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d9e78-a30a-479a-a4f0-41bc74cc29df None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:11.214100 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d75e95-8f82-46d8-b959-0ac615abccb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:11.214861 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d75e95-8f82-46d8-b959-0ac615abccb2 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:11.215208 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d75e95-8f82-46d8-b959-0ac615abccb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:11.215578 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d75e95-8f82-46d8-b959-0ac615abccb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:11.216727 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e544c-7b10-46b0-8c15-670b5f0e1009 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:11.224852 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d75e95-8f82-46d8-b959-0ac615abccb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:11.226941 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d75e95-8f82-46d8-b959-0ac615abccb2 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:11.239879 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-12d75e95-8f82-46d8-b959-0ac615abccb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:11.239879 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:11.239879 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:11.239879 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:11.239879 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:11.239879 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:11.239879 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:11.239879 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:11.239879 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:11.239879 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:11.239879 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:11.239879 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:11.239879 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:26:11.239879 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:26:11.239879 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:26:11.242091 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:26:11.242091 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:11.242091 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:11.242091 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:11.242091 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:11.242091 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:11.242091 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:11.242091 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:11.242091 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:11.242091 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:11.242091 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:11.242091 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:11.242091 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:11.242091 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:11.242091 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:11.242091 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:11.242091 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:11.244552 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:26:11.244552 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:26:11.244552 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:26:11.244552 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:26:11.244552 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:26:11.244552 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:26:11.244552 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:11.244552 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:11.246582 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 269/538] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:26:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:11.248074 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798d043-7d88-4767-9863-f2f7d65f8041 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:11.248435 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798d043-7d88-4767-9863-f2f7d65f8041 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:11.248842 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798d043-7d88-4767-9863-f2f7d65f8041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:11.282044 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-4798d043-7d88-4767-9863-f2f7d65f8041 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:11.284846 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4798d043-7d88-4767-9863-f2f7d65f8041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:11.303844 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82deaa-30b4-48bd-bf90-ff4ae4dca225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:11.304950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82deaa-30b4-48bd-bf90-ff4ae4dca225 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:11.305449 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82deaa-30b4-48bd-bf90-ff4ae4dca225 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:11.305939 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82deaa-30b4-48bd-bf90-ff4ae4dca225 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:11.307797 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82deaa-30b4-48bd-bf90-ff4ae4dca225 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:11.308005 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82deaa-30b4-48bd-bf90-ff4ae4dca225 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:11.310921 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82deaa-30b4-48bd-bf90-ff4ae4dca225 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:11.354471 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 270/539] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:26:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:11.356305 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82deaa-30b4-48bd-bf90-ff4ae4dca225 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:11.382653 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:11.433850 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 270/540] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:26:11.435576 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798d043-7d88-4767-9863-f2f7d65f8041 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:11.490497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:11.512060 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82deaa-30b4-48bd-bf90-ff4ae4dca225 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:11.564962 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3bc47-a830-4908-8832-b2d39537000e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:11.565957 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3bc47-a830-4908-8832-b2d39537000e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:11.566440 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3bc47-a830-4908-8832-b2d39537000e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:11.566954 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3bc47-a830-4908-8832-b2d39537000e None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:11.567924 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3bc47-a830-4908-8832-b2d39537000e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:11.568564 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3bc47-a830-4908-8832-b2d39537000e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:11.570324 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3bc47-a830-4908-8832-b2d39537000e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:11.586257 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 271/541] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:26:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:11.592069 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3bc47-a830-4908-8832-b2d39537000e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:11.657451 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798d043-7d88-4767-9863-f2f7d65f8041 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:11.740848 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3ed4b-6982-46f0-a799-2b99398dab38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:11.744673 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3ed4b-6982-46f0-a799-2b99398dab38 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:11.744966 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3ed4b-6982-46f0-a799-2b99398dab38 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:11.745253 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3ed4b-6982-46f0-a799-2b99398dab38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:11.746003 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3ed4b-6982-46f0-a799-2b99398dab38 None admin] RBAC: Adding query filter params (role.id=b936dc45662c4ac195fdbf9e8ac589b0, scope.project.id=b6ed5f989f4248d7bab2548eb350fe17, user.id=7c86ca1e378c4042a1807c7a45aaab99) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:11.746314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3ed4b-6982-46f0-a799-2b99398dab38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:11.747925 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3ed4b-6982-46f0-a799-2b99398dab38 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:11.762989 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 271/542] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:26:11 2022] GET /identity/v3/role_assignments?user.id=7c86ca1e378c4042a1807c7a45aaab99&scope.project.id=b6ed5f989f4248d7bab2548eb350fe17&role.id=b936dc45662c4ac195fdbf9e8ac589b0 => generated 259 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:11.798188 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3bc47-a830-4908-8832-b2d39537000e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:11.843518 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2c219-dfe4-42f1-8aaf-d75a5ac24708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:11.844153 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2c219-dfe4-42f1-8aaf-d75a5ac24708 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:11.844523 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2c219-dfe4-42f1-8aaf-d75a5ac24708 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:11.845006 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2c219-dfe4-42f1-8aaf-d75a5ac24708 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:11.846376 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2c219-dfe4-42f1-8aaf-d75a5ac24708 None admin] RBAC: Adding query filter params (role.id=b936dc45662c4ac195fdbf9e8ac589b0, scope.project.id=b6ed5f989f4248d7bab2548eb350fe17, user.id=7690af0cd266458f9cdd799c98ff5bfd) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:11.846917 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2c219-dfe4-42f1-8aaf-d75a5ac24708 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:11.848795 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2c219-dfe4-42f1-8aaf-d75a5ac24708 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:11.856579 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 272/543] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:26:11 2022] GET /identity/v3/role_assignments?user.id=7690af0cd266458f9cdd799c98ff5bfd&scope.project.id=b6ed5f989f4248d7bab2548eb350fe17&role.id=b936dc45662c4ac195fdbf9e8ac589b0 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:11.974388 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3ed4b-6982-46f0-a799-2b99398dab38 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:12.055798 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:12.133371 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3ed4b-6982-46f0-a799-2b99398dab38 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:12.188771 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29832675-b203-49e3-a315-59ed5e2e7f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:12.189414 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29832675-b203-49e3-a315-59ed5e2e7f80 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:12.189708 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29832675-b203-49e3-a315-59ed5e2e7f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:12.189963 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29832675-b203-49e3-a315-59ed5e2e7f80 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:12.207271 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29832675-b203-49e3-a315-59ed5e2e7f80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:26:12.213699 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-29832675-b203-49e3-a315-59ed5e2e7f80 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:12.213699 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:12.213699 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:12.213699 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:12.213699 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:12.213699 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:12.213699 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:12.213699 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:12.213699 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:12.213699 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:12.213699 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:12.213699 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:12.213699 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:26:12.213699 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:26:12.213699 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:26:12.213699 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:26:12.215671 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:26:12.215671 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:26:12.215671 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:26:12.215671 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:26:12.215671 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:12.215671 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:12.215671 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:12.215671 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:12.215671 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:12.215671 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:12.215671 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:12.215671 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:12.215671 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:12.215671 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:12.215671 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:12.215671 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:12.217304 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:12.217304 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:12.217304 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:12.217304 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:12.217304 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:26:12.217304 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:26:12.217304 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:26:12.217304 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:26:12.217304 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:26:12.217304 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:26:12.217304 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:12.217304 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:12.217304 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 272/544] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Sep 11 08:26:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:12.229391 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2c219-dfe4-42f1-8aaf-d75a5ac24708 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:12.243353 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:12.427198 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2c219-dfe4-42f1-8aaf-d75a5ac24708 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:12.478009 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51869d-dc95-4c58-96d5-0deaa59b880e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:12.478633 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51869d-dc95-4c58-96d5-0deaa59b880e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:12.478914 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51869d-dc95-4c58-96d5-0deaa59b880e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:12.479185 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51869d-dc95-4c58-96d5-0deaa59b880e None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:12.479967 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51869d-dc95-4c58-96d5-0deaa59b880e None admin] RBAC: Adding query filter params (name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:12.480273 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51869d-dc95-4c58-96d5-0deaa59b880e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:12.481691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51869d-dc95-4c58-96d5-0deaa59b880e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:12.497084 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 273/545] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Sep 11 08:26:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:12.505499 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29832675-b203-49e3-a315-59ed5e2e7f80 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:12.605688 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae63d28-7cf6-4e03-9efc-11501efcf3b4 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:12.606190 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae63d28-7cf6-4e03-9efc-11501efcf3b4 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:12.606673 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae63d28-7cf6-4e03-9efc-11501efcf3b4 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:12.609348 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 274/546] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:26:12.617720 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859dd851-0c57-44d0-949c-08571d4ec789 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:12.618666 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859dd851-0c57-44d0-949c-08571d4ec789 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:12.619479 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859dd851-0c57-44d0-949c-08571d4ec789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:12.651998 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-859dd851-0c57-44d0-949c-08571d4ec789 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:12.653251 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-859dd851-0c57-44d0-949c-08571d4ec789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:12.731603 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29832675-b203-49e3-a315-59ed5e2e7f80 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:12.735217 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:12.809440 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:12.824703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 275/547] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 08:26:12.867318 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f8a91-d995-483a-88de-22effa56660d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:12.868713 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f8a91-d995-483a-88de-22effa56660d None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:12.869399 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f8a91-d995-483a-88de-22effa56660d None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:12.870077 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f8a91-d995-483a-88de-22effa56660d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:12.898034 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f8a91-d995-483a-88de-22effa56660d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:12.901922 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f8a91-d995-483a-88de-22effa56660d None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:12.941461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-5f6f8a91-d995-483a-88de-22effa56660d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:12.941461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:12.941461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:12.941461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:12.941461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:12.941461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:12.941461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:12.941461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:12.941461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:12.941461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:12.941461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:12.941461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:12.941461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:12.941461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:12.941461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:12.941461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:12.943891 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:12.943891 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:12.943891 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:12.943891 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:12.943891 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:12.943891 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:12.943891 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:12.943891 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:12.943891 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:12.943891 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:12.943891 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:12.943891 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:12.943891 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:12.943891 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:12.943891 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:12.943891 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:12.943891 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:12.945765 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:12.945765 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:12.945765 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:12.957080 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 273/548] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 452 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:12.966305 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859dd851-0c57-44d0-949c-08571d4ec789 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:13.111542 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f8a91-d995-483a-88de-22effa56660d None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:13.169124 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859dd851-0c57-44d0-949c-08571d4ec789 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:13.210687 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff267a-8f23-495f-837a-84b3ea742313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:13.215292 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff267a-8f23-495f-837a-84b3ea742313 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:13.215292 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff267a-8f23-495f-837a-84b3ea742313 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:13.215292 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff267a-8f23-495f-837a-84b3ea742313 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:13.215292 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff267a-8f23-495f-837a-84b3ea742313 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:13.215292 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff267a-8f23-495f-837a-84b3ea742313 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:13.215292 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff267a-8f23-495f-837a-84b3ea742313 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:13.230062 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 276/549] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:13.239859 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff267a-8f23-495f-837a-84b3ea742313 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:13.377226 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:13.427842 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff267a-8f23-495f-837a-84b3ea742313 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:13.436235 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f8a91-d995-483a-88de-22effa56660d None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:13.468960 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b49995-a187-455b-bf1a-1a8ca3240be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:13.469612 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b49995-a187-455b-bf1a-1a8ca3240be3 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:13.469892 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b49995-a187-455b-bf1a-1a8ca3240be3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:13.470166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b49995-a187-455b-bf1a-1a8ca3240be3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:13.485472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b49995-a187-455b-bf1a-1a8ca3240be3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:13.486985 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b49995-a187-455b-bf1a-1a8ca3240be3 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:13.499659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-55b49995-a187-455b-bf1a-1a8ca3240be3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 08:26:13.499659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:13.499659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:13.499659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:13.499659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:13.499659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:13.499659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:13.499659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:13.499659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:13.499659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:13.499659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:13.499659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:13.499659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:26:13.499659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:26:13.499659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:26:13.499659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:26:13.501280 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:13.501280 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:13.501280 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:26:13.501280 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:13.501280 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:26:13.501280 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:13.501280 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:13.501280 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:13.501280 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:13.501280 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:13.501280 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:13.501280 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:13.501280 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:13.501280 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:13.501280 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:13.501280 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:13.501280 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:13.501280 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:13.502850 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:13.502850 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:13.502850 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:26:13.502850 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:26:13.502850 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:26:13.502850 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:26:13.502850 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:26:13.502850 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:26:13.502850 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 08:26:13.502850 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:13.502850 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 277/550] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:26:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:26:13.507737 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b49995-a187-455b-bf1a-1a8ca3240be3 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:13.528510 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698edeb1-2dfc-494c-8c4b-4f2714926d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:13.529173 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698edeb1-2dfc-494c-8c4b-4f2714926d45 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:13.529453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698edeb1-2dfc-494c-8c4b-4f2714926d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:13.529724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698edeb1-2dfc-494c-8c4b-4f2714926d45 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:13.544946 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698edeb1-2dfc-494c-8c4b-4f2714926d45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:26:13.550536 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-698edeb1-2dfc-494c-8c4b-4f2714926d45 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:13.550536 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:13.550536 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:13.550536 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:13.550536 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:13.550536 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:13.550536 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:13.550536 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:13.550536 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:13.550536 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:13.550536 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:13.550536 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:13.550536 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:26:13.550536 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:26:13.550536 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:26:13.550536 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:26:13.551558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:26:13.551558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:26:13.551558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:26:13.551558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:26:13.551558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:13.551558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:13.551558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:13.551558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:13.551558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:13.551558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:13.551558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:13.551558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:13.551558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:13.551558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:13.551558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:13.551558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:13.556217 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:13.556217 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:13.556217 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:13.556217 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:13.556217 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:26:13.556217 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:26:13.556217 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:26:13.556217 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:26:13.556217 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:26:13.556217 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:26:13.556217 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:13.556217 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:13.556217 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 274/551] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Sep 11 08:26:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 448 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:13.556217 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509f7a6-b4db-4d54-ba50-50f3e46d2584 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:13.557234 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509f7a6-b4db-4d54-ba50-50f3e46d2584 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:13.557234 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509f7a6-b4db-4d54-ba50-50f3e46d2584 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:13.557234 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 275/552] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:13.565981 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509f7a6-b4db-4d54-ba50-50f3e46d2584 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:13.599658 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:13.668390 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b49995-a187-455b-bf1a-1a8ca3240be3 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:13.685490 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509f7a6-b4db-4d54-ba50-50f3e46d2584 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:13.693413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:13.717398 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a217ce3-3497-4757-8e9a-4d20bb02795c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:13.718034 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a217ce3-3497-4757-8e9a-4d20bb02795c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:13.718335 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a217ce3-3497-4757-8e9a-4d20bb02795c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:13.718607 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a217ce3-3497-4757-8e9a-4d20bb02795c None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:13.719618 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a217ce3-3497-4757-8e9a-4d20bb02795c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:13.719927 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a217ce3-3497-4757-8e9a-4d20bb02795c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:13.721456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a217ce3-3497-4757-8e9a-4d20bb02795c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:13.740095 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6add3-cee8-418a-b6ee-492bfd0a1a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:13.741761 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6add3-cee8-418a-b6ee-492bfd0a1a24 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:13.742242 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6add3-cee8-418a-b6ee-492bfd0a1a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:13.742712 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6add3-cee8-418a-b6ee-492bfd0a1a24 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:13.743655 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d6add3-cee8-418a-b6ee-492bfd0a1a24 None admin] RBAC: Adding query filter params (name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:13.744178 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d6add3-cee8-418a-b6ee-492bfd0a1a24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:13.745820 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 278/553] 10.222.0.26 () {56 vars in 1135 bytes} [Sun Sep 11 08:26:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:13.746031 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d6add3-cee8-418a-b6ee-492bfd0a1a24 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:13.747213 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41cbdcf-79b4-45eb-9f92-0e055d7b3bdd None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:13.747602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41cbdcf-79b4-45eb-9f92-0e055d7b3bdd None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:13.747927 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41cbdcf-79b4-45eb-9f92-0e055d7b3bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:13.761403 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 276/554] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Sep 11 08:26:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:13.762844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6add3-cee8-418a-b6ee-492bfd0a1a24 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:13.769886 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f41cbdcf-79b4-45eb-9f92-0e055d7b3bdd None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:13.771096 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f41cbdcf-79b4-45eb-9f92-0e055d7b3bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:13.857359 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:13.871330 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 279/555] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:26:13.871330 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41cbdcf-79b4-45eb-9f92-0e055d7b3bdd None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:13.906410 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6add3-cee8-418a-b6ee-492bfd0a1a24 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:13.989350 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add28757-217f-4909-9628-95cb63aa7b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:13.989982 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add28757-217f-4909-9628-95cb63aa7b73 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:13.990258 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add28757-217f-4909-9628-95cb63aa7b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:13.990725 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add28757-217f-4909-9628-95cb63aa7b73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:14.077458 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41cbdcf-79b4-45eb-9f92-0e055d7b3bdd None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:14.089319 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:14.111609 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add28757-217f-4909-9628-95cb63aa7b73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:14.114730 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add28757-217f-4909-9628-95cb63aa7b73 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:14.161452 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe45c5-1f4c-43f9-9036-f2cecc65a354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:14.162149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe45c5-1f4c-43f9-9036-f2cecc65a354 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:14.163009 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe45c5-1f4c-43f9-9036-f2cecc65a354 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:14.163313 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe45c5-1f4c-43f9-9036-f2cecc65a354 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:14.177459 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe45c5-1f4c-43f9-9036-f2cecc65a354 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:14.179117 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe45c5-1f4c-43f9-9036-f2cecc65a354 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:14.201546 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-c6fe45c5-1f4c-43f9-9036-f2cecc65a354 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:14.201546 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:14.201546 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:14.201546 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:14.201546 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:14.201546 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:14.201546 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:14.201546 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:14.201546 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:14.201546 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:14.201546 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:14.201546 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:14.201546 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:14.201546 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:14.201546 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:14.201546 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:14.202545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:14.202545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:14.202545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:14.202545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:14.202545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:14.202545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:14.202545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:14.202545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:14.202545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:14.202545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:14.202545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:14.202545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:14.202545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:14.202545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:14.202545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:14.202545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:14.202545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:14.203446 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:14.203446 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:14.203446 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:14.203446 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 280/556] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:14.204374 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe45c5-1f4c-43f9-9036-f2cecc65a354 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:14.255463 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:14.282388 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 277/557] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:26:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 08:26:14.286982 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add28757-217f-4909-9628-95cb63aa7b73 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:14.314222 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe45c5-1f4c-43f9-9036-f2cecc65a354 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:14.352246 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ec176-2b15-44eb-9d5d-c6e84bd6f46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:14.352899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ec176-2b15-44eb-9d5d-c6e84bd6f46a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:14.353176 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ec176-2b15-44eb-9d5d-c6e84bd6f46a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:14.353449 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ec176-2b15-44eb-9d5d-c6e84bd6f46a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:14.365296 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ec176-2b15-44eb-9d5d-c6e84bd6f46a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:26:14.370936 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-359ec176-2b15-44eb-9d5d-c6e84bd6f46a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:14.370936 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:14.370936 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:14.370936 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:14.370936 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:14.370936 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:14.370936 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:14.370936 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:14.370936 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:14.370936 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:14.370936 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:14.370936 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:14.370936 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:26:14.370936 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:26:14.370936 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:26:14.370936 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:26:14.372394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:26:14.372394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:26:14.372394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:26:14.372394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:26:14.372394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:14.372394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:14.372394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:14.372394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:14.372394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:14.372394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:14.372394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:14.372394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:14.372394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:14.372394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:14.372394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:14.372394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:14.373232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:14.373232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:14.373232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:14.373232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:14.373232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:26:14.373232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:26:14.373232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:26:14.373232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:26:14.373232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:26:14.373232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:26:14.373232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:14.373232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:14.376935 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 281/558] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Sep 11 08:26:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:14.377894 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ec176-2b15-44eb-9d5d-c6e84bd6f46a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:14.403932 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:14.416659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add28757-217f-4909-9628-95cb63aa7b73 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:14.456009 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101246ef-98a6-4681-90e7-63d15a0d7305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:14.456793 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101246ef-98a6-4681-90e7-63d15a0d7305 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:14.457219 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101246ef-98a6-4681-90e7-63d15a0d7305 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:14.457537 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101246ef-98a6-4681-90e7-63d15a0d7305 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:14.458562 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101246ef-98a6-4681-90e7-63d15a0d7305 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:14.458562 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101246ef-98a6-4681-90e7-63d15a0d7305 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:14.460890 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101246ef-98a6-4681-90e7-63d15a0d7305 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:14.473863 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 278/559] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:14.474985 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101246ef-98a6-4681-90e7-63d15a0d7305 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:14.501286 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ec176-2b15-44eb-9d5d-c6e84bd6f46a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:14.513363 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:14.543519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd931f2-5473-4410-94a2-88642bcd69eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:14.544891 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd931f2-5473-4410-94a2-88642bcd69eb None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:14.545433 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd931f2-5473-4410-94a2-88642bcd69eb None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:14.545914 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd931f2-5473-4410-94a2-88642bcd69eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:14.558991 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd931f2-5473-4410-94a2-88642bcd69eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:14.560892 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd931f2-5473-4410-94a2-88642bcd69eb None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:14.579396 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-ecd931f2-5473-4410-94a2-88642bcd69eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:14.579396 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:14.579396 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:14.579396 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:14.579396 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:14.579396 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:14.579396 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:14.579396 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:14.579396 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:14.579396 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:14.579396 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:14.579396 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:14.579396 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:14.579396 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:14.579396 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:14.579396 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:14.580541 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:14.580541 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:14.580541 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:14.580541 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:14.580541 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:14.580541 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:14.580541 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:14.580541 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:14.580541 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:14.580541 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:14.580541 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:14.580541 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:14.580541 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:14.580541 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:14.580541 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:14.580541 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:14.580541 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:14.581483 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:14.581483 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:14.581483 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:14.588604 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 282/560] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:14.590010 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd931f2-5473-4410-94a2-88642bcd69eb None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:14.593942 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101246ef-98a6-4681-90e7-63d15a0d7305 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:14.634719 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250cf5c-70bf-4bcf-a86d-d64913c19203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:14.635366 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250cf5c-70bf-4bcf-a86d-d64913c19203 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:14.635759 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250cf5c-70bf-4bcf-a86d-d64913c19203 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:14.636037 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250cf5c-70bf-4bcf-a86d-d64913c19203 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:14.636709 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250cf5c-70bf-4bcf-a86d-d64913c19203 None admin] RBAC: Adding query filter params (name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:14.637016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250cf5c-70bf-4bcf-a86d-d64913c19203 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:14.638407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250cf5c-70bf-4bcf-a86d-d64913c19203 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:14.652581 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 279/561] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Sep 11 08:26:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:14.653482 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250cf5c-70bf-4bcf-a86d-d64913c19203 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:14.675477 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:14.715185 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd931f2-5473-4410-94a2-88642bcd69eb None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:14.753737 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a76279-2614-425b-8163-5f365743782f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:14.754502 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a76279-2614-425b-8163-5f365743782f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:14.754789 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a76279-2614-425b-8163-5f365743782f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:14.755066 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a76279-2614-425b-8163-5f365743782f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:14.764621 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:14.764800 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a76279-2614-425b-8163-5f365743782f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:14.766388 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a76279-2614-425b-8163-5f365743782f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:14.770187 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250cf5c-70bf-4bcf-a86d-d64913c19203 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:14.778793 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-a0a76279-2614-425b-8163-5f365743782f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 08:26:14.778793 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:14.778793 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:14.778793 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:14.778793 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:14.778793 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:14.778793 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:14.778793 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:14.778793 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:14.778793 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:14.778793 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:14.778793 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:14.778793 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:26:14.778793 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:26:14.778793 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:26:14.778793 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:26:14.784467 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:14.784467 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:14.784467 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:26:14.784467 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:14.784467 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:26:14.784467 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:14.784467 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:14.784467 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:14.784467 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:14.784467 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:14.784467 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:14.784467 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:14.784467 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:14.784467 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:14.784467 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:14.784467 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:14.784467 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:14.784467 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:14.785676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:14.785676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:14.785676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:26:14.785676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:26:14.785676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:26:14.785676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:26:14.785676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:26:14.785676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:26:14.785676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 08:26:14.785676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:14.785676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 283/562] 10.222.0.26 () {56 vars in 1093 bytes} [Sun Sep 11 08:26:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:14.785676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a76279-2614-425b-8163-5f365743782f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:14.823069 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4f98c-6c1a-4e5f-b3e8-e1db04da598a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:14.823723 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4f98c-6c1a-4e5f-b3e8-e1db04da598a None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:14.824009 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4f98c-6c1a-4e5f-b3e8-e1db04da598a None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:14.824284 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4f98c-6c1a-4e5f-b3e8-e1db04da598a None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:14.824928 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4f98c-6c1a-4e5f-b3e8-e1db04da598a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:14.825236 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4f98c-6c1a-4e5f-b3e8-e1db04da598a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:14.826611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4f98c-6c1a-4e5f-b3e8-e1db04da598a None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:14.847281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 280/563] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:14.847281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577ab29-32b5-41e9-964a-919b51a3d2fe None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:14.847281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577ab29-32b5-41e9-964a-919b51a3d2fe None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:14.847281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577ab29-32b5-41e9-964a-919b51a3d2fe None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:14.847281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 281/564] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:14.847281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577ab29-32b5-41e9-964a-919b51a3d2fe None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:14.960133 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a76279-2614-425b-8163-5f365743782f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:15.001000 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:15.004692 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577ab29-32b5-41e9-964a-919b51a3d2fe None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:15.012222 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc74cc-62f0-458d-b6aa-1435be930d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:15.013340 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc74cc-62f0-458d-b6aa-1435be930d2b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:15.013830 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc74cc-62f0-458d-b6aa-1435be930d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:15.014318 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc74cc-62f0-458d-b6aa-1435be930d2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:15.036759 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc74cc-62f0-458d-b6aa-1435be930d2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:15.039612 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc74cc-62f0-458d-b6aa-1435be930d2b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:15.047693 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65843a32-836c-4c19-948a-ecab3c1bc449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:15.048314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65843a32-836c-4c19-948a-ecab3c1bc449 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:15.048592 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65843a32-836c-4c19-948a-ecab3c1bc449 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:15.048864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65843a32-836c-4c19-948a-ecab3c1bc449 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:15.049609 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65843a32-836c-4c19-948a-ecab3c1bc449 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:15.049925 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65843a32-836c-4c19-948a-ecab3c1bc449 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:15.051379 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65843a32-836c-4c19-948a-ecab3c1bc449 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:15.066812 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-f6fc74cc-62f0-458d-b6aa-1435be930d2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:15.066812 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:15.066812 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:15.066812 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:15.066812 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:15.066812 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:15.066812 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:15.066812 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:15.066812 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:15.066812 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:15.066812 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:15.066812 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:15.066812 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:15.066812 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:15.066812 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:15.066812 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:15.070135 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:15.070135 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:15.070135 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:15.070135 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:15.070135 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:15.070135 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:15.070135 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:15.070135 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:15.070135 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:15.070135 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:15.070135 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:15.070135 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:15.070135 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:15.070135 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:15.070135 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:15.070135 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:15.070135 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:15.074317 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:15.074317 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:15.074317 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:15.074317 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 284/565] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:15.074317 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4ece7-ded1-4d38-867d-da2a8e0fb19d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:15.074317 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4ece7-ded1-4d38-867d-da2a8e0fb19d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:15.074317 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4ece7-ded1-4d38-867d-da2a8e0fb19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:15.095301 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 282/566] 10.222.0.26 () {56 vars in 1133 bytes} [Sun Sep 11 08:26:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:15.095301 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65843a32-836c-4c19-948a-ecab3c1bc449 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:15.110175 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-07b4ece7-ded1-4d38-867d-da2a8e0fb19d None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:15.112233 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-07b4ece7-ded1-4d38-867d-da2a8e0fb19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:15.130554 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:15.197026 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 285/567] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:26:15.207820 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4ece7-ded1-4d38-867d-da2a8e0fb19d None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:15.265167 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65843a32-836c-4c19-948a-ecab3c1bc449 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:15.316773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e796c-ca1e-4072-828c-8548df4ebcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:15.318010 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e796c-ca1e-4072-828c-8548df4ebcbf None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:15.318992 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e796c-ca1e-4072-828c-8548df4ebcbf None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:15.319623 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e796c-ca1e-4072-828c-8548df4ebcbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:15.331200 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e796c-ca1e-4072-828c-8548df4ebcbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:15.332708 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e796c-ca1e-4072-828c-8548df4ebcbf None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:15.349676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-e44e796c-ca1e-4072-828c-8548df4ebcbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:15.349676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:15.349676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:15.349676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:15.349676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:15.349676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:15.349676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:15.349676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:15.349676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:15.349676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:15.349676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:15.349676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:15.349676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:26:15.349676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:26:15.349676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:26:15.351232 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:26:15.351232 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:15.351232 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:15.351232 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:15.351232 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:15.351232 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:15.351232 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:15.351232 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:15.351232 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:15.351232 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:15.351232 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:15.351232 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:15.351232 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:15.351232 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:15.351232 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:15.351232 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:15.351232 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:15.352627 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:26:15.352627 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:26:15.352627 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:26:15.352627 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:26:15.352627 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:26:15.352627 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:26:15.352627 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:15.352627 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:15.352627 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 283/568] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:26:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:15.352627 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e796c-ca1e-4072-828c-8548df4ebcbf None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:15.355776 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4ece7-ded1-4d38-867d-da2a8e0fb19d None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:15.376338 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:15.407712 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9dff87-e4de-4596-a818-3b103aaac40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:15.408977 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9dff87-e4de-4596-a818-3b103aaac40d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:15.409462 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9dff87-e4de-4596-a818-3b103aaac40d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:15.410388 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9dff87-e4de-4596-a818-3b103aaac40d None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:15.411312 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9dff87-e4de-4596-a818-3b103aaac40d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:15.412091 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9dff87-e4de-4596-a818-3b103aaac40d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:15.415230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9dff87-e4de-4596-a818-3b103aaac40d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:15.433565 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 286/569] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:15.434649 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9dff87-e4de-4596-a818-3b103aaac40d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:15.451693 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:15.485029 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e796c-ca1e-4072-828c-8548df4ebcbf None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:15.529934 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460aee1b-9036-42c4-9307-579e0696554c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:15.531086 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460aee1b-9036-42c4-9307-579e0696554c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:15.531998 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460aee1b-9036-42c4-9307-579e0696554c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:15.532489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460aee1b-9036-42c4-9307-579e0696554c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:15.548364 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460aee1b-9036-42c4-9307-579e0696554c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:15.550708 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460aee1b-9036-42c4-9307-579e0696554c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:15.555126 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9dff87-e4de-4596-a818-3b103aaac40d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:15.570640 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-460aee1b-9036-42c4-9307-579e0696554c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:15.570640 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:15.570640 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:15.570640 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:15.570640 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:15.570640 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:15.570640 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:15.570640 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:15.570640 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:15.570640 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:15.570640 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:15.570640 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:15.570640 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:15.570640 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:15.570640 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:15.570640 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:15.571847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:15.571847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:15.571847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:15.571847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:15.571847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:15.571847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:15.571847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:15.571847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:15.571847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:15.571847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:15.571847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:15.571847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:15.571847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:15.571847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:15.571847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:15.571847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:15.571847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:15.572939 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:15.572939 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:15.572939 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:15.575692 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 284/570] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:15.577061 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460aee1b-9036-42c4-9307-579e0696554c None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:15.607970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a36f0e-2141-4ea3-b7b9-31bddf35ae55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:15.608908 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a36f0e-2141-4ea3-b7b9-31bddf35ae55 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:15.609526 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a36f0e-2141-4ea3-b7b9-31bddf35ae55 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:15.609949 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a36f0e-2141-4ea3-b7b9-31bddf35ae55 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:15.611584 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a36f0e-2141-4ea3-b7b9-31bddf35ae55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:15.612078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a36f0e-2141-4ea3-b7b9-31bddf35ae55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:15.614093 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a36f0e-2141-4ea3-b7b9-31bddf35ae55 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:15.632954 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 287/571] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:26:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:15.634119 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a36f0e-2141-4ea3-b7b9-31bddf35ae55 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:15.680703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:15.715795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460aee1b-9036-42c4-9307-579e0696554c None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:15.750598 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:15.761970 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428e166-b086-4255-b472-53541a240fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:15.762629 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428e166-b086-4255-b472-53541a240fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:15.762908 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428e166-b086-4255-b472-53541a240fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:15.763305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428e166-b086-4255-b472-53541a240fb0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:15.773745 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428e166-b086-4255-b472-53541a240fb0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:15.775299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428e166-b086-4255-b472-53541a240fb0 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:15.779061 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a36f0e-2141-4ea3-b7b9-31bddf35ae55 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:15.789038 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-e428e166-b086-4255-b472-53541a240fb0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 08:26:15.789038 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:15.789038 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:15.789038 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:15.789038 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:15.789038 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:15.789038 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:15.789038 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:15.789038 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:15.789038 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:15.789038 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:15.789038 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:15.789038 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:26:15.789038 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:26:15.789038 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:26:15.789038 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:26:15.790999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:15.790999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:15.790999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:26:15.790999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:15.790999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:26:15.790999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:15.790999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:15.790999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:15.790999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:15.790999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:15.790999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:15.790999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:15.790999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:15.790999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:15.790999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:15.790999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:15.790999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:15.790999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:15.792596 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:15.792596 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:15.792596 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:26:15.792596 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:26:15.792596 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:26:15.792596 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:26:15.792596 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:26:15.792596 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:26:15.792596 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 08:26:15.792596 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:15.795290 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 285/572] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:26:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:15.796296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428e166-b086-4255-b472-53541a240fb0 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:15.823378 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955adfd4-5b01-4f10-b13d-31a1c552e28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:15.823875 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955adfd4-5b01-4f10-b13d-31a1c552e28a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:15.824152 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955adfd4-5b01-4f10-b13d-31a1c552e28a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:15.824426 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955adfd4-5b01-4f10-b13d-31a1c552e28a None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:15.825111 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955adfd4-5b01-4f10-b13d-31a1c552e28a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:15.825416 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955adfd4-5b01-4f10-b13d-31a1c552e28a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:15.826847 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955adfd4-5b01-4f10-b13d-31a1c552e28a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:15.840521 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 288/573] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:15.841707 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955adfd4-5b01-4f10-b13d-31a1c552e28a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:15.941439 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428e166-b086-4255-b472-53541a240fb0 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:15.958677 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:15.968302 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955adfd4-5b01-4f10-b13d-31a1c552e28a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:15.990447 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66d530-0104-4ffe-81c6-c3e321595254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:15.991072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66d530-0104-4ffe-81c6-c3e321595254 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:15.991390 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66d530-0104-4ffe-81c6-c3e321595254 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:15.991668 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66d530-0104-4ffe-81c6-c3e321595254 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:15.992411 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66d530-0104-4ffe-81c6-c3e321595254 None admin] RBAC: Adding query filter params (role.id=b936dc45662c4ac195fdbf9e8ac589b0, scope.project.id=b6ed5f989f4248d7bab2548eb350fe17, user.id=d1a4f25df9724d34afdd6a41e719546a) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:15.992724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66d530-0104-4ffe-81c6-c3e321595254 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:15.994194 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66d530-0104-4ffe-81c6-c3e321595254 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:16.000041 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 286/574] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:26:15 2022] GET /identity/v3/role_assignments?user.id=d1a4f25df9724d34afdd6a41e719546a&scope.project.id=b6ed5f989f4248d7bab2548eb350fe17&role.id=b936dc45662c4ac195fdbf9e8ac589b0 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:16.001292 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1759b5-7a17-413f-969c-5ac78fbb48e6 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:16.001579 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1759b5-7a17-413f-969c-5ac78fbb48e6 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:16.001856 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1759b5-7a17-413f-969c-5ac78fbb48e6 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:16.003406 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 287/575] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:16.008525 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1759b5-7a17-413f-969c-5ac78fbb48e6 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:16.018778 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf04ec-29a1-4a34-b798-821eb8a6a7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:16.019569 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf04ec-29a1-4a34-b798-821eb8a6a7be None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:16.019886 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf04ec-29a1-4a34-b798-821eb8a6a7be None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:16.020172 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf04ec-29a1-4a34-b798-821eb8a6a7be None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:16.034495 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf04ec-29a1-4a34-b798-821eb8a6a7be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:26:16.040218 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-4baf04ec-29a1-4a34-b798-821eb8a6a7be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:16.040218 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:16.040218 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:16.040218 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:16.040218 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:16.040218 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:16.040218 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:16.040218 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:16.040218 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:16.040218 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:16.040218 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:16.040218 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:16.040218 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:26:16.040218 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:26:16.040218 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:26:16.040218 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:26:16.041969 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:26:16.041969 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:26:16.041969 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:26:16.041969 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:26:16.041969 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:16.041969 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:16.041969 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:16.041969 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:16.041969 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:16.041969 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:16.041969 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:16.041969 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:16.041969 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:16.041969 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:16.041969 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:16.041969 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:16.043550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:16.043550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:16.043550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:16.043550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:16.043550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:26:16.043550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:26:16.043550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:26:16.043550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:26:16.043550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:26:16.043550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:26:16.043550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:16.043550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:16.043550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 289/576] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Sep 11 08:26:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:16.043550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf04ec-29a1-4a34-b798-821eb8a6a7be None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:16.133168 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:16.183361 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf04ec-29a1-4a34-b798-821eb8a6a7be None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:16.231131 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1759b5-7a17-413f-969c-5ac78fbb48e6 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:16.246323 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee419c-6c04-4583-bbe3-885a8e5d7a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:16.247773 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee419c-6c04-4583-bbe3-885a8e5d7a63 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:16.248435 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee419c-6c04-4583-bbe3-885a8e5d7a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:16.249111 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee419c-6c04-4583-bbe3-885a8e5d7a63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:16.262837 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee419c-6c04-4583-bbe3-885a8e5d7a63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:16.266000 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee419c-6c04-4583-bbe3-885a8e5d7a63 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:16.281205 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19538eb2-e638-46f9-856d-038be1ff62aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:16.281828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19538eb2-e638-46f9-856d-038be1ff62aa None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:16.282110 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19538eb2-e638-46f9-856d-038be1ff62aa None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:16.282387 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19538eb2-e638-46f9-856d-038be1ff62aa None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:16.283126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19538eb2-e638-46f9-856d-038be1ff62aa None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:16.283466 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19538eb2-e638-46f9-856d-038be1ff62aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:16.284913 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19538eb2-e638-46f9-856d-038be1ff62aa None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:16.292295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-6cee419c-6c04-4583-bbe3-885a8e5d7a63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:16.292295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:16.292295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:16.292295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:16.292295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:16.292295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:16.292295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:16.292295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:16.292295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:16.292295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:16.292295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:16.292295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:16.292295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:26:16.292295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:26:16.292295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:26:16.294249 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:26:16.294249 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:16.294249 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:16.294249 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:16.294249 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:16.294249 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:16.294249 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:16.294249 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:16.294249 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:16.294249 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:16.294249 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:16.294249 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:16.294249 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:16.294249 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:16.294249 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:16.294249 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:16.294249 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:16.296271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:26:16.296271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:26:16.296271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:26:16.296271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:26:16.296271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:26:16.296271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:26:16.296271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:16.296271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:16.299412 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 290/577] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:26:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:16.301960 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975ff2a-8f2c-4938-b200-4e48ae0307e2 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:16.302713 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975ff2a-8f2c-4938-b200-4e48ae0307e2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:16.303472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975ff2a-8f2c-4938-b200-4e48ae0307e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:16.311690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 288/578] 10.222.0.26 () {56 vars in 1137 bytes} [Sun Sep 11 08:26:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:16.312664 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19538eb2-e638-46f9-856d-038be1ff62aa None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:16.339533 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-6975ff2a-8f2c-4938-b200-4e48ae0307e2 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:16.340749 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6975ff2a-8f2c-4938-b200-4e48ae0307e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:16.349516 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:16.434812 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 291/579] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:26:16.435752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975ff2a-8f2c-4938-b200-4e48ae0307e2 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:16.499098 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19538eb2-e638-46f9-856d-038be1ff62aa None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:16.519946 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:16.567039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71169d7-42c8-4dd3-a387-d5352d301b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:16.568275 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71169d7-42c8-4dd3-a387-d5352d301b68 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:16.569326 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71169d7-42c8-4dd3-a387-d5352d301b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:16.569896 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71169d7-42c8-4dd3-a387-d5352d301b68 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:16.571144 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71169d7-42c8-4dd3-a387-d5352d301b68 None admin] RBAC: Adding query filter params (name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:16.571689 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71169d7-42c8-4dd3-a387-d5352d301b68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:16.574334 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71169d7-42c8-4dd3-a387-d5352d301b68 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:16.591892 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 289/580] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Sep 11 08:26:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:16.592812 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71169d7-42c8-4dd3-a387-d5352d301b68 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:16.624206 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975ff2a-8f2c-4938-b200-4e48ae0307e2 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:16.691627 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b532944-26ee-41b6-ab72-8455a68b9ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:16.691627 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b532944-26ee-41b6-ab72-8455a68b9ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:16.691627 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b532944-26ee-41b6-ab72-8455a68b9ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:16.691627 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b532944-26ee-41b6-ab72-8455a68b9ee9 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:16.692248 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b532944-26ee-41b6-ab72-8455a68b9ee9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:16.692248 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b532944-26ee-41b6-ab72-8455a68b9ee9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:16.694909 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b532944-26ee-41b6-ab72-8455a68b9ee9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:16.715121 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 292/581] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:26:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:16.716185 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b532944-26ee-41b6-ab72-8455a68b9ee9 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:16.719423 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:16.762173 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71169d7-42c8-4dd3-a387-d5352d301b68 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:16.798395 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c99662-7e6d-4e13-a0bb-d1257f2d5c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:16.799044 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c99662-7e6d-4e13-a0bb-d1257f2d5c38 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:16.799375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c99662-7e6d-4e13-a0bb-d1257f2d5c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:16.799657 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c99662-7e6d-4e13-a0bb-d1257f2d5c38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:16.812147 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c99662-7e6d-4e13-a0bb-d1257f2d5c38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:16.813493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c99662-7e6d-4e13-a0bb-d1257f2d5c38 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:16.830643 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-08c99662-7e6d-4e13-a0bb-d1257f2d5c38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:16.830643 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:16.830643 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:16.830643 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:16.830643 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:16.830643 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:16.830643 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:16.830643 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:16.830643 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:16.830643 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:16.830643 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:16.830643 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:16.830643 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:16.830643 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:16.830643 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:16.830643 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:16.832021 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:16.832021 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:16.832021 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:16.832021 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:16.832021 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:16.832021 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:16.832021 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:16.832021 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:16.832021 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:16.832021 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:16.832021 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:16.832021 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:16.832021 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:16.832021 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:16.832021 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:16.832021 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:16.832021 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:16.833552 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:16.833552 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:16.833552 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:16.835212 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b532944-26ee-41b6-ab72-8455a68b9ee9 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:16.836776 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 290/582] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:16.837756 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c99662-7e6d-4e13-a0bb-d1257f2d5c38 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:16.870802 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:16.873058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd2e8f-f107-4538-ace8-e59aeebe95ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:16.873884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd2e8f-f107-4538-ace8-e59aeebe95ba None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:16.874532 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd2e8f-f107-4538-ace8-e59aeebe95ba None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:16.874812 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd2e8f-f107-4538-ace8-e59aeebe95ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:16.887285 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd2e8f-f107-4538-ace8-e59aeebe95ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:16.888841 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd2e8f-f107-4538-ace8-e59aeebe95ba None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:16.904054 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-0dbd2e8f-f107-4538-ace8-e59aeebe95ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:16.904054 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:16.904054 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:16.904054 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:16.904054 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:16.904054 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:16.904054 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:16.904054 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:16.904054 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:16.904054 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:16.904054 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:16.904054 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:16.904054 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:16.904054 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:16.904054 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:16.904054 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:16.905883 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:16.905883 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:16.905883 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:16.905883 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:16.905883 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:16.905883 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:16.905883 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:16.905883 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:16.905883 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:16.905883 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:16.905883 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:16.905883 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:16.905883 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:16.905883 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:16.905883 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:16.905883 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:16.905883 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:16.909066 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:16.909066 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:16.909066 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:16.909066 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 293/583] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:16.909066 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd2e8f-f107-4538-ace8-e59aeebe95ba None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:16.974197 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c99662-7e6d-4e13-a0bb-d1257f2d5c38 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:16.991088 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:17.026669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8f5b6-d6f1-4e88-b6fa-98ee05e8e198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:17.027666 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8f5b6-d6f1-4e88-b6fa-98ee05e8e198 None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:17.028296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8f5b6-d6f1-4e88-b6fa-98ee05e8e198 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:17.029416 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8f5b6-d6f1-4e88-b6fa-98ee05e8e198 None admin] PATH_INFO: `/v3/projects/b6ed5f989f4248d7bab2548eb350fe17/users/e62bb9d2e13649b5af239bb56001ce16/roles/b936dc45662c4ac195fdbf9e8ac589b0` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:17.042708 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd2e8f-f107-4538-ace8-e59aeebe95ba None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:17.051367 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8f5b6-d6f1-4e88-b6fa-98ee05e8e198 None admin] RBAC: Authorizing `identity:create_grant(project_id=b6ed5f989f4248d7bab2548eb350fe17, user_id=e62bb9d2e13649b5af239bb56001ce16, role_id=b936dc45662c4ac195fdbf9e8ac589b0)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:17.053814 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8f5b6-d6f1-4e88-b6fa-98ee05e8e198 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:17.088939 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f9dff-c06d-444a-9770-b08da9035997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:17.089603 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f9dff-c06d-444a-9770-b08da9035997 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:17.089880 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f9dff-c06d-444a-9770-b08da9035997 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:17.090152 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f9dff-c06d-444a-9770-b08da9035997 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:17.103997 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f9dff-c06d-444a-9770-b08da9035997 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:26:17.109562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-e54f9dff-c06d-444a-9770-b08da9035997 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:17.109562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:17.109562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:17.109562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:17.109562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:17.109562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:17.109562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:17.109562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:17.109562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:17.109562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:17.109562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:17.109562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:17.109562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:26:17.109562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:26:17.109562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:26:17.109562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:26:17.111486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:26:17.111486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:26:17.111486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:26:17.111486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:26:17.111486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:17.111486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:17.111486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:17.111486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:17.111486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:17.111486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:17.111486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:17.111486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:17.111486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:17.111486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:17.111486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:17.111486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:17.113158 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:17.113158 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:17.113158 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:17.113158 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:17.113158 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:26:17.113158 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:26:17.113158 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:26:17.113158 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:26:17.113158 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:26:17.113158 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:26:17.113158 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:17.113158 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:17.113158 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 294/584] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Sep 11 08:26:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:17.113158 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f9dff-c06d-444a-9770-b08da9035997 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:17.135614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 291/585] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Sep 11 08:26:16 2022] PUT /identity/v3/projects/b6ed5f989f4248d7bab2548eb350fe17/users/e62bb9d2e13649b5af239bb56001ce16/roles/b936dc45662c4ac195fdbf9e8ac589b0 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:26:17.137454 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8f5b6-d6f1-4e88-b6fa-98ee05e8e198 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:17.282642 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:17.322947 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8f5b6-d6f1-4e88-b6fa-98ee05e8e198 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:17.355117 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f9dff-c06d-444a-9770-b08da9035997 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:17.383171 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367e859-6ec7-46d7-95be-1b95ba01055b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:17.384073 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367e859-6ec7-46d7-95be-1b95ba01055b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:17.384628 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367e859-6ec7-46d7-95be-1b95ba01055b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:17.385081 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367e859-6ec7-46d7-95be-1b95ba01055b None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:17.385916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367e859-6ec7-46d7-95be-1b95ba01055b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:17.386401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367e859-6ec7-46d7-95be-1b95ba01055b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:17.388003 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367e859-6ec7-46d7-95be-1b95ba01055b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:17.390775 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:17.409519 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 292/586] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:17.414984 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367e859-6ec7-46d7-95be-1b95ba01055b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:17.435698 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ba76b-d3aa-4221-95c0-2a34949ff2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:17.436769 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ba76b-d3aa-4221-95c0-2a34949ff2bd None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:17.437302 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ba76b-d3aa-4221-95c0-2a34949ff2bd None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:17.438432 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ba76b-d3aa-4221-95c0-2a34949ff2bd None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:17.439649 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ba76b-d3aa-4221-95c0-2a34949ff2bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:17.440558 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ba76b-d3aa-4221-95c0-2a34949ff2bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:17.443281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ba76b-d3aa-4221-95c0-2a34949ff2bd None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:17.469381 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 295/587] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:17.475350 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ba76b-d3aa-4221-95c0-2a34949ff2bd None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:17.611793 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367e859-6ec7-46d7-95be-1b95ba01055b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:17.655282 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be8aa31-49d9-4ff7-a6df-b46a7b987403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:17.655908 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8aa31-49d9-4ff7-a6df-b46a7b987403 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:17.656174 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8aa31-49d9-4ff7-a6df-b46a7b987403 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:17.656437 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8aa31-49d9-4ff7-a6df-b46a7b987403 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:17.657181 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be8aa31-49d9-4ff7-a6df-b46a7b987403 None admin] RBAC: Adding query filter params (name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:17.657482 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be8aa31-49d9-4ff7-a6df-b46a7b987403 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:17.658882 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be8aa31-49d9-4ff7-a6df-b46a7b987403 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:17.660759 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:17.664610 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ba76b-d3aa-4221-95c0-2a34949ff2bd None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:17.673517 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 293/588] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Sep 11 08:26:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:17.674272 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be8aa31-49d9-4ff7-a6df-b46a7b987403 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:17.717267 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc95e4-f4d4-41f4-91ab-7183a2f9db34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:17.718680 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc95e4-f4d4-41f4-91ab-7183a2f9db34 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:17.719147 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc95e4-f4d4-41f4-91ab-7183a2f9db34 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:17.720639 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc95e4-f4d4-41f4-91ab-7183a2f9db34 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:17.731480 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc95e4-f4d4-41f4-91ab-7183a2f9db34 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:17.733754 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc95e4-f4d4-41f4-91ab-7183a2f9db34 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:17.750225 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-c2dc95e4-f4d4-41f4-91ab-7183a2f9db34 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 08:26:17.750225 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:17.750225 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:17.750225 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:17.750225 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:17.750225 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:17.750225 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:17.750225 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:17.750225 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:17.750225 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:17.750225 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:17.750225 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:17.750225 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:26:17.750225 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:26:17.750225 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:26:17.750225 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:26:17.751230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:17.751230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:17.751230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:26:17.751230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:17.751230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:26:17.751230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:17.751230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:17.751230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:17.751230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:17.751230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:17.751230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:17.751230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:17.751230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:17.751230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:17.751230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:17.751230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:17.751230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:17.751230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:17.752232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:17.752232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:17.752232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:26:17.752232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:26:17.752232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:26:17.752232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:26:17.752232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:26:17.752232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:26:17.752232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 08:26:17.752232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:17.755322 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 296/589] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Sep 11 08:26:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:17.756561 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc95e4-f4d4-41f4-91ab-7183a2f9db34 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:17.800643 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:17.845176 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be8aa31-49d9-4ff7-a6df-b46a7b987403 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:17.904369 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c48d3e-9c10-4b9f-9ec2-c8f428a194ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:17.905313 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c48d3e-9c10-4b9f-9ec2-c8f428a194ef None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:17.905782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c48d3e-9c10-4b9f-9ec2-c8f428a194ef None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:17.906249 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c48d3e-9c10-4b9f-9ec2-c8f428a194ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:17.914641 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc95e4-f4d4-41f4-91ab-7183a2f9db34 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:17.917364 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c48d3e-9c10-4b9f-9ec2-c8f428a194ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:17.919296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c48d3e-9c10-4b9f-9ec2-c8f428a194ef None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:17.943198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-83c48d3e-9c10-4b9f-9ec2-c8f428a194ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:17.943198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:17.943198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:17.943198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:17.943198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:17.943198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:17.943198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:17.943198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:17.943198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:17.943198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:17.943198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:17.943198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:17.943198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:26:17.943198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:26:17.943198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:26:17.945236 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:26:17.945236 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:17.945236 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:17.945236 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:17.945236 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:17.945236 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:17.945236 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:17.945236 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:17.945236 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:17.945236 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:17.945236 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:17.945236 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:17.945236 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:17.945236 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:17.945236 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:17.945236 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:17.945236 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:17.946322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:26:17.946322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:26:17.946322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:26:17.946322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:26:17.946322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:26:17.946322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:26:17.946322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:17.946322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:17.952049 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 294/590] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:26:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:17.954097 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c48d3e-9c10-4b9f-9ec2-c8f428a194ef None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:17.972102 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd50563-c78c-4c42-bf38-eb604e9755d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:17.973335 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd50563-c78c-4c42-bf38-eb604e9755d4 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:17.974092 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd50563-c78c-4c42-bf38-eb604e9755d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:17.974660 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd50563-c78c-4c42-bf38-eb604e9755d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:17.991409 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd50563-c78c-4c42-bf38-eb604e9755d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:17.994754 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd50563-c78c-4c42-bf38-eb604e9755d4 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:18.019561 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-9fd50563-c78c-4c42-bf38-eb604e9755d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:18.019561 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:18.019561 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:18.019561 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:18.019561 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:18.019561 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:18.019561 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:18.019561 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:18.019561 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:18.019561 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:18.019561 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:18.019561 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:18.019561 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:18.019561 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:18.019561 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:18.019561 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:18.020884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:18.020884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:18.020884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:18.020884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:18.020884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:18.020884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:18.020884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:18.020884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:18.020884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:18.020884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:18.020884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:18.020884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:18.020884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:18.020884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:18.020884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:18.020884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:18.020884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:18.022685 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:18.022685 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:18.022685 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:18.025255 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 297/591] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:18.027140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd50563-c78c-4c42-bf38-eb604e9755d4 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:18.062556 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:18.132638 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c48d3e-9c10-4b9f-9ec2-c8f428a194ef None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:18.173934 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:18.177151 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08a2dc-a2d8-424e-96ce-c1ba7e0186e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:18.179682 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08a2dc-a2d8-424e-96ce-c1ba7e0186e8 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:18.180314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08a2dc-a2d8-424e-96ce-c1ba7e0186e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:18.187118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08a2dc-a2d8-424e-96ce-c1ba7e0186e8 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:18.188723 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08a2dc-a2d8-424e-96ce-c1ba7e0186e8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:18.189356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08a2dc-a2d8-424e-96ce-c1ba7e0186e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:18.192427 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08a2dc-a2d8-424e-96ce-c1ba7e0186e8 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:18.192860 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd50563-c78c-4c42-bf38-eb604e9755d4 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:18.223417 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 295/592] 10.222.0.26 () {56 vars in 1139 bytes} [Sun Sep 11 08:26:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:18.224687 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08a2dc-a2d8-424e-96ce-c1ba7e0186e8 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:18.233212 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09228c7-3375-4be6-8fa8-03ed2d7cf8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:18.234127 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09228c7-3375-4be6-8fa8-03ed2d7cf8d5 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:18.234577 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09228c7-3375-4be6-8fa8-03ed2d7cf8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:18.234999 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09228c7-3375-4be6-8fa8-03ed2d7cf8d5 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:18.236037 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09228c7-3375-4be6-8fa8-03ed2d7cf8d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:18.236593 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09228c7-3375-4be6-8fa8-03ed2d7cf8d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:18.238303 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09228c7-3375-4be6-8fa8-03ed2d7cf8d5 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:18.252426 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 298/593] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:26:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:18.253685 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09228c7-3375-4be6-8fa8-03ed2d7cf8d5 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:18.343882 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08a2dc-a2d8-424e-96ce-c1ba7e0186e8 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:18.360290 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:18.362672 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09228c7-3375-4be6-8fa8-03ed2d7cf8d5 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:18.384677 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ff1a8-f132-47f8-b173-85a04d09f4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:18.385587 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ff1a8-f132-47f8-b173-85a04d09f4ac None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:18.386012 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ff1a8-f132-47f8-b173-85a04d09f4ac None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:18.386566 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ff1a8-f132-47f8-b173-85a04d09f4ac None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:18.387449 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ff1a8-f132-47f8-b173-85a04d09f4ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:18.387934 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ff1a8-f132-47f8-b173-85a04d09f4ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:18.389714 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ff1a8-f132-47f8-b173-85a04d09f4ac None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:18.401523 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70548e32-f7d7-42ce-b622-9fa3b1f44c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:18.402173 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70548e32-f7d7-42ce-b622-9fa3b1f44c61 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:18.402510 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70548e32-f7d7-42ce-b622-9fa3b1f44c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:18.402827 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70548e32-f7d7-42ce-b622-9fa3b1f44c61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:18.404595 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 296/594] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:18.405846 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ff1a8-f132-47f8-b173-85a04d09f4ac None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:18.414990 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70548e32-f7d7-42ce-b622-9fa3b1f44c61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:18.416714 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70548e32-f7d7-42ce-b622-9fa3b1f44c61 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:18.424477 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:18.434117 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-70548e32-f7d7-42ce-b622-9fa3b1f44c61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:18.434117 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:18.434117 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:18.434117 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:18.434117 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:18.434117 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:18.434117 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:18.434117 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:18.434117 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:18.434117 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:18.434117 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:18.434117 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:18.434117 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:18.434117 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:18.434117 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:18.434117 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:18.442494 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:18.442494 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:18.442494 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:18.442494 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:18.442494 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:18.442494 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:18.442494 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:18.442494 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:18.442494 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:18.442494 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:18.442494 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:18.442494 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:18.442494 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:18.442494 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:18.442494 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:18.442494 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:18.442494 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:18.444007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:18.444007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:18.444007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:18.444007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 299/595] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:18.444007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70548e32-f7d7-42ce-b622-9fa3b1f44c61 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:18.536487 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ff1a8-f132-47f8-b173-85a04d09f4ac None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:18.550236 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70548e32-f7d7-42ce-b622-9fa3b1f44c61 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:18.576736 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2b6fd-9535-445f-9b74-768cc1d57f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:18.577985 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2b6fd-9535-445f-9b74-768cc1d57f72 None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:18.578473 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2b6fd-9535-445f-9b74-768cc1d57f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:18.579307 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2b6fd-9535-445f-9b74-768cc1d57f72 None admin] PATH_INFO: `/v3/projects/b6ed5f989f4248d7bab2548eb350fe17/users/211fa4ad83be44cd8164e0e47278273a/roles/b936dc45662c4ac195fdbf9e8ac589b0` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:18.589339 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420282ef-5136-4e04-8f96-79297d37b8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:18.590035 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420282ef-5136-4e04-8f96-79297d37b8c1 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:18.590318 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420282ef-5136-4e04-8f96-79297d37b8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:18.590591 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420282ef-5136-4e04-8f96-79297d37b8c1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:18.599277 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420282ef-5136-4e04-8f96-79297d37b8c1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:18.600218 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2b6fd-9535-445f-9b74-768cc1d57f72 None admin] RBAC: Authorizing `identity:create_grant(project_id=b6ed5f989f4248d7bab2548eb350fe17, user_id=211fa4ad83be44cd8164e0e47278273a, role_id=b936dc45662c4ac195fdbf9e8ac589b0)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:18.600876 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420282ef-5136-4e04-8f96-79297d37b8c1 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:18.602149 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2b6fd-9535-445f-9b74-768cc1d57f72 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:18.618140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-420282ef-5136-4e04-8f96-79297d37b8c1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 11 08:26:18.618140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:18.618140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:18.618140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:18.618140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:18.618140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:18.618140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:18.618140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:18.618140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:18.618140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:18.618140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:18.618140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:18.618140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:26:18.618140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:26:18.618140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:26:18.618140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:26:18.620493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:18.620493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:18.620493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:26:18.620493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:18.620493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:26:18.620493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:18.620493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:18.620493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:18.620493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:18.620493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:18.620493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:18.620493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:18.620493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:18.620493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:18.620493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:18.620493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:18.620493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:18.620493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:18.621997 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:18.621997 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:18.621997 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:26:18.621997 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:26:18.621997 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:26:18.621997 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:26:18.621997 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:26:18.621997 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:26:18.621997 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 11 08:26:18.621997 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:18.621997 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 300/596] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:26:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:18.621997 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420282ef-5136-4e04-8f96-79297d37b8c1 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:18.694542 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:18.699380 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 297/597] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Sep 11 08:26:18 2022] PUT /identity/v3/projects/b6ed5f989f4248d7bab2548eb350fe17/users/211fa4ad83be44cd8164e0e47278273a/roles/b936dc45662c4ac195fdbf9e8ac589b0 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:26:18.704742 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554760e9-0950-4bd5-a602-8b11450631e9 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:18.704742 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554760e9-0950-4bd5-a602-8b11450631e9 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:18.704742 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554760e9-0950-4bd5-a602-8b11450631e9 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:18.704742 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 298/598] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:18.704742 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554760e9-0950-4bd5-a602-8b11450631e9 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:18.734669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:18.764797 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420282ef-5136-4e04-8f96-79297d37b8c1 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:18.851753 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554760e9-0950-4bd5-a602-8b11450631e9 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:18.857456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56984756-e2fc-4ec4-b9a1-e71dd75e6d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:18.859073 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56984756-e2fc-4ec4-b9a1-e71dd75e6d19 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:18.860063 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56984756-e2fc-4ec4-b9a1-e71dd75e6d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:18.860917 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56984756-e2fc-4ec4-b9a1-e71dd75e6d19 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:18.862574 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56984756-e2fc-4ec4-b9a1-e71dd75e6d19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:18.863521 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56984756-e2fc-4ec4-b9a1-e71dd75e6d19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:18.867942 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56984756-e2fc-4ec4-b9a1-e71dd75e6d19 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:18.894519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 301/599] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:18.897365 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca66162-0ea4-4c61-92c2-78094e7baeb9 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:18.898238 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca66162-0ea4-4c61-92c2-78094e7baeb9 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:18.899046 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca66162-0ea4-4c61-92c2-78094e7baeb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:18.914760 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1ff68-5e8e-480a-8d94-6010a30b6664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:18.915704 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1ff68-5e8e-480a-8d94-6010a30b6664 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:18.916158 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1ff68-5e8e-480a-8d94-6010a30b6664 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:18.916619 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1ff68-5e8e-480a-8d94-6010a30b6664 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:18.917888 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1ff68-5e8e-480a-8d94-6010a30b6664 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:18.918382 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1ff68-5e8e-480a-8d94-6010a30b6664 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:18.921009 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1ff68-5e8e-480a-8d94-6010a30b6664 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:18.922871 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-0ca66162-0ea4-4c61-92c2-78094e7baeb9 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:18.924422 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0ca66162-0ea4-4c61-92c2-78094e7baeb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:18.956799 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 299/600] 10.222.0.26 () {56 vars in 1137 bytes} [Sun Sep 11 08:26:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:18.958063 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1ff68-5e8e-480a-8d94-6010a30b6664 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:19.031650 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 302/601] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:26:19.032952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca66162-0ea4-4c61-92c2-78094e7baeb9 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:19.085987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:19.125487 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:19.141445 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca66162-0ea4-4c61-92c2-78094e7baeb9 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:19.163993 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1ff68-5e8e-480a-8d94-6010a30b6664 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:19.233473 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbad7a9-aca2-4cb9-a3ef-3ec9d833425c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:19.234136 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbad7a9-aca2-4cb9-a3ef-3ec9d833425c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:19.234422 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbad7a9-aca2-4cb9-a3ef-3ec9d833425c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:19.237385 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbad7a9-aca2-4cb9-a3ef-3ec9d833425c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:19.262311 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbad7a9-aca2-4cb9-a3ef-3ec9d833425c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:19.266002 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbad7a9-aca2-4cb9-a3ef-3ec9d833425c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:19.267103 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bffe50-6b81-40ce-82b1-42dd9f3bc300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:19.267813 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bffe50-6b81-40ce-82b1-42dd9f3bc300 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:19.268095 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bffe50-6b81-40ce-82b1-42dd9f3bc300 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:19.268372 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bffe50-6b81-40ce-82b1-42dd9f3bc300 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:19.290623 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bffe50-6b81-40ce-82b1-42dd9f3bc300 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:19.292254 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bffe50-6b81-40ce-82b1-42dd9f3bc300 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:19.298432 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-0cbad7a9-aca2-4cb9-a3ef-3ec9d833425c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:19.298432 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:19.298432 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:19.298432 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:19.298432 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:19.298432 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:19.298432 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:19.298432 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:19.298432 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:19.298432 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:19.298432 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:19.298432 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:19.298432 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:19.298432 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:19.298432 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:19.298432 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:19.299522 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:19.299522 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:19.299522 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:19.299522 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:19.299522 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:19.299522 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:19.299522 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:19.299522 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:19.299522 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:19.299522 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:19.299522 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:19.299522 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:19.299522 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:19.299522 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:19.299522 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:19.299522 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:19.299522 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:19.300424 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:19.300424 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:19.300424 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:19.307021 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 303/602] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:19.314557 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbad7a9-aca2-4cb9-a3ef-3ec9d833425c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:19.322209 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-b4bffe50-6b81-40ce-82b1-42dd9f3bc300 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:19.322209 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:19.322209 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:19.322209 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:19.322209 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:19.322209 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:19.322209 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:19.322209 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:19.322209 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:19.322209 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:19.322209 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:19.322209 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:19.322209 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:26:19.322209 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:26:19.322209 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:26:19.323198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:26:19.323198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:19.323198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:19.323198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:19.323198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:19.323198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:19.323198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:19.323198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:19.323198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:19.323198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:19.323198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:19.323198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:19.323198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:19.323198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:19.323198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:19.323198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:19.323198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:19.324182 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:26:19.324182 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:26:19.324182 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:26:19.324182 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:26:19.324182 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:26:19.324182 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:26:19.324182 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:19.324182 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:19.327062 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 300/603] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:26:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:19.332876 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bffe50-6b81-40ce-82b1-42dd9f3bc300 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:19.494297 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bffe50-6b81-40ce-82b1-42dd9f3bc300 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:19.539979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8dc1d9-9ce0-4c2b-8678-b334acd47082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:19.540611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8dc1d9-9ce0-4c2b-8678-b334acd47082 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:19.541064 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8dc1d9-9ce0-4c2b-8678-b334acd47082 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:19.541483 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8dc1d9-9ce0-4c2b-8678-b334acd47082 None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:19.542203 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8dc1d9-9ce0-4c2b-8678-b334acd47082 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:19.542515 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8dc1d9-9ce0-4c2b-8678-b334acd47082 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:19.544206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8dc1d9-9ce0-4c2b-8678-b334acd47082 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:19.544748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:19.552922 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbad7a9-aca2-4cb9-a3ef-3ec9d833425c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:19.560910 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 301/604] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:26:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:19.561690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8dc1d9-9ce0-4c2b-8678-b334acd47082 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:19.567459 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:19.615085 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e0721-0210-46b4-a3c5-f441c6fb09b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:19.616209 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e0721-0210-46b4-a3c5-f441c6fb09b0 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:19.616693 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e0721-0210-46b4-a3c5-f441c6fb09b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:19.617248 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e0721-0210-46b4-a3c5-f441c6fb09b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:19.618411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e0721-0210-46b4-a3c5-f441c6fb09b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:19.618943 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e0721-0210-46b4-a3c5-f441c6fb09b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:19.621553 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e0721-0210-46b4-a3c5-f441c6fb09b0 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:19.651298 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 304/605] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:26:19.651298 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8377e-796b-45ee-ade1-cd0cf5ec8a93 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:19.651298 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8377e-796b-45ee-ade1-cd0cf5ec8a93 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:19.651298 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8377e-796b-45ee-ade1-cd0cf5ec8a93 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:19.652043 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 305/606] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:19.653894 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8377e-796b-45ee-ade1-cd0cf5ec8a93 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:19.706482 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8dc1d9-9ce0-4c2b-8678-b334acd47082 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:19.757274 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0f24e-a853-4c6e-8152-2672d80cb17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:19.758042 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0f24e-a853-4c6e-8152-2672d80cb17d None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:19.758743 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0f24e-a853-4c6e-8152-2672d80cb17d None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:19.758743 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0f24e-a853-4c6e-8152-2672d80cb17d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:19.774622 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0f24e-a853-4c6e-8152-2672d80cb17d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:26:19.780850 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-fdc0f24e-a853-4c6e-8152-2672d80cb17d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:19.780850 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:19.780850 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:19.780850 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:19.780850 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:19.780850 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:19.780850 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:19.780850 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:19.780850 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:19.780850 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:19.780850 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:19.780850 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:19.780850 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:26:19.780850 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:26:19.780850 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:26:19.780850 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:26:19.782019 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:26:19.782019 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:26:19.782019 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:26:19.782019 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:26:19.782019 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:19.782019 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:19.782019 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:19.782019 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:19.782019 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:19.782019 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:19.782019 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:19.782019 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:19.782019 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:19.782019 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:19.782019 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:19.782019 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:19.783092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:19.783092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:19.783092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:19.783092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:19.783092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:26:19.783092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:26:19.783092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:26:19.783092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:26:19.783092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:26:19.783092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:26:19.783092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:19.783092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:19.783787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 302/607] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Sep 11 08:26:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:19.785456 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0f24e-a853-4c6e-8152-2672d80cb17d None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:19.818268 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8377e-796b-45ee-ade1-cd0cf5ec8a93 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:19.868684 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0798e-80b6-4059-9369-e99549d0bda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:19.869464 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0798e-80b6-4059-9369-e99549d0bda1 None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:19.869793 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0798e-80b6-4059-9369-e99549d0bda1 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:19.870142 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0798e-80b6-4059-9369-e99549d0bda1 None admin] PATH_INFO: `/v3/projects/b6ed5f989f4248d7bab2548eb350fe17/users/7c86ca1e378c4042a1807c7a45aaab99/roles/b936dc45662c4ac195fdbf9e8ac589b0` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:19.885424 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:19.891963 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e0798e-80b6-4059-9369-e99549d0bda1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b6ed5f989f4248d7bab2548eb350fe17, user_id=7c86ca1e378c4042a1807c7a45aaab99, role_id=b936dc45662c4ac195fdbf9e8ac589b0)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:19.893508 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e0798e-80b6-4059-9369-e99549d0bda1 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:19.952246 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0f24e-a853-4c6e-8152-2672d80cb17d None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:19.991097 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332e5ca-91eb-43be-a2ca-f98169df3f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:19.991766 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332e5ca-91eb-43be-a2ca-f98169df3f30 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:19.992597 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332e5ca-91eb-43be-a2ca-f98169df3f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:19.992597 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332e5ca-91eb-43be-a2ca-f98169df3f30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:19.999938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332e5ca-91eb-43be-a2ca-f98169df3f30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:20.001432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332e5ca-91eb-43be-a2ca-f98169df3f30 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:20.015487 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 306/608] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Sep 11 08:26:19 2022] PUT /identity/v3/projects/b6ed5f989f4248d7bab2548eb350fe17/users/7c86ca1e378c4042a1807c7a45aaab99/roles/b936dc45662c4ac195fdbf9e8ac589b0 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:26:20.015487 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d29aa7-8cab-4b87-9660-a991591e17c9 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:20.015487 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d29aa7-8cab-4b87-9660-a991591e17c9 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:20.015487 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d29aa7-8cab-4b87-9660-a991591e17c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:20.016084 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-b332e5ca-91eb-43be-a2ca-f98169df3f30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:20.016084 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:20.016084 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:20.016084 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:20.016084 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:20.016084 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:20.016084 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:20.016084 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:20.016084 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:20.016084 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:20.016084 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:20.016084 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:20.016084 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:26:20.016084 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:26:20.016084 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:26:20.017803 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:26:20.017803 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:20.017803 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:20.017803 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:20.017803 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:20.017803 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:20.017803 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:20.017803 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:20.017803 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:20.017803 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:20.017803 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:20.017803 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:20.017803 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:20.017803 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:20.017803 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:20.017803 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:20.017803 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:20.018760 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:26:20.018760 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:26:20.018760 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:26:20.018760 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:26:20.018760 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:26:20.018760 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:26:20.018760 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:20.018760 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:20.018760 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 303/609] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:26:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:20.018760 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332e5ca-91eb-43be-a2ca-f98169df3f30 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:20.056903 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-a8d29aa7-8cab-4b87-9660-a991591e17c9 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:20.059412 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a8d29aa7-8cab-4b87-9660-a991591e17c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:20.064749 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:20.215194 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 307/610] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:26:20.216997 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d29aa7-8cab-4b87-9660-a991591e17c9 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:20.229647 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332e5ca-91eb-43be-a2ca-f98169df3f30 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:20.274929 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:20.296435 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fe977-cf0f-40ed-aacd-725b39d46ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:20.297380 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fe977-cf0f-40ed-aacd-725b39d46ddc None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:20.297961 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fe977-cf0f-40ed-aacd-725b39d46ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:20.298407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fe977-cf0f-40ed-aacd-725b39d46ddc None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:20.299736 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15fe977-cf0f-40ed-aacd-725b39d46ddc None admin] RBAC: Adding query filter params (name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:20.300230 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15fe977-cf0f-40ed-aacd-725b39d46ddc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:20.302726 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15fe977-cf0f-40ed-aacd-725b39d46ddc None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:20.321355 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 304/611] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Sep 11 08:26:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:20.333319 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fe977-cf0f-40ed-aacd-725b39d46ddc None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:20.487428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d29aa7-8cab-4b87-9660-a991591e17c9 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:20.558277 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fe977-cf0f-40ed-aacd-725b39d46ddc None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:20.578129 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d00855-f779-427b-86f6-1a7f245e84e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:20.579769 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d00855-f779-427b-86f6-1a7f245e84e0 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:20.580348 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d00855-f779-427b-86f6-1a7f245e84e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:20.580827 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d00855-f779-427b-86f6-1a7f245e84e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:20.581769 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d00855-f779-427b-86f6-1a7f245e84e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:20.582291 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d00855-f779-427b-86f6-1a7f245e84e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:20.584597 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d00855-f779-427b-86f6-1a7f245e84e0 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:20.595203 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:20.604630 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 308/612] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:26:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:20.606270 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d00855-f779-427b-86f6-1a7f245e84e0 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:20.631481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903ccf0-b2b8-463b-a417-376c7f345277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:20.632606 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903ccf0-b2b8-463b-a417-376c7f345277 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:20.633102 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903ccf0-b2b8-463b-a417-376c7f345277 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:20.633684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903ccf0-b2b8-463b-a417-376c7f345277 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:20.651212 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903ccf0-b2b8-463b-a417-376c7f345277 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:20.653290 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903ccf0-b2b8-463b-a417-376c7f345277 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:20.675400 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-7903ccf0-b2b8-463b-a417-376c7f345277 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:20.675400 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:20.675400 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:20.675400 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:20.675400 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:20.675400 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:20.675400 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:20.675400 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:20.675400 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:20.675400 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:20.675400 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:20.675400 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:20.675400 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:20.675400 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:20.675400 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:20.675400 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:20.676381 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:20.676381 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:20.676381 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:20.676381 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:20.676381 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:20.676381 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:20.676381 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:20.676381 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:20.676381 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:20.676381 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:20.676381 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:20.676381 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:20.676381 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:20.676381 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:20.676381 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:20.676381 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:20.676381 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:20.677288 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:20.677288 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:20.677288 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:20.680102 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 305/613] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:20.681299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903ccf0-b2b8-463b-a417-376c7f345277 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:20.757646 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:20.831384 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d00855-f779-427b-86f6-1a7f245e84e0 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:20.853401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903ccf0-b2b8-463b-a417-376c7f345277 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:20.895921 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13f513-1a00-4312-80c6-90e1aa88e1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:20.896782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13f513-1a00-4312-80c6-90e1aa88e1a0 None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:20.897168 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13f513-1a00-4312-80c6-90e1aa88e1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:20.897557 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13f513-1a00-4312-80c6-90e1aa88e1a0 None admin] PATH_INFO: `/v3/projects/b6ed5f989f4248d7bab2548eb350fe17/users/7690af0cd266458f9cdd799c98ff5bfd/roles/b936dc45662c4ac195fdbf9e8ac589b0` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:20.916120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13f513-1a00-4312-80c6-90e1aa88e1a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=b6ed5f989f4248d7bab2548eb350fe17, user_id=7690af0cd266458f9cdd799c98ff5bfd, role_id=b936dc45662c4ac195fdbf9e8ac589b0)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:20.917907 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13f513-1a00-4312-80c6-90e1aa88e1a0 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:20.919876 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c2a23-2551-4e4f-8383-44ebcac8f5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:20.922341 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c2a23-2551-4e4f-8383-44ebcac8f5e6 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:20.923370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c2a23-2551-4e4f-8383-44ebcac8f5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:20.923889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c2a23-2551-4e4f-8383-44ebcac8f5e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:20.944540 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c2a23-2551-4e4f-8383-44ebcac8f5e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:26:20.955603 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-d96c2a23-2551-4e4f-8383-44ebcac8f5e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:20.955603 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:20.955603 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:20.955603 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:20.955603 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:20.955603 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:20.955603 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:20.955603 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:20.955603 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:20.955603 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:20.955603 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:20.955603 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:20.955603 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:26:20.955603 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:26:20.955603 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:26:20.955603 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:26:20.956670 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:26:20.956670 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:26:20.956670 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:26:20.956670 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:26:20.956670 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:20.956670 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:20.956670 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:20.956670 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:20.956670 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:20.956670 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:20.956670 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:20.956670 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:20.956670 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:20.956670 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:20.956670 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:20.956670 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:20.957507 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:20.957507 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:20.957507 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:20.957507 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:20.957507 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:26:20.957507 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:26:20.957507 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:26:20.957507 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:26:20.957507 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:26:20.957507 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:26:20.957507 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:20.957507 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:20.964796 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 309/614] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Sep 11 08:26:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:20.964796 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c2a23-2551-4e4f-8383-44ebcac8f5e6 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:21.011827 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 306/615] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Sep 11 08:26:20 2022] PUT /identity/v3/projects/b6ed5f989f4248d7bab2548eb350fe17/users/7690af0cd266458f9cdd799c98ff5bfd/roles/b936dc45662c4ac195fdbf9e8ac589b0 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:26:21.013291 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13f513-1a00-4312-80c6-90e1aa88e1a0 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:21.126455 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:21.145437 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:21.146601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13f513-1a00-4312-80c6-90e1aa88e1a0 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:21.190670 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58124ce6-7c8b-4691-80ee-1a4c3de8102c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:21.191729 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58124ce6-7c8b-4691-80ee-1a4c3de8102c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:21.192219 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58124ce6-7c8b-4691-80ee-1a4c3de8102c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:21.192695 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58124ce6-7c8b-4691-80ee-1a4c3de8102c None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:21.193740 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58124ce6-7c8b-4691-80ee-1a4c3de8102c None admin] RBAC: Adding query filter params (name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:21.194926 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58124ce6-7c8b-4691-80ee-1a4c3de8102c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:21.197592 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58124ce6-7c8b-4691-80ee-1a4c3de8102c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:21.208606 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 307/616] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Sep 11 08:26:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:21.215934 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58124ce6-7c8b-4691-80ee-1a4c3de8102c None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:21.298477 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c2a23-2551-4e4f-8383-44ebcac8f5e6 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:21.440247 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf96172-c4cb-435d-91e9-11646b4c4560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:21.440803 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf96172-c4cb-435d-91e9-11646b4c4560 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:21.441088 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf96172-c4cb-435d-91e9-11646b4c4560 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:21.441355 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf96172-c4cb-435d-91e9-11646b4c4560 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:21.442051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf96172-c4cb-435d-91e9-11646b4c4560 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:21.442363 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf96172-c4cb-435d-91e9-11646b4c4560 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:21.443977 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf96172-c4cb-435d-91e9-11646b4c4560 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:21.471751 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 310/617] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 513 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:21.483423 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf96172-c4cb-435d-91e9-11646b4c4560 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:21.496317 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58124ce6-7c8b-4691-80ee-1a4c3de8102c None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:21.563145 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233a46d-78fe-4d5a-8937-8aee4f19a041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:21.564341 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233a46d-78fe-4d5a-8937-8aee4f19a041 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:21.564911 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233a46d-78fe-4d5a-8937-8aee4f19a041 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:21.565449 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233a46d-78fe-4d5a-8937-8aee4f19a041 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:21.588119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3233a46d-78fe-4d5a-8937-8aee4f19a041 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:21.590606 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3233a46d-78fe-4d5a-8937-8aee4f19a041 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:21.606915 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:21.625568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-3233a46d-78fe-4d5a-8937-8aee4f19a041 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:21.625568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:21.625568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:21.625568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:21.625568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:21.625568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:21.625568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:21.625568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:21.625568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:21.625568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:21.625568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:21.625568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:21.625568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:21.625568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:21.625568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:21.625568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:21.637126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:21.637126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:21.637126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:21.637126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:21.637126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:21.637126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:21.637126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:21.637126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:21.637126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:21.637126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:21.637126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:21.637126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:21.637126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:21.637126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:21.637126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:21.637126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:21.637126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:21.639143 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:21.639143 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:21.639143 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:21.639143 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 308/618] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 419 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:21.645673 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233a46d-78fe-4d5a-8937-8aee4f19a041 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:21.707085 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf96172-c4cb-435d-91e9-11646b4c4560 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:21.748850 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:21.778502 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd49265-2e41-4a34-bb9d-19920ed460ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:21.779992 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd49265-2e41-4a34-bb9d-19920ed460ef None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:21.780685 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd49265-2e41-4a34-bb9d-19920ed460ef None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:21.781373 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd49265-2e41-4a34-bb9d-19920ed460ef None admin] PATH_INFO: `/v3/users/swift` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:21.799763 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd49265-2e41-4a34-bb9d-19920ed460ef None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:21.802934 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd49265-2e41-4a34-bb9d-19920ed460ef None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:21.832994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-1bd49265-2e41-4a34-bb9d-19920ed460ef None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 08:26:21.832994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:21.832994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:21.832994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:21.832994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:21.832994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:21.832994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:21.832994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:21.832994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:21.832994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:21.832994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:21.832994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:21.832994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:26:21.832994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:26:21.832994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:26:21.832994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:26:21.835617 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:21.835617 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:21.835617 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:26:21.835617 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:21.835617 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:26:21.835617 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:21.835617 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:21.835617 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:21.835617 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:21.835617 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:21.835617 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:21.835617 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:21.835617 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:21.835617 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:21.835617 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:21.835617 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:21.835617 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:21.835617 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:21.837562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:21.837562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:21.837562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:26:21.837562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:26:21.837562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:26:21.837562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:26:21.837562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:26:21.837562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:26:21.837562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 08:26:21.837562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:21.842766 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 311/619] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:26:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:21.850152 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e59d54-3a7b-4405-b739-6278853675ab None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:21.850454 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e59d54-3a7b-4405-b739-6278853675ab None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:21.850672 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e59d54-3a7b-4405-b739-6278853675ab None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:21.852344 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 312/620] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:21.857340 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e59d54-3a7b-4405-b739-6278853675ab None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:21.958080 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233a46d-78fe-4d5a-8937-8aee4f19a041 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:22.020255 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e59d54-3a7b-4405-b739-6278853675ab None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:22.033023 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368b9a2-45fc-4281-92fc-719ccf8fd4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:22.034396 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368b9a2-45fc-4281-92fc-719ccf8fd4bf None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:22.035173 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368b9a2-45fc-4281-92fc-719ccf8fd4bf None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:22.036011 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368b9a2-45fc-4281-92fc-719ccf8fd4bf None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:22.037490 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368b9a2-45fc-4281-92fc-719ccf8fd4bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:22.038374 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368b9a2-45fc-4281-92fc-719ccf8fd4bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:22.040397 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368b9a2-45fc-4281-92fc-719ccf8fd4bf None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:22.062621 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c2a43-6fd3-4864-a42d-d8b3685f3177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:22.063360 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c2a43-6fd3-4864-a42d-d8b3685f3177 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:22.063823 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c2a43-6fd3-4864-a42d-d8b3685f3177 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:22.064102 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c2a43-6fd3-4864-a42d-d8b3685f3177 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:22.064870 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c2a43-6fd3-4864-a42d-d8b3685f3177 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:22.065182 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c2a43-6fd3-4864-a42d-d8b3685f3177 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:22.066470 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 309/621] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:22.069818 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acd674-4ed1-4d1a-bcc3-c46df0231cf6 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:22.070772 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acd674-4ed1-4d1a-bcc3-c46df0231cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:22.071524 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acd674-4ed1-4d1a-bcc3-c46df0231cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:22.072185 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c2a43-6fd3-4864-a42d-d8b3685f3177 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:22.099296 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 313/622] 10.222.0.26 () {56 vars in 1135 bytes} [Sun Sep 11 08:26:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:22.099296 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c2a43-6fd3-4864-a42d-d8b3685f3177 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:22.110664 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-92acd674-4ed1-4d1a-bcc3-c46df0231cf6 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:22.113319 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-92acd674-4ed1-4d1a-bcc3-c46df0231cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:22.147572 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:22.206210 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:22.220283 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 310/623] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:26:22.221587 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acd674-4ed1-4d1a-bcc3-c46df0231cf6 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:22.245778 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c2a43-6fd3-4864-a42d-d8b3685f3177 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:22.317541 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43fa9ec-3fbc-4898-a2d8-71cd53b91a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:22.319130 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fa9ec-3fbc-4898-a2d8-71cd53b91a74 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:22.319676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fa9ec-3fbc-4898-a2d8-71cd53b91a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:22.320168 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fa9ec-3fbc-4898-a2d8-71cd53b91a74 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:22.340641 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43fa9ec-3fbc-4898-a2d8-71cd53b91a74 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:22.342599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43fa9ec-3fbc-4898-a2d8-71cd53b91a74 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:22.364025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-d43fa9ec-3fbc-4898-a2d8-71cd53b91a74 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 08:26:22.364025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:22.364025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:22.364025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:22.364025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:22.364025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:22.364025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:22.364025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:22.364025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:22.364025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:22.364025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:22.364025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:22.364025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:26:22.364025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:26:22.364025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:26:22.364025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:26:22.365602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:22.365602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:22.365602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:26:22.365602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:22.365602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:26:22.365602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:22.365602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:22.365602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:22.365602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:22.365602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:22.365602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:22.365602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:22.365602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:22.365602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:22.365602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:22.365602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:22.365602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:22.365602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:22.366599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:22.366599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:22.366599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:26:22.366599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:26:22.366599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:26:22.366599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:26:22.366599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:26:22.366599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:26:22.366599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 08:26:22.366599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:22.375100 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 314/624] 10.222.0.26 () {56 vars in 1093 bytes} [Sun Sep 11 08:26:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:22.397325 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43fa9ec-3fbc-4898-a2d8-71cd53b91a74 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:22.448593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acd674-4ed1-4d1a-bcc3-c46df0231cf6 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:22.522373 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d4fb9-8f0b-4c93-80b0-fd720eead49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:22.523550 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d4fb9-8f0b-4c93-80b0-fd720eead49b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:22.524048 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d4fb9-8f0b-4c93-80b0-fd720eead49b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:22.524515 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d4fb9-8f0b-4c93-80b0-fd720eead49b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:22.546161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d4fb9-8f0b-4c93-80b0-fd720eead49b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:22.548948 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d4fb9-8f0b-4c93-80b0-fd720eead49b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:22.576112 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43fa9ec-3fbc-4898-a2d8-71cd53b91a74 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:22.578979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-8e4d4fb9-8f0b-4c93-80b0-fd720eead49b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:22.578979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:22.578979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:22.578979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:22.578979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:22.578979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:22.578979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:22.578979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:22.578979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:22.578979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:22.578979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:22.578979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:22.578979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:22.578979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:22.578979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:22.578979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:22.580254 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:22.580254 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:22.580254 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:22.580254 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:22.580254 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:22.580254 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:22.580254 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:22.580254 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:22.580254 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:22.580254 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:22.580254 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:22.580254 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:22.580254 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:22.580254 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:22.580254 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:22.580254 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:22.580254 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:22.581207 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:22.581207 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:22.581207 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:22.582069 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 311/625] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:22.592171 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb17ac-cfec-4557-8c60-889b090557b0 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:22.592645 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb17ac-cfec-4557-8c60-889b090557b0 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:22.593133 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb17ac-cfec-4557-8c60-889b090557b0 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:22.596454 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 312/626] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:22 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:22.598199 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb17ac-cfec-4557-8c60-889b090557b0 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:22.603809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:22.628527 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70b898-2420-476e-9039-ff5717ff253a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:22.630233 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70b898-2420-476e-9039-ff5717ff253a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:22.630789 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70b898-2420-476e-9039-ff5717ff253a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:22.631636 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70b898-2420-476e-9039-ff5717ff253a None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:22.632620 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c70b898-2420-476e-9039-ff5717ff253a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:22.633134 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c70b898-2420-476e-9039-ff5717ff253a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:22.635862 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c70b898-2420-476e-9039-ff5717ff253a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:22.660054 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 315/627] 10.222.0.26 () {56 vars in 1133 bytes} [Sun Sep 11 08:26:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:22.661730 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521be43-3747-4bf2-990b-c8e4f80b38a6 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:22.662788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521be43-3747-4bf2-990b-c8e4f80b38a6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:22.663303 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521be43-3747-4bf2-990b-c8e4f80b38a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:22.686510 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:22.690711 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-3521be43-3747-4bf2-990b-c8e4f80b38a6 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:22.692212 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3521be43-3747-4bf2-990b-c8e4f80b38a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:22.795423 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 316/628] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:26:22.795423 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521be43-3747-4bf2-990b-c8e4f80b38a6 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:22.801295 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb17ac-cfec-4557-8c60-889b090557b0 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:22.853046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1b90e-53b6-417d-83dd-e0601be576eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:22.853851 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1b90e-53b6-417d-83dd-e0601be576eb None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:22.854145 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1b90e-53b6-417d-83dd-e0601be576eb None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:22.854787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1b90e-53b6-417d-83dd-e0601be576eb None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:22.855761 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1b90e-53b6-417d-83dd-e0601be576eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:22.856071 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1b90e-53b6-417d-83dd-e0601be576eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:22.858030 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1b90e-53b6-417d-83dd-e0601be576eb None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:22.879446 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 313/629] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:22.881770 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1b90e-53b6-417d-83dd-e0601be576eb None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:22.892899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:22.910631 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521be43-3747-4bf2-990b-c8e4f80b38a6 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:22.950586 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed2691-c505-45d7-9626-267f197177fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:22.951525 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed2691-c505-45d7-9626-267f197177fa None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:22.952111 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed2691-c505-45d7-9626-267f197177fa None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:22.952623 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed2691-c505-45d7-9626-267f197177fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:22.968192 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed2691-c505-45d7-9626-267f197177fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:26:22.973838 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-a4ed2691-c505-45d7-9626-267f197177fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:22.973838 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:22.973838 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:22.973838 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:22.973838 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:22.973838 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:22.973838 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:22.973838 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:22.973838 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:22.973838 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:22.973838 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:22.973838 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:22.973838 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:26:22.973838 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:26:22.973838 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:26:22.973838 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:26:22.975615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:26:22.975615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:26:22.975615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:26:22.975615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:26:22.975615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:22.975615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:22.975615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:22.975615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:22.975615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:22.975615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:22.975615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:22.975615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:22.975615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:22.975615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:22.975615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:22.975615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:22.976474 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:22.976474 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:22.976474 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:22.976474 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:22.976474 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:26:22.976474 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:26:22.976474 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:26:22.976474 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:26:22.976474 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:26:22.976474 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:26:22.976474 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:22.976474 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:22.985159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 317/630] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Sep 11 08:26:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:22.986476 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed2691-c505-45d7-9626-267f197177fa None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:23.015428 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1b90e-53b6-417d-83dd-e0601be576eb None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:23.017265 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:23.068079 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3baf268-5f77-44f0-90bd-f087f4fcd6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:23.069233 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baf268-5f77-44f0-90bd-f087f4fcd6e3 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:23.069883 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baf268-5f77-44f0-90bd-f087f4fcd6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:23.070437 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baf268-5f77-44f0-90bd-f087f4fcd6e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:23.116705 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed2691-c505-45d7-9626-267f197177fa None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:23.166396 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de947d-09ff-4079-99d5-06e09b222254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:23.167768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de947d-09ff-4079-99d5-06e09b222254 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:23.168247 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de947d-09ff-4079-99d5-06e09b222254 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:23.169299 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de947d-09ff-4079-99d5-06e09b222254 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:23.187241 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de947d-09ff-4079-99d5-06e09b222254 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:23.191128 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de947d-09ff-4079-99d5-06e09b222254 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:23.193104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3baf268-5f77-44f0-90bd-f087f4fcd6e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:23.195667 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3baf268-5f77-44f0-90bd-f087f4fcd6e3 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:23.208166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-83de947d-09ff-4079-99d5-06e09b222254 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:23.208166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:23.208166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:23.208166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:23.208166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:23.208166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:23.208166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:23.208166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:23.208166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:23.208166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:23.208166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:23.208166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:23.208166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:26:23.208166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:26:23.208166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:26:23.209732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:26:23.209732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:23.209732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:23.209732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:23.209732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:23.209732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:23.209732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:23.209732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:23.209732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:23.209732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:23.209732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:23.209732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:23.209732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:23.209732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:23.209732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:23.209732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:23.209732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:23.210636 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:26:23.210636 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:26:23.210636 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:26:23.210636 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:26:23.210636 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:26:23.210636 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:26:23.210636 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:23.210636 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:23.214353 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 318/631] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:26:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:23.215653 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de947d-09ff-4079-99d5-06e09b222254 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:23.225599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:23.341339 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de947d-09ff-4079-99d5-06e09b222254 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:23.384662 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 314/632] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:26:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 08:26:23.386154 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3baf268-5f77-44f0-90bd-f087f4fcd6e3 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:23.389163 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:23.398749 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30aa65-be25-4ba0-8b7c-909c0a667e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:23.399827 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30aa65-be25-4ba0-8b7c-909c0a667e77 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:23.400293 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30aa65-be25-4ba0-8b7c-909c0a667e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:23.400898 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30aa65-be25-4ba0-8b7c-909c0a667e77 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:23.401942 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30aa65-be25-4ba0-8b7c-909c0a667e77 None admin] RBAC: Adding query filter params (name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:23.402456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30aa65-be25-4ba0-8b7c-909c0a667e77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:23.405026 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30aa65-be25-4ba0-8b7c-909c0a667e77 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:23.423745 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 319/633] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Sep 11 08:26:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:23.423745 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30aa65-be25-4ba0-8b7c-909c0a667e77 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:23.523693 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:23.534185 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3baf268-5f77-44f0-90bd-f087f4fcd6e3 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:23.568956 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30aa65-be25-4ba0-8b7c-909c0a667e77 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:23.582754 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164ef07-c4eb-4c3f-9b3a-21e34ec5e9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:23.583656 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164ef07-c4eb-4c3f-9b3a-21e34ec5e9f5 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:23.584239 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164ef07-c4eb-4c3f-9b3a-21e34ec5e9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:23.584659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164ef07-c4eb-4c3f-9b3a-21e34ec5e9f5 None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:23.585880 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164ef07-c4eb-4c3f-9b3a-21e34ec5e9f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:23.586406 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164ef07-c4eb-4c3f-9b3a-21e34ec5e9f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:23.588519 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164ef07-c4eb-4c3f-9b3a-21e34ec5e9f5 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:23.612439 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 315/634] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:26:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:23.612439 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164ef07-c4eb-4c3f-9b3a-21e34ec5e9f5 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:23.620396 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd545745-4524-4747-a5be-fa6b2d3f1a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:23.621160 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd545745-4524-4747-a5be-fa6b2d3f1a7f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:23.621534 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd545745-4524-4747-a5be-fa6b2d3f1a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:23.621879 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd545745-4524-4747-a5be-fa6b2d3f1a7f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:23.636410 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd545745-4524-4747-a5be-fa6b2d3f1a7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:26:23.643026 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-dd545745-4524-4747-a5be-fa6b2d3f1a7f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:23.643026 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:23.643026 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:23.643026 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:23.643026 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:23.643026 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:23.643026 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:23.643026 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:23.643026 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:23.643026 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:23.643026 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:23.643026 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:23.643026 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:26:23.643026 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:26:23.643026 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:26:23.643026 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:26:23.645242 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:26:23.645242 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:26:23.645242 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:26:23.645242 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:26:23.645242 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:23.645242 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:23.645242 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:23.645242 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:23.645242 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:23.645242 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:23.645242 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:23.645242 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:23.645242 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:23.645242 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:23.645242 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:23.645242 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:23.647852 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:23.647852 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:23.647852 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:23.647852 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:23.647852 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:26:23.647852 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:26:23.647852 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:26:23.647852 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:26:23.647852 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:26:23.647852 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:26:23.647852 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:23.647852 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:23.647852 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 320/635] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Sep 11 08:26:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:23.648858 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd545745-4524-4747-a5be-fa6b2d3f1a7f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:23.706923 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:23.765598 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164ef07-c4eb-4c3f-9b3a-21e34ec5e9f5 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:23.793925 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd545745-4524-4747-a5be-fa6b2d3f1a7f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:23.819466 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe73bf-8038-40d4-9b0d-5faa89a9cfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:23.820657 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe73bf-8038-40d4-9b0d-5faa89a9cfdd None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:23.821219 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe73bf-8038-40d4-9b0d-5faa89a9cfdd None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:23.821780 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe73bf-8038-40d4-9b0d-5faa89a9cfdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:23.839724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe73bf-8038-40d4-9b0d-5faa89a9cfdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:23.840029 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:23.842508 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe73bf-8038-40d4-9b0d-5faa89a9cfdd None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:23.853365 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843eeda-e2b5-4d84-83f5-9fb3977e107c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:23.854346 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843eeda-e2b5-4d84-83f5-9fb3977e107c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:23.855370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843eeda-e2b5-4d84-83f5-9fb3977e107c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:23.855370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843eeda-e2b5-4d84-83f5-9fb3977e107c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:23.870015 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-2cfe73bf-8038-40d4-9b0d-5faa89a9cfdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:23.870015 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:23.870015 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:23.870015 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:23.870015 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:23.870015 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:23.870015 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:23.870015 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:23.870015 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:23.870015 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:23.870015 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:23.870015 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:23.870015 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:23.870015 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:23.870015 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:23.870015 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:23.872161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:23.872161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:23.872161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:23.872161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:23.872161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:23.872161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:23.872161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:23.872161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:23.872161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:23.872161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:23.872161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:23.872161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:23.872161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:23.872161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:23.872161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:23.872161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:23.872161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:23.874204 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:23.874204 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:23.874204 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:23.874628 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843eeda-e2b5-4d84-83f5-9fb3977e107c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:23.874628 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843eeda-e2b5-4d84-83f5-9fb3977e107c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:23.881613 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 316/636] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:23.881613 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe73bf-8038-40d4-9b0d-5faa89a9cfdd None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:23.906149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-d843eeda-e2b5-4d84-83f5-9fb3977e107c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:23.906149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:23.906149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:23.906149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:23.906149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:23.906149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:23.906149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:23.906149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:23.906149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:23.906149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:23.906149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:23.906149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:23.906149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:23.906149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:23.906149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:23.906149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:23.908330 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:23.908330 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:23.908330 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:23.908330 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:23.908330 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:23.908330 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:23.908330 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:23.908330 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:23.908330 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:23.908330 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:23.908330 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:23.908330 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:23.908330 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:23.908330 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:23.908330 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:23.908330 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:23.908330 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:23.910147 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:23.910147 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:23.910147 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:23.910147 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 321/637] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:23.910688 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843eeda-e2b5-4d84-83f5-9fb3977e107c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:24.024297 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe73bf-8038-40d4-9b0d-5faa89a9cfdd None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:24.042735 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:24.082430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb1cfd-f507-48ae-be6c-867b5efcadae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:24.083537 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb1cfd-f507-48ae-be6c-867b5efcadae None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:24.083959 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb1cfd-f507-48ae-be6c-867b5efcadae None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:24.084428 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb1cfd-f507-48ae-be6c-867b5efcadae None admin] PATH_INFO: `/v3/projects/b6ed5f989f4248d7bab2548eb350fe17/users/d1a4f25df9724d34afdd6a41e719546a/roles/b936dc45662c4ac195fdbf9e8ac589b0` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:24.088788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843eeda-e2b5-4d84-83f5-9fb3977e107c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:24.109597 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb1cfd-f507-48ae-be6c-867b5efcadae None admin] RBAC: Authorizing `identity:create_grant(project_id=b6ed5f989f4248d7bab2548eb350fe17, user_id=d1a4f25df9724d34afdd6a41e719546a, role_id=b936dc45662c4ac195fdbf9e8ac589b0)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:24.115839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb1cfd-f507-48ae-be6c-867b5efcadae None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:24.140856 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a5e24-71ed-4339-8fe1-cf1b596e446c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:24.141390 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a5e24-71ed-4339-8fe1-cf1b596e446c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:24.141668 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a5e24-71ed-4339-8fe1-cf1b596e446c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:24.141941 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a5e24-71ed-4339-8fe1-cf1b596e446c None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:24.142623 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a5e24-71ed-4339-8fe1-cf1b596e446c None admin] RBAC: Adding query filter params (name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:24.142920 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a5e24-71ed-4339-8fe1-cf1b596e446c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:24.144373 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a5e24-71ed-4339-8fe1-cf1b596e446c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:24.163917 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 322/638] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Sep 11 08:26:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:24.163917 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a5e24-71ed-4339-8fe1-cf1b596e446c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:24.228334 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 317/639] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Sep 11 08:26:23 2022] PUT /identity/v3/projects/b6ed5f989f4248d7bab2548eb350fe17/users/d1a4f25df9724d34afdd6a41e719546a/roles/b936dc45662c4ac195fdbf9e8ac589b0 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:26:24.230130 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb1cfd-f507-48ae-be6c-867b5efcadae None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:24.249940 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:24.377651 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a5e24-71ed-4339-8fe1-cf1b596e446c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:24.380434 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb1cfd-f507-48ae-be6c-867b5efcadae None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:24.426648 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1939cc-3b03-4962-891d-c94f983eb7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:24.427402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1939cc-3b03-4962-891d-c94f983eb7da None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:24.427868 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1939cc-3b03-4962-891d-c94f983eb7da None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:24.428246 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1939cc-3b03-4962-891d-c94f983eb7da None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:24.429031 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1939cc-3b03-4962-891d-c94f983eb7da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:24.429450 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1939cc-3b03-4962-891d-c94f983eb7da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:24.430965 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1939cc-3b03-4962-891d-c94f983eb7da None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:24.451680 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 318/640] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:24.453481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1939cc-3b03-4962-891d-c94f983eb7da None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:24.460351 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd80da-c5b7-4569-87e0-ddb44cd9127a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:24.462279 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd80da-c5b7-4569-87e0-ddb44cd9127a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:24.462279 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd80da-c5b7-4569-87e0-ddb44cd9127a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:24.462279 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd80da-c5b7-4569-87e0-ddb44cd9127a None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:24.462772 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd80da-c5b7-4569-87e0-ddb44cd9127a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:24.463043 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd80da-c5b7-4569-87e0-ddb44cd9127a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:24.464664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd80da-c5b7-4569-87e0-ddb44cd9127a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:24.488277 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 323/641] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:24.488277 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd80da-c5b7-4569-87e0-ddb44cd9127a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:24.524449 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:24.664134 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1939cc-3b03-4962-891d-c94f983eb7da None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:24.689897 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd80da-c5b7-4569-87e0-ddb44cd9127a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:24.693754 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:24.724587 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c53ef7-b1b0-4587-a32c-41bda4349df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:24.725747 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c53ef7-b1b0-4587-a32c-41bda4349df7 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:24.725747 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c53ef7-b1b0-4587-a32c-41bda4349df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:24.726175 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c53ef7-b1b0-4587-a32c-41bda4349df7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:24.738894 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c53ef7-b1b0-4587-a32c-41bda4349df7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:24.740594 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c53ef7-b1b0-4587-a32c-41bda4349df7 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:24.746591 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e6339-d0c2-41ee-a6e8-1ea7899c88c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:24.748268 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e6339-d0c2-41ee-a6e8-1ea7899c88c2 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:24.748648 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e6339-d0c2-41ee-a6e8-1ea7899c88c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:24.749027 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e6339-d0c2-41ee-a6e8-1ea7899c88c2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:24.759144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e6339-d0c2-41ee-a6e8-1ea7899c88c2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:24.760827 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e6339-d0c2-41ee-a6e8-1ea7899c88c2 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:24.769438 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-c1c53ef7-b1b0-4587-a32c-41bda4349df7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:24.769438 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:24.769438 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:24.769438 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:24.769438 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:24.769438 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:24.769438 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:24.769438 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:24.769438 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:24.769438 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:24.769438 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:24.769438 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:24.769438 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:24.769438 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:24.769438 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:24.769438 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:24.772214 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:24.772214 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:24.772214 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:24.772214 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:24.772214 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:24.772214 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:24.772214 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:24.772214 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:24.772214 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:24.772214 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:24.772214 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:24.772214 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:24.772214 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:24.772214 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:24.772214 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:24.772214 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:24.772214 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:24.774167 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:24.774167 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:24.774167 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:24.775772 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 319/642] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:24.777672 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c53ef7-b1b0-4587-a32c-41bda4349df7 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:24.778411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-156e6339-d0c2-41ee-a6e8-1ea7899c88c2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 08:26:24.778411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:24.778411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:24.778411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:24.778411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:24.778411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:24.778411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:24.778411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:24.778411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:24.778411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:24.778411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:24.778411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:24.778411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:26:24.778411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:26:24.778411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:26:24.778411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:26:24.780465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:24.780465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:24.780465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:26:24.780465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:24.780465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:26:24.780465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:24.780465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:24.780465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:24.780465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:24.780465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:24.780465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:24.780465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:24.780465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:24.780465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:24.780465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:24.780465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:24.780465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:24.780465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:24.782415 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:24.782415 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:24.782415 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:26:24.782415 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:26:24.782415 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:26:24.782415 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:26:24.782415 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:26:24.782415 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:26:24.782415 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 08:26:24.782415 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:24.782415 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 324/643] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:26:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:24.782415 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52fc35-2fb3-4788-bc03-b4cad7b9be45 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:24.783876 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52fc35-2fb3-4788-bc03-b4cad7b9be45 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:24.783876 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52fc35-2fb3-4788-bc03-b4cad7b9be45 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:24.791081 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 325/644] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:24.791081 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52fc35-2fb3-4788-bc03-b4cad7b9be45 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:24.924780 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52fc35-2fb3-4788-bc03-b4cad7b9be45 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:24.945544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:24.985404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38bc47-c812-4e4f-8d97-80a49f1a5df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:24.986036 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38bc47-c812-4e4f-8d97-80a49f1a5df3 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:24.986317 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38bc47-c812-4e4f-8d97-80a49f1a5df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:24.987058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38bc47-c812-4e4f-8d97-80a49f1a5df3 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:24.987913 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38bc47-c812-4e4f-8d97-80a49f1a5df3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:24.988426 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38bc47-c812-4e4f-8d97-80a49f1a5df3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:24.989855 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38bc47-c812-4e4f-8d97-80a49f1a5df3 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:24.991234 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c53ef7-b1b0-4587-a32c-41bda4349df7 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:25.006349 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 326/645] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:25.007113 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38bc47-c812-4e4f-8d97-80a49f1a5df3 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:25.039941 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:25.062910 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6d7bb-624e-4536-bff7-d1a24a226b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:25.064085 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6d7bb-624e-4536-bff7-d1a24a226b40 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:25.064587 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6d7bb-624e-4536-bff7-d1a24a226b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:25.065078 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6d7bb-624e-4536-bff7-d1a24a226b40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:25.078161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6d7bb-624e-4536-bff7-d1a24a226b40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:25.081399 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6d7bb-624e-4536-bff7-d1a24a226b40 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:25.103654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-0ca6d7bb-624e-4536-bff7-d1a24a226b40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:25.103654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:25.103654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:25.103654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:25.103654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:25.103654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:25.103654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:25.103654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:25.103654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:25.103654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:25.103654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:25.103654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:25.103654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:26:25.103654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:26:25.103654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:26:25.105714 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:26:25.105714 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:25.105714 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:25.105714 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:25.105714 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:25.105714 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:25.105714 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:25.105714 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:25.105714 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:25.105714 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:25.105714 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:25.105714 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:25.105714 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:25.105714 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:25.105714 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:25.105714 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:25.105714 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:25.107809 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:26:25.107809 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:26:25.107809 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:26:25.107809 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:26:25.107809 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:26:25.107809 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:26:25.107809 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:25.107809 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:25.107809 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 320/646] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:26:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:25.108949 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cd045-6cf8-43c0-bd26-1563ae28186f None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:25.108949 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cd045-6cf8-43c0-bd26-1563ae28186f None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:25.109228 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cd045-6cf8-43c0-bd26-1563ae28186f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:25.140327 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-295cd045-6cf8-43c0-bd26-1563ae28186f None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:25.142401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-295cd045-6cf8-43c0-bd26-1563ae28186f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:25.172322 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38bc47-c812-4e4f-8d97-80a49f1a5df3 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:25.222806 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179a765-98ee-4e19-a21b-6a5d5397edfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:25.223828 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179a765-98ee-4e19-a21b-6a5d5397edfb None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:25.224337 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179a765-98ee-4e19-a21b-6a5d5397edfb None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:25.224827 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179a765-98ee-4e19-a21b-6a5d5397edfb None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:25.226052 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179a765-98ee-4e19-a21b-6a5d5397edfb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:25.226608 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179a765-98ee-4e19-a21b-6a5d5397edfb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:25.229377 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179a765-98ee-4e19-a21b-6a5d5397edfb None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:25.251498 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 327/647] 10.222.0.26 () {56 vars in 1137 bytes} [Sun Sep 11 08:26:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:25.252365 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179a765-98ee-4e19-a21b-6a5d5397edfb None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:25.261797 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 321/648] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:26:25.263756 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cd045-6cf8-43c0-bd26-1563ae28186f None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:25.363074 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:25.390479 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179a765-98ee-4e19-a21b-6a5d5397edfb None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:25.392146 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:25.451929 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf243d-cd97-4f86-8e01-5093c73d49a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:25.452579 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf243d-cd97-4f86-8e01-5093c73d49a1 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:25.452858 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf243d-cd97-4f86-8e01-5093c73d49a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:25.453135 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf243d-cd97-4f86-8e01-5093c73d49a1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:25.462598 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf243d-cd97-4f86-8e01-5093c73d49a1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:25.464233 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf243d-cd97-4f86-8e01-5093c73d49a1 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:25.474807 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cd045-6cf8-43c0-bd26-1563ae28186f None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:25.477734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-7dbf243d-cd97-4f86-8e01-5093c73d49a1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 08:26:25.477734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:25.477734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:25.477734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:25.477734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:25.477734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:25.477734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:25.477734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:25.477734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:25.477734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:25.477734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:25.477734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:25.477734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:26:25.477734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:26:25.477734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:26:25.477734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:26:25.479559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:25.479559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:25.479559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:26:25.479559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:25.479559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:26:25.479559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:25.479559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:25.479559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:25.479559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:25.479559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:25.479559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:25.479559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:25.479559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:25.479559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:25.479559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:25.479559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:25.479559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:25.479559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:25.481355 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:25.481355 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:25.481355 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:26:25.481355 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:26:25.481355 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:26:25.481355 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:26:25.481355 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:26:25.481355 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:26:25.481355 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 08:26:25.481355 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:25.485532 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 328/649] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Sep 11 08:26:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:25.485532 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf243d-cd97-4f86-8e01-5093c73d49a1 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:25.533885 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b31b0-dcf2-474b-9ee9-457be9f8671b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:25.534645 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b31b0-dcf2-474b-9ee9-457be9f8671b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:25.534915 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b31b0-dcf2-474b-9ee9-457be9f8671b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:25.535189 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b31b0-dcf2-474b-9ee9-457be9f8671b None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:25.535916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b31b0-dcf2-474b-9ee9-457be9f8671b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:25.536225 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b31b0-dcf2-474b-9ee9-457be9f8671b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:25.538790 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b31b0-dcf2-474b-9ee9-457be9f8671b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:25.553710 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 322/650] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:26:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:25.555313 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b31b0-dcf2-474b-9ee9-457be9f8671b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:25.659758 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf243d-cd97-4f86-8e01-5093c73d49a1 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:25.711391 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b31b0-dcf2-474b-9ee9-457be9f8671b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:25.722972 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0e55b-55be-49f6-9ae4-1be7e91f03ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:25.723621 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0e55b-55be-49f6-9ae4-1be7e91f03ba None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:25.723903 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0e55b-55be-49f6-9ae4-1be7e91f03ba None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:25.724212 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0e55b-55be-49f6-9ae4-1be7e91f03ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:25.739359 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:25.749008 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:25.764658 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02270571-57f2-42d2-97a4-d333ae2a259b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:25.765596 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02270571-57f2-42d2-97a4-d333ae2a259b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:25.766217 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02270571-57f2-42d2-97a4-d333ae2a259b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:25.766664 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02270571-57f2-42d2-97a4-d333ae2a259b None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:25.768084 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02270571-57f2-42d2-97a4-d333ae2a259b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:25.768906 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02270571-57f2-42d2-97a4-d333ae2a259b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:25.770390 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02270571-57f2-42d2-97a4-d333ae2a259b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:25.795772 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 323/651] 10.222.0.26 () {56 vars in 1139 bytes} [Sun Sep 11 08:26:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:25.797251 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02270571-57f2-42d2-97a4-d333ae2a259b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:25.830186 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0e55b-55be-49f6-9ae4-1be7e91f03ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:25.831766 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0e55b-55be-49f6-9ae4-1be7e91f03ba None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:25.947805 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 329/652] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:26:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 08:26:25.948799 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0e55b-55be-49f6-9ae4-1be7e91f03ba None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:25.997292 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02270571-57f2-42d2-97a4-d333ae2a259b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:26.022757 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:26.054562 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb9378-c671-4691-b8a6-5c057fab08bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:26.055564 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb9378-c671-4691-b8a6-5c057fab08bd None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:26.055977 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb9378-c671-4691-b8a6-5c057fab08bd None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:26.056441 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb9378-c671-4691-b8a6-5c057fab08bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:26.057744 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb9378-c671-4691-b8a6-5c057fab08bd None admin] RBAC: Adding query filter params (role.id=b936dc45662c4ac195fdbf9e8ac589b0, scope.project.id=b6ed5f989f4248d7bab2548eb350fe17, user.id=e62bb9d2e13649b5af239bb56001ce16) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:26.058265 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb9378-c671-4691-b8a6-5c057fab08bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:26.060729 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb9378-c671-4691-b8a6-5c057fab08bd None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:26.071305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 324/653] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:26:25 2022] GET /identity/v3/role_assignments?user.id=e62bb9d2e13649b5af239bb56001ce16&scope.project.id=b6ed5f989f4248d7bab2548eb350fe17&role.id=b936dc45662c4ac195fdbf9e8ac589b0 => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:26.072538 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb9378-c671-4691-b8a6-5c057fab08bd None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:26.123314 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0e55b-55be-49f6-9ae4-1be7e91f03ba None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:26.164103 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b48bba-d517-4354-ab4b-ac5f71725c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:26.165124 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b48bba-d517-4354-ab4b-ac5f71725c77 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:26.165619 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b48bba-d517-4354-ab4b-ac5f71725c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:26.166083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b48bba-d517-4354-ab4b-ac5f71725c77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:26.170492 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:26.180251 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b48bba-d517-4354-ab4b-ac5f71725c77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:26:26.185827 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-56b48bba-d517-4354-ab4b-ac5f71725c77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:26.185827 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:26.185827 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:26.185827 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:26.185827 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:26.185827 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:26.185827 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:26.185827 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:26.185827 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:26.185827 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:26.185827 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:26.185827 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:26.185827 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:26:26.185827 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:26:26.185827 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:26:26.185827 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:26:26.189957 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:26:26.189957 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:26:26.189957 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:26:26.189957 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:26:26.189957 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:26.189957 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:26.189957 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:26.189957 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:26.189957 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:26.189957 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:26.189957 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:26.189957 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:26.189957 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:26.189957 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:26.189957 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:26.189957 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:26.190804 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:26.190804 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:26.190804 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:26.190804 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:26.190804 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:26:26.190804 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:26:26.190804 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:26:26.190804 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:26:26.190804 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:26:26.190804 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:26:26.190804 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:26.190804 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:26.190804 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 330/654] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Sep 11 08:26:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:26.190804 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b48bba-d517-4354-ab4b-ac5f71725c77 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:26.281879 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb9378-c671-4691-b8a6-5c057fab08bd None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:26.317520 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:26.321552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b48bba-d517-4354-ab4b-ac5f71725c77 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:26.357071 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee26033-4ccd-4947-a456-a04f40703ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:26.357960 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee26033-4ccd-4947-a456-a04f40703ecd None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:26.358372 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee26033-4ccd-4947-a456-a04f40703ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:26.358780 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee26033-4ccd-4947-a456-a04f40703ecd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:26.374096 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c258954-24bc-4e02-9077-c4d0818f9b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:26.375509 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c258954-24bc-4e02-9077-c4d0818f9b1a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:26.375798 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c258954-24bc-4e02-9077-c4d0818f9b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:26.376415 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c258954-24bc-4e02-9077-c4d0818f9b1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:26.394875 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c258954-24bc-4e02-9077-c4d0818f9b1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:26.397001 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c258954-24bc-4e02-9077-c4d0818f9b1a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:26.424166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-1c258954-24bc-4e02-9077-c4d0818f9b1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:26.424166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:26.424166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:26.424166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:26.424166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:26.424166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:26.424166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:26.424166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:26.424166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:26.424166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:26.424166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:26.424166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:26.424166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:26.424166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:26.424166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:26.424166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:26.425281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:26.425281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:26.425281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:26.425281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:26.425281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:26.425281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:26.425281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:26.425281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:26.425281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:26.425281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:26.425281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:26.425281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:26.425281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:26.425281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:26.425281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:26.425281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:26.425281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:26.428830 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:26.428830 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:26.428830 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:26.428830 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 331/655] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:26.428830 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c258954-24bc-4e02-9077-c4d0818f9b1a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:26.451880 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee26033-4ccd-4947-a456-a04f40703ecd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:26.453343 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee26033-4ccd-4947-a456-a04f40703ecd None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:26.534740 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:26.581501 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c258954-24bc-4e02-9077-c4d0818f9b1a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:26.604869 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 325/656] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:26:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 08:26:26.605832 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee26033-4ccd-4947-a456-a04f40703ecd None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:26.655694 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22213279-1ddb-4928-a2f9-7b7946a0e4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:26.656636 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22213279-1ddb-4928-a2f9-7b7946a0e4c0 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:26.656992 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22213279-1ddb-4928-a2f9-7b7946a0e4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:26.657335 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22213279-1ddb-4928-a2f9-7b7946a0e4c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:26.658127 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22213279-1ddb-4928-a2f9-7b7946a0e4c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:26.658500 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22213279-1ddb-4928-a2f9-7b7946a0e4c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:26.660093 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22213279-1ddb-4928-a2f9-7b7946a0e4c0 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:26.675289 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 332/657] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Sep 11 08:26:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:26.680607 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22213279-1ddb-4928-a2f9-7b7946a0e4c0 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:26.713508 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:26.758922 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee26033-4ccd-4947-a456-a04f40703ecd None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:26.799596 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6d33c-e620-44fc-9a96-4c734ec07d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:26.800125 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6d33c-e620-44fc-9a96-4c734ec07d4c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:26.800399 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6d33c-e620-44fc-9a96-4c734ec07d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:26.800668 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6d33c-e620-44fc-9a96-4c734ec07d4c None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:26.801318 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6d33c-e620-44fc-9a96-4c734ec07d4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:26.801615 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6d33c-e620-44fc-9a96-4c734ec07d4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:26.803013 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6d33c-e620-44fc-9a96-4c734ec07d4c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:26.820467 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 326/658] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:26.820467 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6d33c-e620-44fc-9a96-4c734ec07d4c None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:26.841379 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:26.844587 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22213279-1ddb-4928-a2f9-7b7946a0e4c0 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:26.893551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899ced0-da37-4e66-8273-af68961964dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:26.895155 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899ced0-da37-4e66-8273-af68961964dc None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:26.895814 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899ced0-da37-4e66-8273-af68961964dc None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:26.897086 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899ced0-da37-4e66-8273-af68961964dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:26.917269 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899ced0-da37-4e66-8273-af68961964dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:26.919116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899ced0-da37-4e66-8273-af68961964dc None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:26.936837 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-a899ced0-da37-4e66-8273-af68961964dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:26.936837 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:26.936837 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:26.936837 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:26.936837 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:26.936837 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:26.936837 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:26.936837 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:26.936837 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:26.936837 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:26.936837 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:26.936837 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:26.936837 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:26.936837 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:26.936837 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:26.936837 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:26.937893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:26.937893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:26.937893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:26.937893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:26.937893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:26.937893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:26.937893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:26.937893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:26.937893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:26.937893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:26.937893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:26.937893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:26.937893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:26.937893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:26.937893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:26.937893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:26.937893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:26.938834 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:26.938834 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:26.938834 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:26.938834 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 333/659] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:26.940181 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e5ee2-a065-470f-ab95-61d6ceb3bb4a None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:26.940181 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e5ee2-a065-470f-ab95-61d6ceb3bb4a None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:26.940181 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e5ee2-a065-470f-ab95-61d6ceb3bb4a None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:26.941291 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 334/660] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:26.941967 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e5ee2-a065-470f-ab95-61d6ceb3bb4a None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:26.980343 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6d33c-e620-44fc-9a96-4c734ec07d4c None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:27.021912 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c22cce-92ed-4448-8c68-cc6f986edd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:27.022839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c22cce-92ed-4448-8c68-cc6f986edd5b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:27.023130 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c22cce-92ed-4448-8c68-cc6f986edd5b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:27.023462 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c22cce-92ed-4448-8c68-cc6f986edd5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:27.024884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:27.038637 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c22cce-92ed-4448-8c68-cc6f986edd5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:27.046160 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c22cce-92ed-4448-8c68-cc6f986edd5b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:27.060118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-f2c22cce-92ed-4448-8c68-cc6f986edd5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:27.060118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:27.060118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:27.060118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:27.060118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:27.060118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:27.060118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:27.060118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:27.060118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:27.060118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:27.060118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:27.060118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:27.060118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:27.060118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:27.060118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:27.060118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:27.061111 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:27.061111 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:27.061111 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:27.061111 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:27.061111 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:27.061111 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:27.061111 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:27.061111 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:27.061111 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:27.061111 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:27.061111 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:27.061111 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:27.061111 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:27.061111 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:27.061111 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:27.061111 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:27.061111 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:27.062016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:27.062016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:27.062016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:27.062016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 327/661] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:27.062253 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c22cce-92ed-4448-8c68-cc6f986edd5b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:27.073869 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e5ee2-a065-470f-ab95-61d6ceb3bb4a None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:27.120610 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066248d-26dc-4d27-919f-561e072e8e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:27.121406 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066248d-26dc-4d27-919f-561e072e8e62 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:27.121752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066248d-26dc-4d27-919f-561e072e8e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:27.122028 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066248d-26dc-4d27-919f-561e072e8e62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:27.131511 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066248d-26dc-4d27-919f-561e072e8e62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:27.133092 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066248d-26dc-4d27-919f-561e072e8e62 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:27.148994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-1066248d-26dc-4d27-919f-561e072e8e62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:27.148994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:27.148994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:27.148994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:27.148994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:27.148994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:27.148994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:27.148994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:27.148994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:27.148994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:27.148994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:27.148994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:27.148994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:26:27.148994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:26:27.148994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:26:27.151005 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:26:27.151005 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:27.151005 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:27.151005 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:27.151005 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:27.151005 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:27.151005 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:27.151005 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:27.151005 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:27.151005 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:27.151005 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:27.151005 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:27.151005 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:27.151005 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:27.151005 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:27.151005 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:27.151005 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:27.153299 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:26:27.153299 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:26:27.153299 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:26:27.153299 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:26:27.153299 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:26:27.153299 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:26:27.153299 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:27.153299 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:27.153299 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 335/662] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:26:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:27.153299 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a1d10-4354-4afb-b7da-14c667cdf2f2 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:27.153299 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a1d10-4354-4afb-b7da-14c667cdf2f2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:27.154308 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a1d10-4354-4afb-b7da-14c667cdf2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:27.177261 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:27.179035 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-843a1d10-4354-4afb-b7da-14c667cdf2f2 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:27.180208 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-843a1d10-4354-4afb-b7da-14c667cdf2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:27.249152 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c22cce-92ed-4448-8c68-cc6f986edd5b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:27.263290 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 336/663] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:26:27.263290 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a1d10-4354-4afb-b7da-14c667cdf2f2 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:27.336376 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce8215-ac65-4188-b978-72c98e41ce19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:27.338268 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:27.339177 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce8215-ac65-4188-b978-72c98e41ce19 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:27.339816 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce8215-ac65-4188-b978-72c98e41ce19 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:27.340745 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce8215-ac65-4188-b978-72c98e41ce19 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:27.341892 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce8215-ac65-4188-b978-72c98e41ce19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:27.342650 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce8215-ac65-4188-b978-72c98e41ce19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:27.344943 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce8215-ac65-4188-b978-72c98e41ce19 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:27.360948 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 328/664] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:27.361899 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce8215-ac65-4188-b978-72c98e41ce19 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:27.398727 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a1d10-4354-4afb-b7da-14c667cdf2f2 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:27.441310 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdaaa10-5fcf-44f2-886c-0195a4cf164c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:27.441933 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdaaa10-5fcf-44f2-886c-0195a4cf164c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:27.442215 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdaaa10-5fcf-44f2-886c-0195a4cf164c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:27.442485 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdaaa10-5fcf-44f2-886c-0195a4cf164c None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:27.443826 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdaaa10-5fcf-44f2-886c-0195a4cf164c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:27.444190 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdaaa10-5fcf-44f2-886c-0195a4cf164c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:27.445646 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdaaa10-5fcf-44f2-886c-0195a4cf164c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:27.459396 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 337/665] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:27.460261 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdaaa10-5fcf-44f2-886c-0195a4cf164c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:27.521897 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce8215-ac65-4188-b978-72c98e41ce19 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:27.551570 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:27.573771 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7097979-a526-4800-a528-4b0dc01c41e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:27.574831 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7097979-a526-4800-a528-4b0dc01c41e7 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:27.575359 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7097979-a526-4800-a528-4b0dc01c41e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:27.575864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7097979-a526-4800-a528-4b0dc01c41e7 None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:27.577034 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7097979-a526-4800-a528-4b0dc01c41e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:27.577601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7097979-a526-4800-a528-4b0dc01c41e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:27.580651 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7097979-a526-4800-a528-4b0dc01c41e7 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:27.600214 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdaaa10-5fcf-44f2-886c-0195a4cf164c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:27.603196 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 329/666] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:26:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:27.604207 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7097979-a526-4800-a528-4b0dc01c41e7 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:27.624616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:27.654424 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32583c-afe4-4f03-8c4c-51167769d3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:27.655060 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32583c-afe4-4f03-8c4c-51167769d3d8 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:27.656293 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32583c-afe4-4f03-8c4c-51167769d3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:27.656293 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32583c-afe4-4f03-8c4c-51167769d3d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:27.664440 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32583c-afe4-4f03-8c4c-51167769d3d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:27.666094 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32583c-afe4-4f03-8c4c-51167769d3d8 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:27.678773 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-8d32583c-afe4-4f03-8c4c-51167769d3d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:27.678773 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:27.678773 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:27.678773 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:27.678773 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:27.678773 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:27.678773 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:27.678773 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:27.678773 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:27.678773 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:27.678773 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:27.678773 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:27.678773 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:26:27.678773 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:26:27.678773 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:26:27.680752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:26:27.680752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:27.680752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:27.680752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:27.680752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:27.680752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:27.680752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:27.680752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:27.680752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:27.680752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:27.680752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:27.680752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:27.680752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:27.680752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:27.680752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:27.680752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:27.680752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:27.682692 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:26:27.682692 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:26:27.682692 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:26:27.682692 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:26:27.682692 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:26:27.682692 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:26:27.682692 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:27.682692 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:27.682692 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 338/667] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:26:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:27.685657 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32583c-afe4-4f03-8c4c-51167769d3d8 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:27.759350 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7097979-a526-4800-a528-4b0dc01c41e7 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:27.812543 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597ebe3-4c30-477c-8c7a-23685b9bd004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:27.813631 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597ebe3-4c30-477c-8c7a-23685b9bd004 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:27.814222 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597ebe3-4c30-477c-8c7a-23685b9bd004 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:27.814817 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597ebe3-4c30-477c-8c7a-23685b9bd004 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:27.821812 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32583c-afe4-4f03-8c4c-51167769d3d8 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:27.825861 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597ebe3-4c30-477c-8c7a-23685b9bd004 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:27.827696 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597ebe3-4c30-477c-8c7a-23685b9bd004 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:27.845299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-2597ebe3-4c30-477c-8c7a-23685b9bd004 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 11 08:26:27.845299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:27.845299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:27.845299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:27.845299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:27.845299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:27.845299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:27.845299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:27.845299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:27.845299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:27.845299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:27.845299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:27.845299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:26:27.845299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:26:27.845299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:26:27.845299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:26:27.846894 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:27.846894 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:27.846894 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:26:27.846894 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:27.846894 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:26:27.846894 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:27.846894 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:27.846894 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:27.846894 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:27.846894 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:27.846894 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:27.846894 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:27.846894 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:27.846894 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:27.846894 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:27.846894 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:27.846894 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:27.846894 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:27.849065 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:27.849065 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:27.849065 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:26:27.849065 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:26:27.849065 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:26:27.849065 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:26:27.849065 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:26:27.849065 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:26:27.849065 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 11 08:26:27.849065 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:27.851099 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 330/668] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:26:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:27.852172 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597ebe3-4c30-477c-8c7a-23685b9bd004 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:27.883045 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011ecf2-fb9a-4cd4-a018-efa3f0f914a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:27.884305 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011ecf2-fb9a-4cd4-a018-efa3f0f914a7 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:27.884706 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011ecf2-fb9a-4cd4-a018-efa3f0f914a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:27.885034 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011ecf2-fb9a-4cd4-a018-efa3f0f914a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:27.897856 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3011ecf2-fb9a-4cd4-a018-efa3f0f914a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:26:27.904583 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-3011ecf2-fb9a-4cd4-a018-efa3f0f914a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:27.904583 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:27.904583 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:27.904583 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:27.904583 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:27.904583 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:27.904583 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:27.904583 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:27.904583 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:27.904583 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:27.904583 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:27.904583 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:27.904583 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:26:27.904583 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:26:27.904583 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:26:27.904583 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:26:27.905560 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:26:27.905560 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:26:27.905560 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:26:27.905560 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:26:27.905560 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:27.905560 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:27.905560 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:27.905560 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:27.905560 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:27.905560 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:27.905560 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:27.905560 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:27.905560 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:27.905560 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:27.905560 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:27.905560 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:27.906399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:27.906399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:27.906399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:27.906399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:27.906399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:26:27.906399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:26:27.906399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:26:27.906399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:26:27.906399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:26:27.906399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:26:27.906399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:27.906399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:27.908831 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 339/669] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Sep 11 08:26:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:27.909836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011ecf2-fb9a-4cd4-a018-efa3f0f914a7 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:27.916889 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:27.964560 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:28.006025 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597ebe3-4c30-477c-8c7a-23685b9bd004 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:28.063847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c465cb-d6a1-4f1a-b970-760476f371b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:28.064836 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c465cb-d6a1-4f1a-b970-760476f371b3 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:28.065261 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c465cb-d6a1-4f1a-b970-760476f371b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:28.066145 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c465cb-d6a1-4f1a-b970-760476f371b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:28.067183 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c465cb-d6a1-4f1a-b970-760476f371b3 None admin] RBAC: Adding query filter params (role.id=b936dc45662c4ac195fdbf9e8ac589b0, scope.project.id=b6ed5f989f4248d7bab2548eb350fe17, user.id=211fa4ad83be44cd8164e0e47278273a) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:28.067728 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c465cb-d6a1-4f1a-b970-760476f371b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:28.069661 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c465cb-d6a1-4f1a-b970-760476f371b3 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:28.078175 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 331/670] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:26:27 2022] GET /identity/v3/role_assignments?user.id=211fa4ad83be44cd8164e0e47278273a&scope.project.id=b6ed5f989f4248d7bab2548eb350fe17&role.id=b936dc45662c4ac195fdbf9e8ac589b0 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:28.084165 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011ecf2-fb9a-4cd4-a018-efa3f0f914a7 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:28.084971 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c465cb-d6a1-4f1a-b970-760476f371b3 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:28.154239 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e362a0b-d787-4e49-983e-fb6bcfcc5dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:28.155877 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e362a0b-d787-4e49-983e-fb6bcfcc5dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:28.156721 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e362a0b-d787-4e49-983e-fb6bcfcc5dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:28.157514 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e362a0b-d787-4e49-983e-fb6bcfcc5dd3 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:28.159340 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e362a0b-d787-4e49-983e-fb6bcfcc5dd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:28.160296 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e362a0b-d787-4e49-983e-fb6bcfcc5dd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:28.164131 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e362a0b-d787-4e49-983e-fb6bcfcc5dd3 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:28.191401 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 340/671] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:26:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:28.193466 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e362a0b-d787-4e49-983e-fb6bcfcc5dd3 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:28.240688 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c465cb-d6a1-4f1a-b970-760476f371b3 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:28.245344 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:28.298401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389755a6-77c3-407b-afdb-9e58cfc45979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:28.298832 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389755a6-77c3-407b-afdb-9e58cfc45979 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:28.299129 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389755a6-77c3-407b-afdb-9e58cfc45979 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:28.299402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389755a6-77c3-407b-afdb-9e58cfc45979 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:28.300620 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389755a6-77c3-407b-afdb-9e58cfc45979 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:28.300620 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389755a6-77c3-407b-afdb-9e58cfc45979 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:28.302049 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389755a6-77c3-407b-afdb-9e58cfc45979 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:28.332232 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 332/672] 10.222.0.26 () {56 vars in 1137 bytes} [Sun Sep 11 08:26:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:28.333483 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389755a6-77c3-407b-afdb-9e58cfc45979 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:28.417736 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:28.430288 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e362a0b-d787-4e49-983e-fb6bcfcc5dd3 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:28.494651 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29517c62-3612-4d01-8429-32e71b668606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:28.495777 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29517c62-3612-4d01-8429-32e71b668606 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:28.496279 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29517c62-3612-4d01-8429-32e71b668606 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:28.496752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29517c62-3612-4d01-8429-32e71b668606 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:28.497839 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29517c62-3612-4d01-8429-32e71b668606 None admin] RBAC: Adding query filter params (name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:28.498391 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29517c62-3612-4d01-8429-32e71b668606 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:28.500947 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29517c62-3612-4d01-8429-32e71b668606 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:28.515569 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 341/673] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Sep 11 08:26:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:28.517120 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29517c62-3612-4d01-8429-32e71b668606 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:28.549965 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389755a6-77c3-407b-afdb-9e58cfc45979 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:28.595730 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e78b0-fe70-4c97-ade5-160012c378b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:28.596388 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e78b0-fe70-4c97-ade5-160012c378b2 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:28.596672 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e78b0-fe70-4c97-ade5-160012c378b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:28.596951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e78b0-fe70-4c97-ade5-160012c378b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:28.597739 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e78b0-fe70-4c97-ade5-160012c378b2 None admin] RBAC: Adding query filter params (role.id=b936dc45662c4ac195fdbf9e8ac589b0, scope.project.id=b6ed5f989f4248d7bab2548eb350fe17, user.id=7c86ca1e378c4042a1807c7a45aaab99) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:28.598551 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e78b0-fe70-4c97-ade5-160012c378b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:28.599567 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e78b0-fe70-4c97-ade5-160012c378b2 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:28.606760 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 333/674] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:26:28 2022] GET /identity/v3/role_assignments?user.id=7c86ca1e378c4042a1807c7a45aaab99&scope.project.id=b6ed5f989f4248d7bab2548eb350fe17&role.id=b936dc45662c4ac195fdbf9e8ac589b0 => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:28.607840 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e78b0-fe70-4c97-ade5-160012c378b2 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:28.647834 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:28.708463 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29517c62-3612-4d01-8429-32e71b668606 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:28.764301 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c3e98-968a-490b-b4e3-50af906735a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:28.764772 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c3e98-968a-490b-b4e3-50af906735a9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:28.765058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c3e98-968a-490b-b4e3-50af906735a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:28.765379 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c3e98-968a-490b-b4e3-50af906735a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:28.804612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e78b0-fe70-4c97-ade5-160012c378b2 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:28.850986 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:28.901527 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e7221-aff3-415a-b689-78dd2c05c921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:28.902184 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e7221-aff3-415a-b689-78dd2c05c921 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:28.902473 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e7221-aff3-415a-b689-78dd2c05c921 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:28.902751 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e7221-aff3-415a-b689-78dd2c05c921 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:28.915881 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e7221-aff3-415a-b689-78dd2c05c921 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:28.918233 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e7221-aff3-415a-b689-78dd2c05c921 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:28.920509 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c3e98-968a-490b-b4e3-50af906735a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:28.922557 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c3e98-968a-490b-b4e3-50af906735a9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:28.936728 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-1b5e7221-aff3-415a-b689-78dd2c05c921 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:28.936728 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:28.936728 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:28.936728 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:28.936728 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:28.936728 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:28.936728 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:28.936728 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:28.936728 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:28.936728 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:28.936728 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:28.936728 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:28.936728 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:28.936728 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:28.936728 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:28.936728 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:28.937715 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:28.937715 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:28.937715 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:28.937715 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:28.937715 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:28.937715 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:28.937715 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:28.937715 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:28.937715 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:28.937715 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:28.937715 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:28.937715 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:28.937715 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:28.937715 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:28.937715 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:28.937715 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:28.937715 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:28.938606 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:28.938606 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:28.938606 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:28.943635 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 334/675] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:28.945210 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c6ce6-a5fd-429f-a14f-946b63827998 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:28.945505 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c6ce6-a5fd-429f-a14f-946b63827998 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:28.945786 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c6ce6-a5fd-429f-a14f-946b63827998 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:28.950104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 335/676] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:28.952793 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c6ce6-a5fd-429f-a14f-946b63827998 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:29.071055 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:29.113810 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 342/677] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:26:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 08:26:29.115348 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796b865-3a0d-458a-8959-0ed9d765f5c0 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:29.115645 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796b865-3a0d-458a-8959-0ed9d765f5c0 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:29.115922 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796b865-3a0d-458a-8959-0ed9d765f5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:29.128361 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c6ce6-a5fd-429f-a14f-946b63827998 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:29.136175 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-0796b865-3a0d-458a-8959-0ed9d765f5c0 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:29.137388 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0796b865-3a0d-458a-8959-0ed9d765f5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:29.199058 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800186f7-27d1-4db0-958e-dbcd138cb871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:29.199680 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800186f7-27d1-4db0-958e-dbcd138cb871 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:29.199961 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800186f7-27d1-4db0-958e-dbcd138cb871 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:29.200240 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800186f7-27d1-4db0-958e-dbcd138cb871 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:29.200898 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800186f7-27d1-4db0-958e-dbcd138cb871 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:29.201202 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800186f7-27d1-4db0-958e-dbcd138cb871 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:29.202599 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800186f7-27d1-4db0-958e-dbcd138cb871 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:29.218504 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 336/678] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:26:29.219433 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800186f7-27d1-4db0-958e-dbcd138cb871 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:29.245793 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:29.284326 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 343/679] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:26:29.285500 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796b865-3a0d-458a-8959-0ed9d765f5c0 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:29.412119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800186f7-27d1-4db0-958e-dbcd138cb871 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:29.501435 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8a6e2-de7b-4e7c-9342-27198d3198bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:29.502519 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8a6e2-de7b-4e7c-9342-27198d3198bb None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:29.502974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8a6e2-de7b-4e7c-9342-27198d3198bb None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:29.503462 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8a6e2-de7b-4e7c-9342-27198d3198bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:29.532742 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:29.542034 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8a6e2-de7b-4e7c-9342-27198d3198bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:29.543543 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8a6e2-de7b-4e7c-9342-27198d3198bb None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:29.547233 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796b865-3a0d-458a-8959-0ed9d765f5c0 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:29.561432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-1ee8a6e2-de7b-4e7c-9342-27198d3198bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:29.561432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:29.561432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:29.561432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:29.561432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:29.561432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:29.561432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:29.561432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:29.561432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:29.561432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:29.561432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:29.561432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:29.561432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:29.561432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:29.561432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:29.561432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:29.563582 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:29.563582 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:29.563582 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:29.563582 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:29.563582 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:29.563582 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:29.563582 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:29.563582 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:29.563582 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:29.563582 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:29.563582 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:29.563582 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:29.563582 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:29.563582 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:29.563582 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:29.563582 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:29.563582 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:29.565628 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:29.565628 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:29.565628 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:29.567407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 337/680] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:29.569196 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8a6e2-de7b-4e7c-9342-27198d3198bb None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:29.634122 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af945dec-5b27-4284-b490-c5c62e856acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:29.635881 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af945dec-5b27-4284-b490-c5c62e856acc None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:29.637965 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af945dec-5b27-4284-b490-c5c62e856acc None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:29.638725 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af945dec-5b27-4284-b490-c5c62e856acc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:29.657434 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af945dec-5b27-4284-b490-c5c62e856acc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:29.658913 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af945dec-5b27-4284-b490-c5c62e856acc None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:29.675683 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-af945dec-5b27-4284-b490-c5c62e856acc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 08:26:29.675683 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:29.675683 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:29.675683 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:29.675683 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:29.675683 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:29.675683 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:29.675683 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:29.675683 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:29.675683 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:29.675683 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:29.675683 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:29.675683 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:26:29.675683 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:26:29.675683 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:26:29.675683 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:26:29.677941 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:29.677941 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:29.677941 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:26:29.677941 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:29.677941 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:26:29.677941 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:29.677941 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:29.677941 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:29.677941 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:29.677941 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:29.677941 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:29.677941 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:29.677941 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:29.677941 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:29.677941 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:29.677941 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:29.677941 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:29.677941 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:29.679836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:29.679836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:29.679836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:26:29.679836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:26:29.679836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:26:29.679836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:26:29.679836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:26:29.679836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:26:29.679836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 08:26:29.679836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:29.682239 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 344/681] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:26:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:29.683222 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af945dec-5b27-4284-b490-c5c62e856acc None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:29.760531 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:29.770064 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8a6e2-de7b-4e7c-9342-27198d3198bb None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:29.813621 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1f042-fc6f-40a3-a686-d32058ef731a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:29.814643 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1f042-fc6f-40a3-a686-d32058ef731a None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:29.814643 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1f042-fc6f-40a3-a686-d32058ef731a None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:29.814880 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1f042-fc6f-40a3-a686-d32058ef731a None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:29.815695 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1f042-fc6f-40a3-a686-d32058ef731a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:29.816075 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1f042-fc6f-40a3-a686-d32058ef731a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:29.819390 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1f042-fc6f-40a3-a686-d32058ef731a None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:29.839382 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 338/682] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:29.841360 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1f042-fc6f-40a3-a686-d32058ef731a None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:29.882305 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af945dec-5b27-4284-b490-c5c62e856acc None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:29.910231 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:29.945161 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90808596-d7b3-4b93-845f-8278d6ea8c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:29.946967 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90808596-d7b3-4b93-845f-8278d6ea8c24 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:29.947621 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90808596-d7b3-4b93-845f-8278d6ea8c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:29.948696 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90808596-d7b3-4b93-845f-8278d6ea8c24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:29.971283 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90808596-d7b3-4b93-845f-8278d6ea8c24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:26:29.978074 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1f042-fc6f-40a3-a686-d32058ef731a None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:29.983389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-90808596-d7b3-4b93-845f-8278d6ea8c24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:26:29.983389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:29.983389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:29.983389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:29.983389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:29.983389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:29.983389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:29.983389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:29.983389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:29.983389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:29.983389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:29.983389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:29.983389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:26:29.983389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:26:29.983389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:26:29.983389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:26:29.984393 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:26:29.984393 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:26:29.984393 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:26:29.984393 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:26:29.984393 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:29.984393 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:29.984393 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:29.984393 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:29.984393 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:29.984393 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:29.984393 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:29.984393 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:29.984393 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:29.984393 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:29.984393 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:29.984393 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:29.985270 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:29.985270 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:29.985270 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:29.985270 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:29.985270 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:26:29.985270 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:26:29.985270 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:26:29.985270 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:26:29.985270 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:26:29.985270 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:26:29.985270 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:26:29.985270 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:29.991787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 345/683] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:26:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:29.993618 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90808596-d7b3-4b93-845f-8278d6ea8c24 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:30.022912 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b9e44-947f-49ea-bcf1-1531d33d84bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:30.024017 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b9e44-947f-49ea-bcf1-1531d33d84bb None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:30.024521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b9e44-947f-49ea-bcf1-1531d33d84bb None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:30.025056 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b9e44-947f-49ea-bcf1-1531d33d84bb None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:30.026016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b9e44-947f-49ea-bcf1-1531d33d84bb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:30.026544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b9e44-947f-49ea-bcf1-1531d33d84bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:30.028329 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b9e44-947f-49ea-bcf1-1531d33d84bb None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:30.055342 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 339/684] 10.222.0.26 () {56 vars in 1135 bytes} [Sun Sep 11 08:26:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:30.056668 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b9e44-947f-49ea-bcf1-1531d33d84bb None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:30.174270 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b9e44-947f-49ea-bcf1-1531d33d84bb None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:30.186059 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:30.208274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90808596-d7b3-4b93-845f-8278d6ea8c24 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:30.214756 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323064f0-3ef6-4c55-8f11-0455c98c7f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:30.215766 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323064f0-3ef6-4c55-8f11-0455c98c7f30 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:30.216261 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323064f0-3ef6-4c55-8f11-0455c98c7f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:30.216739 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323064f0-3ef6-4c55-8f11-0455c98c7f30 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:30.217663 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323064f0-3ef6-4c55-8f11-0455c98c7f30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:30.218178 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323064f0-3ef6-4c55-8f11-0455c98c7f30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:30.219849 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323064f0-3ef6-4c55-8f11-0455c98c7f30 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:30.226684 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:30.235154 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 340/685] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:26:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:30.237128 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323064f0-3ef6-4c55-8f11-0455c98c7f30 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:30.296624 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65d847-7d98-4314-bcfc-9d79089b3ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:30.297597 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65d847-7d98-4314-bcfc-9d79089b3ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:30.298103 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65d847-7d98-4314-bcfc-9d79089b3ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:30.298601 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65d847-7d98-4314-bcfc-9d79089b3ec0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:30.310268 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65d847-7d98-4314-bcfc-9d79089b3ec0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:30.312224 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65d847-7d98-4314-bcfc-9d79089b3ec0 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:30.327068 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-af65d847-7d98-4314-bcfc-9d79089b3ec0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:30.327068 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:30.327068 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:30.327068 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:30.327068 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:30.327068 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:30.327068 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:30.327068 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:30.327068 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:30.327068 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:30.327068 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:30.327068 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:30.327068 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:26:30.327068 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:26:30.327068 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:26:30.328121 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:26:30.328121 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:30.328121 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:30.328121 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:30.328121 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:30.328121 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:30.328121 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:30.328121 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:30.328121 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:30.328121 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:30.328121 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:30.328121 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:30.328121 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:30.328121 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:30.328121 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:30.328121 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:30.328121 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:30.329297 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:26:30.329297 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:26:30.329297 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:26:30.329297 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:26:30.329297 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:26:30.329297 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:26:30.329297 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:30.329297 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:30.337024 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 346/686] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:26:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:30.337785 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65d847-7d98-4314-bcfc-9d79089b3ec0 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:30.398821 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323064f0-3ef6-4c55-8f11-0455c98c7f30 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:30.441949 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5a1d5-ea0a-406b-8064-901355e85f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:30.443052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5a1d5-ea0a-406b-8064-901355e85f46 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:30.443633 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5a1d5-ea0a-406b-8064-901355e85f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:30.444117 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5a1d5-ea0a-406b-8064-901355e85f46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:30.497680 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65d847-7d98-4314-bcfc-9d79089b3ec0 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:30.500734 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:30.544033 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4eaa83-d386-4d14-9927-b9d2756635b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:30.545724 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4eaa83-d386-4d14-9927-b9d2756635b2 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:30.546241 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4eaa83-d386-4d14-9927-b9d2756635b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:30.546778 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4eaa83-d386-4d14-9927-b9d2756635b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:30.549033 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5a1d5-ea0a-406b-8064-901355e85f46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:30.552065 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5a1d5-ea0a-406b-8064-901355e85f46 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:30.560763 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4eaa83-d386-4d14-9927-b9d2756635b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:30.562558 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4eaa83-d386-4d14-9927-b9d2756635b2 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:30.581359 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-fe4eaa83-d386-4d14-9927-b9d2756635b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:30.581359 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:30.581359 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:30.581359 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:30.581359 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:30.581359 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:30.581359 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:30.581359 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:30.581359 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:30.581359 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:30.581359 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:30.581359 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:30.581359 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:30.581359 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:30.581359 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:30.581359 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:30.582515 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:30.582515 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:30.582515 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:30.582515 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:30.582515 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:30.582515 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:30.582515 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:30.582515 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:30.582515 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:30.582515 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:30.582515 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:30.582515 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:30.582515 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:30.582515 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:30.582515 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:30.582515 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:30.582515 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:30.584168 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:30.584168 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:30.584168 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:30.586264 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 347/687] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:30.587745 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4eaa83-d386-4d14-9927-b9d2756635b2 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:30.620893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:30.733031 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 341/688] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:26:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 08:26:30.733031 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5a1d5-ea0a-406b-8064-901355e85f46 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:30.741529 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4eaa83-d386-4d14-9927-b9d2756635b2 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:30.786697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b928d-4d8d-431a-a457-c7b4a8b417c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:30.787598 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b928d-4d8d-431a-a457-c7b4a8b417c5 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:30.788033 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b928d-4d8d-431a-a457-c7b4a8b417c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:30.788460 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b928d-4d8d-431a-a457-c7b4a8b417c5 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:30.789352 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b928d-4d8d-431a-a457-c7b4a8b417c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:30.789815 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b928d-4d8d-431a-a457-c7b4a8b417c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:30.792100 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b928d-4d8d-431a-a457-c7b4a8b417c5 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:30.813366 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 348/689] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:26:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:30.813366 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b928d-4d8d-431a-a457-c7b4a8b417c5 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:30.833538 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:30.869859 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5a1d5-ea0a-406b-8064-901355e85f46 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:30.903965 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:30.911359 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991092ce-e92b-4952-8edb-f82d3bf446f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:30.912023 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991092ce-e92b-4952-8edb-f82d3bf446f5 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:30.912412 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991092ce-e92b-4952-8edb-f82d3bf446f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:30.918642 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991092ce-e92b-4952-8edb-f82d3bf446f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:30.918642 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991092ce-e92b-4952-8edb-f82d3bf446f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:30.918642 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991092ce-e92b-4952-8edb-f82d3bf446f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:30.918642 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991092ce-e92b-4952-8edb-f82d3bf446f5 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:30.927142 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b928d-4d8d-431a-a457-c7b4a8b417c5 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:30.927897 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 342/690] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:30.928775 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991092ce-e92b-4952-8edb-f82d3bf446f5 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:30.978743 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf04c9-ebbf-440c-8d2a-36c7773d9702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:30.979872 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf04c9-ebbf-440c-8d2a-36c7773d9702 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:30.980430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf04c9-ebbf-440c-8d2a-36c7773d9702 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:30.980968 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf04c9-ebbf-440c-8d2a-36c7773d9702 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:30.998416 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccf04c9-ebbf-440c-8d2a-36c7773d9702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:31.000420 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccf04c9-ebbf-440c-8d2a-36c7773d9702 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:31.030970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-8ccf04c9-ebbf-440c-8d2a-36c7773d9702 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:31.030970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:31.030970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:31.030970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:31.030970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:31.030970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:31.030970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:31.030970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:31.030970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:31.030970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:31.030970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:31.030970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:31.030970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:31.030970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:31.030970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:31.030970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:31.032675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:31.032675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:31.032675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:31.032675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:31.032675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:31.032675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:31.032675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:31.032675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:31.032675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:31.032675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:31.032675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:31.032675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:31.032675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:31.032675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:31.032675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:31.032675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:31.032675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:31.034324 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:31.034324 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:31.034324 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:31.039018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 349/691] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:31.040910 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf04c9-ebbf-440c-8d2a-36c7773d9702 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:31.065111 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991092ce-e92b-4952-8edb-f82d3bf446f5 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:31.102860 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:31.110294 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87423a8-39f2-41d6-b8ab-bcdfdce43fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:31.114471 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87423a8-39f2-41d6-b8ab-bcdfdce43fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:31.114471 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87423a8-39f2-41d6-b8ab-bcdfdce43fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:31.114471 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87423a8-39f2-41d6-b8ab-bcdfdce43fd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:31.114471 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87423a8-39f2-41d6-b8ab-bcdfdce43fd0 None admin] RBAC: Adding query filter params (role.id=b936dc45662c4ac195fdbf9e8ac589b0, scope.project.id=b6ed5f989f4248d7bab2548eb350fe17, user.id=7690af0cd266458f9cdd799c98ff5bfd) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:31.114471 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87423a8-39f2-41d6-b8ab-bcdfdce43fd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:31.114471 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87423a8-39f2-41d6-b8ab-bcdfdce43fd0 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:31.123692 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 343/692] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:26:30 2022] GET /identity/v3/role_assignments?user.id=7690af0cd266458f9cdd799c98ff5bfd&scope.project.id=b6ed5f989f4248d7bab2548eb350fe17&role.id=b936dc45662c4ac195fdbf9e8ac589b0 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:31.123692 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87423a8-39f2-41d6-b8ab-bcdfdce43fd0 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:31.207666 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf04c9-ebbf-440c-8d2a-36c7773d9702 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:31.244274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:31.249660 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d21953-a662-4bb6-a218-98e3248dc54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:31.250327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d21953-a662-4bb6-a218-98e3248dc54e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:31.250610 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d21953-a662-4bb6-a218-98e3248dc54e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:31.250985 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d21953-a662-4bb6-a218-98e3248dc54e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:31.257209 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87423a8-39f2-41d6-b8ab-bcdfdce43fd0 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:31.260828 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d21953-a662-4bb6-a218-98e3248dc54e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:31.262674 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d21953-a662-4bb6-a218-98e3248dc54e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:31.276689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-20d21953-a662-4bb6-a218-98e3248dc54e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 08:26:31.276689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:31.276689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:31.276689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:31.276689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:31.276689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:31.276689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:31.276689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:31.276689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:31.276689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:31.276689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:31.276689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:31.276689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:26:31.276689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:26:31.276689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:26:31.276689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:26:31.277752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:31.277752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:31.277752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:26:31.277752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:31.277752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:26:31.277752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:31.277752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:31.277752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:31.277752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:31.277752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:31.277752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:31.277752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:31.277752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:31.277752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:31.277752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:31.277752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:31.277752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:31.277752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:31.280105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:31.280105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:31.280105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:26:31.280105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:26:31.280105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:26:31.280105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:26:31.280105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:26:31.280105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:26:31.280105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 08:26:31.280105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:31.280105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 350/693] 10.222.0.26 () {56 vars in 1093 bytes} [Sun Sep 11 08:26:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:31.280105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784f048-3930-45b7-be7d-1b9b06ebab4c None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:31.280105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784f048-3930-45b7-be7d-1b9b06ebab4c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:31.280855 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784f048-3930-45b7-be7d-1b9b06ebab4c None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:31.286235 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 351/694] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:31.287279 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784f048-3930-45b7-be7d-1b9b06ebab4c None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:31.299850 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8673af-5cc3-460b-94e9-2d30d3d44693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:31.300478 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8673af-5cc3-460b-94e9-2d30d3d44693 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:31.300754 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8673af-5cc3-460b-94e9-2d30d3d44693 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:31.301133 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8673af-5cc3-460b-94e9-2d30d3d44693 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:31.301794 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8673af-5cc3-460b-94e9-2d30d3d44693 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:31.302633 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8673af-5cc3-460b-94e9-2d30d3d44693 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:31.304226 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8673af-5cc3-460b-94e9-2d30d3d44693 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:31.319867 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 344/695] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:31.321140 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e67a2-4ac1-4717-a873-45ec097634f1 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:31.321410 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e67a2-4ac1-4717-a873-45ec097634f1 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:31.321676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e67a2-4ac1-4717-a873-45ec097634f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:31.363313 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-874e67a2-4ac1-4717-a873-45ec097634f1 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:31.366240 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-874e67a2-4ac1-4717-a873-45ec097634f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:31.417231 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784f048-3930-45b7-be7d-1b9b06ebab4c None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:31.469557 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:31.470734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91bd6a-bfbf-4a6b-8ec5-2dd16f93b11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:31.471537 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91bd6a-bfbf-4a6b-8ec5-2dd16f93b11e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:31.471840 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91bd6a-bfbf-4a6b-8ec5-2dd16f93b11e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:31.472112 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91bd6a-bfbf-4a6b-8ec5-2dd16f93b11e None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:31.472909 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91bd6a-bfbf-4a6b-8ec5-2dd16f93b11e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:31.473226 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91bd6a-bfbf-4a6b-8ec5-2dd16f93b11e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:31.475291 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91bd6a-bfbf-4a6b-8ec5-2dd16f93b11e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:31.502059 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 352/696] 10.222.0.26 () {56 vars in 1133 bytes} [Sun Sep 11 08:26:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:31.503070 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 345/697] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:26:31.504660 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91bd6a-bfbf-4a6b-8ec5-2dd16f93b11e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:31.512106 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e67a2-4ac1-4717-a873-45ec097634f1 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:31.627706 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:31.713754 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91bd6a-bfbf-4a6b-8ec5-2dd16f93b11e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:31.727062 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e67a2-4ac1-4717-a873-45ec097634f1 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:31.752326 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f856bc-cc31-4712-8c1a-3e40ffb916e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:31.753022 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f856bc-cc31-4712-8c1a-3e40ffb916e8 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:31.753307 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f856bc-cc31-4712-8c1a-3e40ffb916e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:31.753581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f856bc-cc31-4712-8c1a-3e40ffb916e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:31.761339 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f856bc-cc31-4712-8c1a-3e40ffb916e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:31.762742 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f856bc-cc31-4712-8c1a-3e40ffb916e8 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:31.774931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-c5f856bc-cc31-4712-8c1a-3e40ffb916e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:31.774931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:31.774931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:31.774931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:31.774931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:31.774931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:31.774931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:31.774931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:31.774931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:31.774931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:31.774931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:31.774931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:31.774931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:26:31.774931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:26:31.774931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:26:31.776718 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:26:31.776718 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:31.776718 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:31.776718 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:31.776718 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:31.776718 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:31.776718 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:31.776718 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:31.776718 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:31.776718 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:31.776718 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:31.776718 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:31.776718 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:31.776718 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:31.776718 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:31.776718 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:31.776718 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:31.778524 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:26:31.778524 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:26:31.778524 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:26:31.778524 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:26:31.778524 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:26:31.778524 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:26:31.778524 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:31.778524 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:31.778524 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 353/698] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:26:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:31.778524 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fed5f8-83d3-4899-82aa-3412f06593e6 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:31.778524 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fed5f8-83d3-4899-82aa-3412f06593e6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:31.780738 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fed5f8-83d3-4899-82aa-3412f06593e6 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:31.784419 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 354/699] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:31.785295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fed5f8-83d3-4899-82aa-3412f06593e6 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:31.797419 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6e53a-23b6-4693-a635-ef93197060f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:31.798229 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6e53a-23b6-4693-a635-ef93197060f3 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:31.798646 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6e53a-23b6-4693-a635-ef93197060f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:31.799111 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6e53a-23b6-4693-a635-ef93197060f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:31.886307 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:31.913438 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6e53a-23b6-4693-a635-ef93197060f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:31.916901 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6e53a-23b6-4693-a635-ef93197060f3 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:31.954128 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fed5f8-83d3-4899-82aa-3412f06593e6 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:31.975750 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:32.017870 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2277a9-ccb8-432a-b3d1-a4690bee9426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:32.018867 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2277a9-ccb8-432a-b3d1-a4690bee9426 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:32.019367 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2277a9-ccb8-432a-b3d1-a4690bee9426 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:32.019829 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2277a9-ccb8-432a-b3d1-a4690bee9426 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:32.021555 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2277a9-ccb8-432a-b3d1-a4690bee9426 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:32.022073 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2277a9-ccb8-432a-b3d1-a4690bee9426 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:32.024730 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2277a9-ccb8-432a-b3d1-a4690bee9426 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:32.047203 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 355/700] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:26:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:32.049373 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd7b77-c62b-4f09-a02c-92fffe627d3b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:32.049875 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd7b77-c62b-4f09-a02c-92fffe627d3b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:32.050372 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd7b77-c62b-4f09-a02c-92fffe627d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:32.071036 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 346/701] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:26:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 08:26:32.072355 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6e53a-23b6-4693-a635-ef93197060f3 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:32.085855 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-10dd7b77-c62b-4f09-a02c-92fffe627d3b None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:32.088051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-10dd7b77-c62b-4f09-a02c-92fffe627d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:32.198929 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:32.231295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 356/702] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:26:32.231295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd7b77-c62b-4f09-a02c-92fffe627d3b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:32.231727 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6e53a-23b6-4693-a635-ef93197060f3 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:32.302875 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88575e63-4b45-4425-8f07-b81d04974249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:32.304005 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88575e63-4b45-4425-8f07-b81d04974249 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:32.304489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88575e63-4b45-4425-8f07-b81d04974249 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:32.304964 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88575e63-4b45-4425-8f07-b81d04974249 None admin] PATH_INFO: `/v3/services/network` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:32.306016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88575e63-4b45-4425-8f07-b81d04974249 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:32.308671 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88575e63-4b45-4425-8f07-b81d04974249 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:32.331291 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-88575e63-4b45-4425-8f07-b81d04974249 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 08:26:32.331291 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:32.331291 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 08:26:32.331291 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 08:26:32.331291 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 08:26:32.331291 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 08:26:32.331291 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 08:26:32.331291 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:26:32.331291 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 08:26:32.331291 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:32.331291 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 08:26:32.331291 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:32.331291 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:32.331291 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:32.331291 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:32.331291 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:32.331291 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:32.333278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:32.333278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:32.333278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:32.333278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:32.333278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:32.333278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:32.333278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 08:26:32.333278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 08:26:32.333278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 08:26:32.333278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 08:26:32.333278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:32.333278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:32.333278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:32.333278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:32.333278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:32.333278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:32.336263 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:32.336263 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:32.336263 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:32.336263 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:32.336263 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:32.336263 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:32.336263 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:32.336263 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:32.336263 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:32.336263 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:32.336263 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 08:26:32.336263 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:26:32.336263 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 08:26:32.336263 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:32.347432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 347/703] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:26:32 2022] GET /identity/v3/services/network => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:32.347432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88575e63-4b45-4425-8f07-b81d04974249 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:32.414618 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:32.420086 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd7b77-c62b-4f09-a02c-92fffe627d3b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:32.484085 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d218be8-4191-4f23-b46d-53a40e204cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:32.485105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d218be8-4191-4f23-b46d-53a40e204cbf None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:32.485583 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d218be8-4191-4f23-b46d-53a40e204cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:32.486056 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d218be8-4191-4f23-b46d-53a40e204cbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:32.487488 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d218be8-4191-4f23-b46d-53a40e204cbf None admin] RBAC: Adding query filter params (role.id=b936dc45662c4ac195fdbf9e8ac589b0, scope.project.id=b6ed5f989f4248d7bab2548eb350fe17, user.id=d1a4f25df9724d34afdd6a41e719546a) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:32.488028 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d218be8-4191-4f23-b46d-53a40e204cbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:32.502870 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d218be8-4191-4f23-b46d-53a40e204cbf None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:32.527814 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 357/704] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:26:32 2022] GET /identity/v3/role_assignments?user.id=d1a4f25df9724d34afdd6a41e719546a&scope.project.id=b6ed5f989f4248d7bab2548eb350fe17&role.id=b936dc45662c4ac195fdbf9e8ac589b0 => generated 608 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:32.529497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d218be8-4191-4f23-b46d-53a40e204cbf None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:32.561063 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88575e63-4b45-4425-8f07-b81d04974249 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:32.707274 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c66451-79b9-44a3-912f-d791016aa699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:32.709501 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c66451-79b9-44a3-912f-d791016aa699 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:32.712227 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c66451-79b9-44a3-912f-d791016aa699 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:32.713202 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c66451-79b9-44a3-912f-d791016aa699 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:32.752382 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c66451-79b9-44a3-912f-d791016aa699 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:32.753868 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c66451-79b9-44a3-912f-d791016aa699 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:32.782186 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:32.796676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-c0c66451-79b9-44a3-912f-d791016aa699 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:32.796676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:32.796676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:32.796676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:32.796676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:32.796676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:32.796676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:32.796676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:32.796676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:32.796676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:32.796676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:32.796676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:32.796676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:32.796676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:32.796676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:32.796676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:32.807493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:32.807493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:32.807493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:32.807493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:32.807493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:32.807493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:32.807493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:32.807493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:32.807493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:32.807493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:32.807493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:32.807493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:32.807493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:32.807493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:32.807493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:32.807493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:32.807493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:32.809308 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:32.809308 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:32.809308 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:32.809308 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 348/705] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 458 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:32.812540 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c66451-79b9-44a3-912f-d791016aa699 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:32.816268 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d218be8-4191-4f23-b46d-53a40e204cbf None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:32.883974 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde3cfa-cf55-4c7d-97f7-c691e00d4412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:32.885101 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde3cfa-cf55-4c7d-97f7-c691e00d4412 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:32.885571 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde3cfa-cf55-4c7d-97f7-c691e00d4412 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:32.885997 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde3cfa-cf55-4c7d-97f7-c691e00d4412 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:32.888262 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde3cfa-cf55-4c7d-97f7-c691e00d4412 None admin] RBAC: Adding query filter params (name=network) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:32.888262 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde3cfa-cf55-4c7d-97f7-c691e00d4412 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:32.890211 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde3cfa-cf55-4c7d-97f7-c691e00d4412 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:32.897701 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 358/706] 10.222.0.26 () {56 vars in 1112 bytes} [Sun Sep 11 08:26:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:32.903399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde3cfa-cf55-4c7d-97f7-c691e00d4412 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:32.960510 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:33.008308 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c66451-79b9-44a3-912f-d791016aa699 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:33.050234 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56941b6e-a4d9-426f-817c-8a25d091ab1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:33.050929 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56941b6e-a4d9-426f-817c-8a25d091ab1a None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:33.051208 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56941b6e-a4d9-426f-817c-8a25d091ab1a None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:33.051517 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56941b6e-a4d9-426f-817c-8a25d091ab1a None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:33.052927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56941b6e-a4d9-426f-817c-8a25d091ab1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:33.053231 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56941b6e-a4d9-426f-817c-8a25d091ab1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:33.054694 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56941b6e-a4d9-426f-817c-8a25d091ab1a None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:33.069308 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 349/707] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:33.070182 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56941b6e-a4d9-426f-817c-8a25d091ab1a None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:33.112863 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde3cfa-cf55-4c7d-97f7-c691e00d4412 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:33.172188 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22f034-8703-49b9-afa4-d0e58674bdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:33.172868 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22f034-8703-49b9-afa4-d0e58674bdce None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:33.173096 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22f034-8703-49b9-afa4-d0e58674bdce None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:33.173435 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22f034-8703-49b9-afa4-d0e58674bdce None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:33.173956 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22f034-8703-49b9-afa4-d0e58674bdce None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:33.175389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22f034-8703-49b9-afa4-d0e58674bdce None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:33.178458 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:33.188153 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-ee22f034-8703-49b9-afa4-d0e58674bdce None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 08:26:33.188153 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:33.188153 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 08:26:33.188153 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 08:26:33.188153 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 08:26:33.188153 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 08:26:33.188153 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 08:26:33.188153 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:26:33.188153 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 08:26:33.188153 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:33.188153 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 08:26:33.188153 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:33.188153 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:33.188153 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:33.188153 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:33.188153 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:33.188153 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:33.196675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:33.196675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:33.196675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:33.196675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:33.196675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:33.196675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:33.196675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 08:26:33.196675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 08:26:33.196675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 08:26:33.196675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 08:26:33.196675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:33.196675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:33.196675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:33.196675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:33.196675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:33.196675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:33.198271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:33.198271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:33.198271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:33.198271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:33.198271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:33.198271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:33.198271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:33.198271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:33.198271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:33.198271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:33.198271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 08:26:33.198271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:26:33.198271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 08:26:33.198271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:33.198271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 359/708] 10.222.0.26 () {56 vars in 1129 bytes} [Sun Sep 11 08:26:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:33.203221 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22f034-8703-49b9-afa4-d0e58674bdce None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:33.244281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56941b6e-a4d9-426f-817c-8a25d091ab1a None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:33.284378 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd58fa6-1d5b-4978-a661-6a876b084e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:33.284891 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd58fa6-1d5b-4978-a661-6a876b084e34 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:33.285207 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd58fa6-1d5b-4978-a661-6a876b084e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:33.285499 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd58fa6-1d5b-4978-a661-6a876b084e34 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:33.286056 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd58fa6-1d5b-4978-a661-6a876b084e34 None admin] RBAC: Adding query filter params (type=network) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:33.286356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd58fa6-1d5b-4978-a661-6a876b084e34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:33.288333 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd58fa6-1d5b-4978-a661-6a876b084e34 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:33.299474 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 350/709] 10.222.0.26 () {56 vars in 1112 bytes} [Sun Sep 11 08:26:33 2022] GET /identity/v3/services?type=network => generated 124 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:33.299474 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd58fa6-1d5b-4978-a661-6a876b084e34 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:33.414897 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd58fa6-1d5b-4978-a661-6a876b084e34 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:33.441421 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:33.455112 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:33.456775 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c057ce0-58b8-4b1d-af16-9881b06ea5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:33.457680 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c057ce0-58b8-4b1d-af16-9881b06ea5c8 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:33.458998 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c057ce0-58b8-4b1d-af16-9881b06ea5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:33.459315 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c057ce0-58b8-4b1d-af16-9881b06ea5c8 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:33.460241 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c057ce0-58b8-4b1d-af16-9881b06ea5c8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:33.460787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c057ce0-58b8-4b1d-af16-9881b06ea5c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:33.462413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c057ce0-58b8-4b1d-af16-9881b06ea5c8 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:33.469587 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 351/710] 10.222.0.26 () {56 vars in 1124 bytes} [Sun Sep 11 08:26:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:33.478043 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c057ce0-58b8-4b1d-af16-9881b06ea5c8 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:33.484141 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22f034-8703-49b9-afa4-d0e58674bdce None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:33.568650 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ba7c7-a83b-4ef6-a462-561ab6c13140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:33.569683 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ba7c7-a83b-4ef6-a462-561ab6c13140 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:33.570181 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ba7c7-a83b-4ef6-a462-561ab6c13140 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:33.570681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ba7c7-a83b-4ef6-a462-561ab6c13140 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:33.591512 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ba7c7-a83b-4ef6-a462-561ab6c13140 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:33.594579 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ba7c7-a83b-4ef6-a462-561ab6c13140 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:33.619597 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-256ba7c7-a83b-4ef6-a462-561ab6c13140 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:33.619597 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:33.619597 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:33.619597 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:33.619597 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:33.619597 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:33.619597 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:33.619597 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:33.619597 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:33.619597 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:33.619597 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:33.619597 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:33.619597 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:26:33.619597 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:26:33.619597 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:26:33.620630 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:26:33.620630 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:33.620630 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:33.620630 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:33.620630 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:33.620630 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:33.620630 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:33.620630 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:33.620630 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:33.620630 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:33.620630 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:33.620630 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:33.620630 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:33.620630 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:33.620630 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:33.620630 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:33.620630 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:33.621552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:26:33.621552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:26:33.621552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:26:33.621552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:26:33.621552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:26:33.621552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:26:33.621552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:33.621552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:33.622271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 360/711] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:26:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 432 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:33.632758 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ba7c7-a83b-4ef6-a462-561ab6c13140 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:33.763605 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c057ce0-58b8-4b1d-af16-9881b06ea5c8 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:33.827778 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546bc1b5-8f64-4296-a368-4c7bea773ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:33.829082 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bc1b5-8f64-4296-a368-4c7bea773ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:33.829563 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bc1b5-8f64-4296-a368-4c7bea773ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:33.830023 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bc1b5-8f64-4296-a368-4c7bea773ea9 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:33.831214 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546bc1b5-8f64-4296-a368-4c7bea773ea9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:33.831775 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546bc1b5-8f64-4296-a368-4c7bea773ea9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:33.834987 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546bc1b5-8f64-4296-a368-4c7bea773ea9 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:33.844537 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 352/712] 10.222.0.26 () {56 vars in 1124 bytes} [Sun Sep 11 08:26:33 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:33.856456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ba7c7-a83b-4ef6-a462-561ab6c13140 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:33.941298 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70aee1-2b6a-46da-bcf4-af7763127a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:33.942406 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70aee1-2b6a-46da-bcf4-af7763127a61 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:33.943491 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70aee1-2b6a-46da-bcf4-af7763127a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:33.943991 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70aee1-2b6a-46da-bcf4-af7763127a61 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:33.945352 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70aee1-2b6a-46da-bcf4-af7763127a61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:33.945921 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70aee1-2b6a-46da-bcf4-af7763127a61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:33.948927 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70aee1-2b6a-46da-bcf4-af7763127a61 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:33.985977 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 361/713] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:26:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:33.995029 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546bc1b5-8f64-4296-a368-4c7bea773ea9 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:34.106937 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:34.186533 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546bc1b5-8f64-4296-a368-4c7bea773ea9 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:34.241210 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec844922-5e82-41e6-8acf-00893e5c8fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:34.241824 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec844922-5e82-41e6-8acf-00893e5c8fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:34.242096 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec844922-5e82-41e6-8acf-00893e5c8fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:34.242367 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec844922-5e82-41e6-8acf-00893e5c8fc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:34.243153 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec844922-5e82-41e6-8acf-00893e5c8fc9 None admin] RBAC: Adding query filter params (role.id=d12af9f1dfb344cd8a6a493e165030ba, scope.project.id=b6ed5f989f4248d7bab2548eb350fe17, user.id=e62bb9d2e13649b5af239bb56001ce16) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:34.243492 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec844922-5e82-41e6-8acf-00893e5c8fc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:34.244927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec844922-5e82-41e6-8acf-00893e5c8fc9 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:34.254072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 353/714] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:26:33 2022] GET /identity/v3/role_assignments?user.id=e62bb9d2e13649b5af239bb56001ce16&scope.project.id=b6ed5f989f4248d7bab2548eb350fe17&role.id=d12af9f1dfb344cd8a6a493e165030ba => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:34.459153 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c52797-a71f-4c9f-9a58-81cfedb52b5c None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:34.459922 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c52797-a71f-4c9f-9a58-81cfedb52b5c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:34.459922 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c52797-a71f-4c9f-9a58-81cfedb52b5c None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:34.461184 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 362/715] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:34.467796 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52115a-8e91-4d85-ba63-8234104d4016 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:34.468289 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52115a-8e91-4d85-ba63-8234104d4016 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:34.468778 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52115a-8e91-4d85-ba63-8234104d4016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:34.503055 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-9f52115a-8e91-4d85-ba63-8234104d4016 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:34.504296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9f52115a-8e91-4d85-ba63-8234104d4016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:34.601093 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 354/716] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:26:34.974440 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c52797-a71f-4c9f-9a58-81cfedb52b5c None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:34.994988 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:35.127429 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c52797-a71f-4c9f-9a58-81cfedb52b5c None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:35.176445 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca48a6-b5e2-4f5d-8474-a60f3080d0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:35.177121 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca48a6-b5e2-4f5d-8474-a60f3080d0bc None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:35.177405 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca48a6-b5e2-4f5d-8474-a60f3080d0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:35.177682 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca48a6-b5e2-4f5d-8474-a60f3080d0bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:35.201823 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca48a6-b5e2-4f5d-8474-a60f3080d0bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:35.205348 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca48a6-b5e2-4f5d-8474-a60f3080d0bc None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:35.242294 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-c4ca48a6-b5e2-4f5d-8474-a60f3080d0bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:35.242294 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:35.242294 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:35.242294 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:35.242294 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:35.242294 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:35.242294 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:35.242294 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:35.242294 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:35.242294 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:35.242294 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:35.242294 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:35.242294 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:35.242294 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:35.242294 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:35.242294 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:35.244223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:35.244223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:35.244223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:35.244223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:35.244223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:35.244223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:35.244223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:35.244223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:35.244223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:35.244223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:35.244223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:35.244223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:35.244223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:35.244223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:35.244223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:35.244223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:35.244223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:35.246085 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:35.246085 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:35.246085 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:35.250029 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 363/717] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:35.256336 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52115a-8e91-4d85-ba63-8234104d4016 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:35.328289 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:35.387942 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52115a-8e91-4d85-ba63-8234104d4016 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:35.438373 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e908a4-6ae9-4011-8d53-9ec8ffa1f484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:35.439013 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e908a4-6ae9-4011-8d53-9ec8ffa1f484 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:35.439328 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e908a4-6ae9-4011-8d53-9ec8ffa1f484 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:35.439609 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e908a4-6ae9-4011-8d53-9ec8ffa1f484 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:35.440283 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e908a4-6ae9-4011-8d53-9ec8ffa1f484 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:35.440591 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e908a4-6ae9-4011-8d53-9ec8ffa1f484 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:35.441992 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e908a4-6ae9-4011-8d53-9ec8ffa1f484 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:35.460639 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 355/718] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:35.466841 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca48a6-b5e2-4f5d-8474-a60f3080d0bc None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:35.577016 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:35.670674 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca48a6-b5e2-4f5d-8474-a60f3080d0bc None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:35.763666 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0bfcb6-b487-48cf-b799-991bb19666ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:35.764707 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bfcb6-b487-48cf-b799-991bb19666ab None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:35.765190 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bfcb6-b487-48cf-b799-991bb19666ab None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:35.765668 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bfcb6-b487-48cf-b799-991bb19666ab None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:35.766855 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0bfcb6-b487-48cf-b799-991bb19666ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:35.769668 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0bfcb6-b487-48cf-b799-991bb19666ab None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:35.879273 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 364/719] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Sep 11 08:26:35 2022] POST /identity/v3/users => generated 254 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:26:36.642612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0dfc5-2e51-4a4a-a1a6-f1818627d284 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:36.643133 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0dfc5-2e51-4a4a-a1a6-f1818627d284 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:36.643212 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0dfc5-2e51-4a4a-a1a6-f1818627d284 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:36.644851 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 356/720] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:36.651943 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ddd27-37c7-478d-b865-ac2f1d70aa51 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:36.652480 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ddd27-37c7-478d-b865-ac2f1d70aa51 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:36.652893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ddd27-37c7-478d-b865-ac2f1d70aa51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:36.688630 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-984ddd27-37c7-478d-b865-ac2f1d70aa51 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:36.690700 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-984ddd27-37c7-478d-b865-ac2f1d70aa51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:36.713152 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87623c3c-7694-44cd-853b-58764fcb244e None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:36.713787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87623c3c-7694-44cd-853b-58764fcb244e None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:36.714271 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87623c3c-7694-44cd-853b-58764fcb244e None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:36.715920 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 357/721] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:36.721775 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec94a04-0cae-4e2a-9713-11776c4cbe9b None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:36.722126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec94a04-0cae-4e2a-9713-11776c4cbe9b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:36.722342 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec94a04-0cae-4e2a-9713-11776c4cbe9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:36.756103 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-fec94a04-0cae-4e2a-9713-11776c4cbe9b None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:36.760877 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-fec94a04-0cae-4e2a-9713-11776c4cbe9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:36.861937 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 365/722] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:26:36.936723 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 358/723] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 08:26:37.209160 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ddd27-37c7-478d-b865-ac2f1d70aa51 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:37.225217 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd7661-730d-48fe-9104-04911c4d9ffb None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:37.226885 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd7661-730d-48fe-9104-04911c4d9ffb None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:37.228132 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd7661-730d-48fe-9104-04911c4d9ffb None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:37.233054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 359/724] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:37 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:37.241271 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488e0ce-40e2-483a-8630-32c138b9d2f7 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:37.242190 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488e0ce-40e2-483a-8630-32c138b9d2f7 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:37.242981 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488e0ce-40e2-483a-8630-32c138b9d2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:37.279313 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:37.297115 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-9488e0ce-40e2-483a-8630-32c138b9d2f7 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:37.300349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9488e0ce-40e2-483a-8630-32c138b9d2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:37.352050 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ddd27-37c7-478d-b865-ac2f1d70aa51 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:37.385842 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:37.396816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ec173-df5d-47c5-908c-fe943dcd27dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:37.401881 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ec173-df5d-47c5-908c-fe943dcd27dc None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:37.401881 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ec173-df5d-47c5-908c-fe943dcd27dc None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:37.401881 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ec173-df5d-47c5-908c-fe943dcd27dc None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:37.401881 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ec173-df5d-47c5-908c-fe943dcd27dc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:37.401881 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ec173-df5d-47c5-908c-fe943dcd27dc None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:37.449931 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 360/725] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:26:37.475964 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42379206-fdb8-4c13-9e1c-6a54bfcc920d None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:37.476334 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42379206-fdb8-4c13-9e1c-6a54bfcc920d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:37.476556 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42379206-fdb8-4c13-9e1c-6a54bfcc920d None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:37.478080 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 361/726] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:26:37.484062 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac7629-14b9-4550-9df3-bf6c6ff3116b None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:37.484338 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac7629-14b9-4550-9df3-bf6c6ff3116b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:37.484614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac7629-14b9-4550-9df3-bf6c6ff3116b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:37.506142 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-7fac7629-14b9-4550-9df3-bf6c6ff3116b None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:37.507399 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7fac7629-14b9-4550-9df3-bf6c6ff3116b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:37.518184 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 366/727] 10.222.0.26 () {60 vars in 1141 bytes} [Sun Sep 11 08:26:37 2022] POST /identity/v3/services => generated 240 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:26:37.588136 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ec173-df5d-47c5-908c-fe943dcd27dc None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:37.662819 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 362/728] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:37 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 08:26:37.829489 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ec173-df5d-47c5-908c-fe943dcd27dc None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:37.831087 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac7629-14b9-4550-9df3-bf6c6ff3116b None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:37.849219 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:37.886234 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d795a5-2dca-40c3-886b-b5f64e15c5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:37.888564 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d795a5-2dca-40c3-886b-b5f64e15c5e4 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:37.890634 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d795a5-2dca-40c3-886b-b5f64e15c5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:37.891408 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d795a5-2dca-40c3-886b-b5f64e15c5e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:37.912169 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d795a5-2dca-40c3-886b-b5f64e15c5e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:26:37.917300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-34d795a5-2dca-40c3-886b-b5f64e15c5e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:26:37.917300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:37.917300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:37.917300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:37.917300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:37.917300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:37.917300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:37.917300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:37.917300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:37.917300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:37.917300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:37.917300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:37.917300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:26:37.917300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:26:37.917300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:26:37.917300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:26:37.919370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:26:37.919370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:26:37.919370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:26:37.919370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:26:37.919370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:37.919370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:37.919370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:37.919370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:37.919370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:37.919370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:37.919370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:37.919370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:37.919370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:37.919370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:37.919370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:37.919370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:37.920985 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:37.920985 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:37.920985 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:37.920985 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:37.920985 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:26:37.920985 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:26:37.920985 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:26:37.920985 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:26:37.920985 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:26:37.920985 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:26:37.920985 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:26:37.920985 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:37.920985 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 367/729] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:26:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:37.931883 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d795a5-2dca-40c3-886b-b5f64e15c5e4 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:38.003498 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:38.020006 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac7629-14b9-4550-9df3-bf6c6ff3116b None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:38.084494 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a7404-9ff6-4e89-a514-bc2a22d71c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:38.085920 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a7404-9ff6-4e89-a514-bc2a22d71c51 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:38.086589 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a7404-9ff6-4e89-a514-bc2a22d71c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:38.087236 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a7404-9ff6-4e89-a514-bc2a22d71c51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:38.108001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a7404-9ff6-4e89-a514-bc2a22d71c51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:26:38.126260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-963a7404-9ff6-4e89-a514-bc2a22d71c51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:26:38.126260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:38.126260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:38.126260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:38.126260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:38.126260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:38.126260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:38.126260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:38.126260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:38.126260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:38.126260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:38.126260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:38.126260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:26:38.126260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:26:38.126260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:26:38.126260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:26:38.128102 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:26:38.128102 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:26:38.128102 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:26:38.128102 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:26:38.128102 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:38.128102 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:38.128102 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:38.128102 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:38.128102 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:38.128102 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:38.128102 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:38.128102 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:38.128102 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:38.128102 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:38.128102 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:38.128102 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:38.129697 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:38.129697 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:38.129697 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:38.129697 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:38.129697 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:26:38.129697 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:26:38.129697 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:26:38.129697 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:26:38.129697 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:26:38.129697 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:26:38.129697 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:26:38.129697 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:38.130990 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d795a5-2dca-40c3-886b-b5f64e15c5e4 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:38.134564 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 363/730] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:26:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:38.136445 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a7404-9ff6-4e89-a514-bc2a22d71c51 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:38.189453 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4680d9-855c-4b8c-921c-d80a4674e3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:38.190305 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4680d9-855c-4b8c-921c-d80a4674e3ca None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:38.190708 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4680d9-855c-4b8c-921c-d80a4674e3ca None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:38.191089 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4680d9-855c-4b8c-921c-d80a4674e3ca None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:38.192208 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4680d9-855c-4b8c-921c-d80a4674e3ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:38.193236 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4680d9-855c-4b8c-921c-d80a4674e3ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:38.199676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4680d9-855c-4b8c-921c-d80a4674e3ca None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:38.222434 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 368/731] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:26:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:26:38.223144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4680d9-855c-4b8c-921c-d80a4674e3ca None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:38.282130 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:38.347471 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a7404-9ff6-4e89-a514-bc2a22d71c51 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:38.413627 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4680d9-855c-4b8c-921c-d80a4674e3ca None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:38.416285 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb3f05-b4a2-441a-8047-16d5b919090a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:38.417841 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb3f05-b4a2-441a-8047-16d5b919090a None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:38.418680 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb3f05-b4a2-441a-8047-16d5b919090a None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:38.419540 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb3f05-b4a2-441a-8047-16d5b919090a None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:38.421020 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb3f05-b4a2-441a-8047-16d5b919090a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:38.423917 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb3f05-b4a2-441a-8047-16d5b919090a None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:38.479999 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e422fdf-2e68-4a0d-a356-d17f3c6fa6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:38.481034 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e422fdf-2e68-4a0d-a356-d17f3c6fa6dd None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:38.481531 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e422fdf-2e68-4a0d-a356-d17f3c6fa6dd None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:38.482591 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e422fdf-2e68-4a0d-a356-d17f3c6fa6dd None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:38.483274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e422fdf-2e68-4a0d-a356-d17f3c6fa6dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:38.483822 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e422fdf-2e68-4a0d-a356-d17f3c6fa6dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:38.486492 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e422fdf-2e68-4a0d-a356-d17f3c6fa6dd None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:38.500981 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 364/732] 10.222.0.26 () {60 vars in 1141 bytes} [Sun Sep 11 08:26:38 2022] POST /identity/v3/services => generated 251 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:26:38.502899 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb3f05-b4a2-441a-8047-16d5b919090a None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:38.512764 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 369/733] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:26:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:38.518334 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e422fdf-2e68-4a0d-a356-d17f3c6fa6dd None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:38.551027 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:38.740532 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb3f05-b4a2-441a-8047-16d5b919090a None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:38.798479 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:38.805918 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977e259-b2fe-4ee4-b9b9-5963ec3b7f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:38.807007 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977e259-b2fe-4ee4-b9b9-5963ec3b7f3b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:38.807510 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977e259-b2fe-4ee4-b9b9-5963ec3b7f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:38.814808 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977e259-b2fe-4ee4-b9b9-5963ec3b7f3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:38.827083 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977e259-b2fe-4ee4-b9b9-5963ec3b7f3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:38.830121 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e422fdf-2e68-4a0d-a356-d17f3c6fa6dd None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:38.830772 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977e259-b2fe-4ee4-b9b9-5963ec3b7f3b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:38.859493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-5977e259-b2fe-4ee4-b9b9-5963ec3b7f3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:38.859493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:38.859493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:38.859493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:38.859493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:38.859493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:38.859493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:38.859493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:38.859493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:38.859493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:38.859493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:38.859493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:38.859493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:38.859493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:38.859493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:38.859493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:38.861541 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:38.861541 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:38.861541 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:38.861541 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:38.861541 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:38.861541 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:38.861541 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:38.861541 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:38.861541 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:38.861541 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:38.861541 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:38.861541 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:38.861541 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:38.861541 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:38.861541 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:38.861541 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:38.861541 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:38.863433 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:38.863433 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:38.863433 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:38.866848 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 365/734] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:38.875764 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977e259-b2fe-4ee4-b9b9-5963ec3b7f3b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:38.902566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d86d64-dd3d-4265-b7ce-26e23bb402bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:38.903166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d86d64-dd3d-4265-b7ce-26e23bb402bf None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:38.903683 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d86d64-dd3d-4265-b7ce-26e23bb402bf None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:38.904426 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d86d64-dd3d-4265-b7ce-26e23bb402bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:38.925932 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d86d64-dd3d-4265-b7ce-26e23bb402bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:38.928921 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d86d64-dd3d-4265-b7ce-26e23bb402bf None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:38.955748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-68d86d64-dd3d-4265-b7ce-26e23bb402bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:38.955748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:38.955748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:38.955748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:38.955748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:38.955748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:38.955748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:38.955748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:38.955748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:38.955748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:38.955748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:38.955748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:38.955748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:38.955748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:38.955748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:38.955748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:38.957784 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:38.957784 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:38.957784 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:38.957784 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:38.957784 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:38.957784 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:38.957784 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:38.957784 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:38.957784 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:38.957784 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:38.957784 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:38.957784 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:38.957784 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:38.957784 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:38.957784 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:38.957784 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:38.957784 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:38.961219 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:38.961219 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:38.961219 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:38.961219 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 370/735] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 440 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:38.965914 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d86d64-dd3d-4265-b7ce-26e23bb402bf None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:39.005716 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:39.098044 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977e259-b2fe-4ee4-b9b9-5963ec3b7f3b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:39.162749 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb672d0-dd2a-4d06-a709-3aae6cc9e198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:39.164410 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb672d0-dd2a-4d06-a709-3aae6cc9e198 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:39.165174 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb672d0-dd2a-4d06-a709-3aae6cc9e198 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:39.165878 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb672d0-dd2a-4d06-a709-3aae6cc9e198 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:39.167486 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb672d0-dd2a-4d06-a709-3aae6cc9e198 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:39.168358 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb672d0-dd2a-4d06-a709-3aae6cc9e198 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:39.171344 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb672d0-dd2a-4d06-a709-3aae6cc9e198 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:39.173105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d86d64-dd3d-4265-b7ce-26e23bb402bf None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:39.195590 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 366/736] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:26:39.204654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb672d0-dd2a-4d06-a709-3aae6cc9e198 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:39.352432 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f77c21-02de-47c9-874c-f0afe93fa54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:39.353406 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f77c21-02de-47c9-874c-f0afe93fa54f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:39.353879 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f77c21-02de-47c9-874c-f0afe93fa54f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:39.354349 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f77c21-02de-47c9-874c-f0afe93fa54f None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:39.355539 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f77c21-02de-47c9-874c-f0afe93fa54f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:39.356601 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f77c21-02de-47c9-874c-f0afe93fa54f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:39.358382 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f77c21-02de-47c9-874c-f0afe93fa54f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:39.405584 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 371/737] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:26:39.406256 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb672d0-dd2a-4d06-a709-3aae6cc9e198 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:39.412849 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f77c21-02de-47c9-874c-f0afe93fa54f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:39.447147 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:39.467641 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:39.519156 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b2ad5-238b-4408-a8b4-22e1bd1e673e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:39.520246 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b2ad5-238b-4408-a8b4-22e1bd1e673e None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:39.521276 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b2ad5-238b-4408-a8b4-22e1bd1e673e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:39.521785 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b2ad5-238b-4408-a8b4-22e1bd1e673e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:39.548187 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b2ad5-238b-4408-a8b4-22e1bd1e673e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:39.550913 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b2ad5-238b-4408-a8b4-22e1bd1e673e None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:39.580822 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-614b2ad5-238b-4408-a8b4-22e1bd1e673e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 08:26:39.580822 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:39.580822 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:39.580822 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:39.580822 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:39.580822 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:39.580822 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:39.580822 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:39.580822 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:39.580822 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:39.580822 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:39.580822 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:39.580822 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:26:39.580822 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:26:39.580822 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:26:39.580822 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:26:39.582096 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:39.582096 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:39.582096 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:26:39.582096 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:39.582096 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:26:39.582096 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:39.582096 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:39.582096 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:39.582096 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:39.582096 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:39.582096 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:39.582096 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:39.582096 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:39.582096 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:39.582096 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:39.582096 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:39.582096 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:39.582096 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:39.583770 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:39.583770 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:39.583770 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:26:39.583770 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:26:39.583770 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:26:39.583770 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:26:39.583770 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:26:39.583770 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:26:39.583770 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 08:26:39.583770 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:39.585573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 367/738] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:26:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:39.595489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee9ef7-b428-48da-bc19-bd4319ff8b75 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:39.595489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee9ef7-b428-48da-bc19-bd4319ff8b75 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:39.595489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee9ef7-b428-48da-bc19-bd4319ff8b75 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:39.595489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 368/739] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:39.598505 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee9ef7-b428-48da-bc19-bd4319ff8b75 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:39.684946 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f77c21-02de-47c9-874c-f0afe93fa54f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:39.731766 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0429c8c-73f0-412f-a06e-4c955888bf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:39.732421 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0429c8c-73f0-412f-a06e-4c955888bf1d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:39.732810 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0429c8c-73f0-412f-a06e-4c955888bf1d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:39.733084 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0429c8c-73f0-412f-a06e-4c955888bf1d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:39.742216 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0429c8c-73f0-412f-a06e-4c955888bf1d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:39.743747 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0429c8c-73f0-412f-a06e-4c955888bf1d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:39.759401 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-c0429c8c-73f0-412f-a06e-4c955888bf1d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 08:26:39.759401 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:39.759401 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:39.759401 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:39.759401 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:39.759401 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:39.759401 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:39.759401 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:39.759401 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:39.759401 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:39.759401 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:39.759401 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:39.759401 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:26:39.759401 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:26:39.759401 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:26:39.759401 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:26:39.761175 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:39.761175 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:39.761175 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:26:39.761175 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:39.761175 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:26:39.761175 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:39.761175 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:39.761175 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:39.761175 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:39.761175 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:39.761175 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:39.761175 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:39.761175 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:39.761175 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:39.761175 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:39.761175 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:39.761175 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:39.761175 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:39.762571 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:39.762571 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:39.762571 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:26:39.762571 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:26:39.762571 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:26:39.762571 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:26:39.762571 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:26:39.762571 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:26:39.762571 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 08:26:39.762571 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:39.762571 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 372/740] 10.222.0.26 () {56 vars in 1093 bytes} [Sun Sep 11 08:26:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:39.762571 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a725bf-9a65-4c2a-a306-091c985fd092 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:39.762571 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a725bf-9a65-4c2a-a306-091c985fd092 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:39.763971 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a725bf-9a65-4c2a-a306-091c985fd092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:39.785605 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-b5a725bf-9a65-4c2a-a306-091c985fd092 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:39.787366 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b5a725bf-9a65-4c2a-a306-091c985fd092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:39.805598 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee9ef7-b428-48da-bc19-bd4319ff8b75 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:39.853146 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4eba7-b440-4b90-8003-48b0204bf55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:39.853773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4eba7-b440-4b90-8003-48b0204bf55d None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:39.854244 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4eba7-b440-4b90-8003-48b0204bf55d None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:39.854404 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4eba7-b440-4b90-8003-48b0204bf55d None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:39.855052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4eba7-b440-4b90-8003-48b0204bf55d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:39.855411 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4eba7-b440-4b90-8003-48b0204bf55d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:39.856854 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4eba7-b440-4b90-8003-48b0204bf55d None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:39.883349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 369/741] 10.222.0.26 () {56 vars in 1135 bytes} [Sun Sep 11 08:26:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:39.885186 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4eba7-b440-4b90-8003-48b0204bf55d None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:39.900382 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:39.911839 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 373/742] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:26:39.913105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a725bf-9a65-4c2a-a306-091c985fd092 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:39.954706 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:40.071545 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4eba7-b440-4b90-8003-48b0204bf55d None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:40.116595 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a725bf-9a65-4c2a-a306-091c985fd092 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:40.149793 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c410e-3965-41e8-902e-0d45c05df845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:40.150797 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c410e-3965-41e8-902e-0d45c05df845 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:40.151314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c410e-3965-41e8-902e-0d45c05df845 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:40.151795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c410e-3965-41e8-902e-0d45c05df845 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:40.152716 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c410e-3965-41e8-902e-0d45c05df845 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:40.153202 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c410e-3965-41e8-902e-0d45c05df845 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:40.154868 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c410e-3965-41e8-902e-0d45c05df845 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:40.193741 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 370/743] 10.222.0.26 () {56 vars in 1133 bytes} [Sun Sep 11 08:26:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:40.198415 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4ef3d-9116-4cfd-8c3d-4675413e62b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:40.202116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4ef3d-9116-4cfd-8c3d-4675413e62b4 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:40.202964 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4ef3d-9116-4cfd-8c3d-4675413e62b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:40.203901 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c410e-3965-41e8-902e-0d45c05df845 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:40.204631 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4ef3d-9116-4cfd-8c3d-4675413e62b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:40.343932 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:40.352945 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4ef3d-9116-4cfd-8c3d-4675413e62b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:40.354735 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4ef3d-9116-4cfd-8c3d-4675413e62b4 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:40.442067 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:40.450837 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c410e-3965-41e8-902e-0d45c05df845 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:40.495966 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41752450-adac-49ac-bb3e-c719af4ca6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:40.496309 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41752450-adac-49ac-bb3e-c719af4ca6f4 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:40.496655 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41752450-adac-49ac-bb3e-c719af4ca6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:40.496819 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41752450-adac-49ac-bb3e-c719af4ca6f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:40.511789 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41752450-adac-49ac-bb3e-c719af4ca6f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:40.521642 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41752450-adac-49ac-bb3e-c719af4ca6f4 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:40.529170 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 374/744] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:26:39 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 08:26:40.532257 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4ef3d-9116-4cfd-8c3d-4675413e62b4 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:40.545448 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-41752450-adac-49ac-bb3e-c719af4ca6f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:40.545448 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:40.545448 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:40.545448 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:40.545448 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:40.545448 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:40.545448 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:40.545448 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:40.545448 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:40.545448 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:40.545448 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:40.545448 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:40.545448 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:40.545448 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:40.545448 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:40.545448 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:40.547392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:40.547392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:40.547392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:40.547392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:40.547392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:40.547392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:40.547392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:40.547392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:40.547392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:40.547392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:40.547392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:40.547392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:40.547392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:40.547392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:40.547392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:40.547392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:40.547392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:40.549105 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:40.549105 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:40.549105 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:40.549105 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 371/745] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:40.549105 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41752450-adac-49ac-bb3e-c719af4ca6f4 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:40.704884 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41752450-adac-49ac-bb3e-c719af4ca6f4 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:40.705798 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:40.713940 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4ef3d-9116-4cfd-8c3d-4675413e62b4 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:40.752144 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237f771-d24b-421e-a845-24b2b49d2c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:40.752810 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237f771-d24b-421e-a845-24b2b49d2c84 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:40.753096 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237f771-d24b-421e-a845-24b2b49d2c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:40.753426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237f771-d24b-421e-a845-24b2b49d2c84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:40.757323 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ee8f0-5261-4e3e-9a17-1403a0d63c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:40.758135 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ee8f0-5261-4e3e-9a17-1403a0d63c17 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:40.758544 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ee8f0-5261-4e3e-9a17-1403a0d63c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:40.758951 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ee8f0-5261-4e3e-9a17-1403a0d63c17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:40.766305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237f771-d24b-421e-a845-24b2b49d2c84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:40.767917 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237f771-d24b-421e-a845-24b2b49d2c84 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:40.773331 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ee8f0-5261-4e3e-9a17-1403a0d63c17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:26:40.779456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-989ee8f0-5261-4e3e-9a17-1403a0d63c17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:40.779456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:40.779456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:40.779456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:40.779456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:40.779456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:40.779456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:40.779456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:40.779456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:40.779456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:40.779456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:40.779456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:40.779456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:26:40.779456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:26:40.779456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:26:40.779456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:26:40.780624 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:26:40.780624 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:26:40.780624 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:26:40.780624 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:26:40.780624 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:40.780624 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:40.780624 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:40.780624 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:40.780624 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:40.780624 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:40.780624 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:40.780624 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:40.780624 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:40.780624 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:40.780624 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:40.780624 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:40.781566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:40.781566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:40.781566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:40.781566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:40.781566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:26:40.781566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:26:40.781566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:26:40.781566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:26:40.781566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:26:40.781566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:26:40.781566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:40.781566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:40.782293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:40.782367 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 375/746] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Sep 11 08:26:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:40.782817 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ee8f0-5261-4e3e-9a17-1403a0d63c17 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:40.796371 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-8237f771-d24b-421e-a845-24b2b49d2c84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:40.796371 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:40.796371 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:40.796371 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:40.796371 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:40.796371 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:40.796371 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:40.796371 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:40.796371 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:40.796371 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:40.796371 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:40.796371 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:40.796371 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:40.796371 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:40.796371 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:40.796371 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:40.798206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:40.798206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:40.798206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:40.798206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:40.798206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:40.798206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:40.798206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:40.798206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:40.798206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:40.798206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:40.798206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:40.798206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:40.798206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:40.798206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:40.798206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:40.798206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:40.798206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:40.799458 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:40.799458 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:40.799458 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:40.799458 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 372/747] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:40.801332 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1bd21-3571-4678-af5f-9f6e6d7bb690 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:40.802272 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1bd21-3571-4678-af5f-9f6e6d7bb690 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:40.802689 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1bd21-3571-4678-af5f-9f6e6d7bb690 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:40.805210 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 373/748] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:40.806479 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1bd21-3571-4678-af5f-9f6e6d7bb690 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:40.949346 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ee8f0-5261-4e3e-9a17-1403a0d63c17 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:40.972067 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1bd21-3571-4678-af5f-9f6e6d7bb690 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:40.998402 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d60d1-24e1-4ab5-8d03-ab20ca33d956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:40.999426 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d60d1-24e1-4ab5-8d03-ab20ca33d956 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:40.999932 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d60d1-24e1-4ab5-8d03-ab20ca33d956 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:41.000423 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d60d1-24e1-4ab5-8d03-ab20ca33d956 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:41.001781 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d60d1-24e1-4ab5-8d03-ab20ca33d956 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:41.002335 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d60d1-24e1-4ab5-8d03-ab20ca33d956 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:41.004385 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d60d1-24e1-4ab5-8d03-ab20ca33d956 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:41.024265 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 376/749] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:41.024501 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ae4d4-004b-4b57-9c38-2a30bc7eea16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:41.024616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d60d1-24e1-4ab5-8d03-ab20ca33d956 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:41.024705 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ae4d4-004b-4b57-9c38-2a30bc7eea16 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:41.024705 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ae4d4-004b-4b57-9c38-2a30bc7eea16 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:41.024705 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ae4d4-004b-4b57-9c38-2a30bc7eea16 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:41.024705 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ae4d4-004b-4b57-9c38-2a30bc7eea16 None admin] RBAC: Adding query filter params (name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:41.024705 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ae4d4-004b-4b57-9c38-2a30bc7eea16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:41.024705 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ae4d4-004b-4b57-9c38-2a30bc7eea16 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:41.034071 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 374/750] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Sep 11 08:26:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:41.040566 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd73f2-f6ca-4977-81cd-a39f433d9e70 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:41.040838 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd73f2-f6ca-4977-81cd-a39f433d9e70 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:41.041106 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd73f2-f6ca-4977-81cd-a39f433d9e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:41.045802 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:41.061851 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-4ecd73f2-f6ca-4977-81cd-a39f433d9e70 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:41.063114 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4ecd73f2-f6ca-4977-81cd-a39f433d9e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:41.139144 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:41.163675 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 375/751] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:26:41.164461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd73f2-f6ca-4977-81cd-a39f433d9e70 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:41.173219 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d60d1-24e1-4ab5-8d03-ab20ca33d956 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:41.234382 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cb6d7-f577-4667-9768-85a80495df8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:41.236034 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cb6d7-f577-4667-9768-85a80495df8d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:41.236522 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cb6d7-f577-4667-9768-85a80495df8d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:41.237754 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cb6d7-f577-4667-9768-85a80495df8d None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:41.239552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cb6d7-f577-4667-9768-85a80495df8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:41.240139 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cb6d7-f577-4667-9768-85a80495df8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:41.243931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cb6d7-f577-4667-9768-85a80495df8d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:41.259816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 377/752] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:41.261051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cb6d7-f577-4667-9768-85a80495df8d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:41.368460 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd73f2-f6ca-4977-81cd-a39f433d9e70 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:41.397166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:41.414703 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3af22f-4ad8-4a33-9a5a-76da2efaebf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:41.415772 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3af22f-4ad8-4a33-9a5a-76da2efaebf7 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:41.416287 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3af22f-4ad8-4a33-9a5a-76da2efaebf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:41.416773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3af22f-4ad8-4a33-9a5a-76da2efaebf7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:41.425261 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3af22f-4ad8-4a33-9a5a-76da2efaebf7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:41.427130 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3af22f-4ad8-4a33-9a5a-76da2efaebf7 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:41.440848 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-8c3af22f-4ad8-4a33-9a5a-76da2efaebf7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:41.440848 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:41.440848 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:41.440848 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:41.440848 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:41.440848 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:41.440848 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:41.440848 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:41.440848 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:41.440848 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:41.440848 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:41.440848 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:41.440848 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:26:41.440848 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:26:41.440848 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:26:41.441828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:26:41.441828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:41.441828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:41.441828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:41.441828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:41.441828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:41.441828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:41.441828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:41.441828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:41.441828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:41.441828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:41.441828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:41.441828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:41.441828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:41.441828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:41.441828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:41.441828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:41.443354 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:26:41.443354 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:26:41.443354 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:26:41.443354 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:26:41.443354 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:26:41.443354 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:26:41.443354 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:41.443354 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:41.443354 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 376/753] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:26:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:41.443852 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3af22f-4ad8-4a33-9a5a-76da2efaebf7 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:41.450925 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cb6d7-f577-4667-9768-85a80495df8d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:41.491574 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d72d2-9607-4ef4-ae6f-58a74f570b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:41.492160 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d72d2-9607-4ef4-ae6f-58a74f570b9a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:41.492433 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d72d2-9607-4ef4-ae6f-58a74f570b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:41.492831 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d72d2-9607-4ef4-ae6f-58a74f570b9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:41.507053 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d72d2-9607-4ef4-ae6f-58a74f570b9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:41.508662 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d72d2-9607-4ef4-ae6f-58a74f570b9a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:41.526508 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-222d72d2-9607-4ef4-ae6f-58a74f570b9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:41.526508 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:41.526508 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:41.526508 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:41.526508 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:41.526508 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:41.526508 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:41.526508 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:41.526508 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:41.526508 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:41.526508 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:41.526508 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:41.526508 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:41.526508 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:41.526508 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:41.526508 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:41.527599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:41.527599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:41.527599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:41.527599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:41.527599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:41.527599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:41.527599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:41.527599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:41.527599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:41.527599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:41.527599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:41.527599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:41.527599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:41.527599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:41.527599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:41.527599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:41.527599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:41.528512 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:41.528512 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:41.528512 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:41.528512 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 378/754] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:41.528743 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d72d2-9607-4ef4-ae6f-58a74f570b9a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:41.548132 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:41.637043 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3af22f-4ad8-4a33-9a5a-76da2efaebf7 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:41.645725 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d72d2-9607-4ef4-ae6f-58a74f570b9a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:41.679382 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:41.685324 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d34b0-0276-4d25-a9af-acf6bbd519c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:41.685963 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d34b0-0276-4d25-a9af-acf6bbd519c4 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:41.686250 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d34b0-0276-4d25-a9af-acf6bbd519c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:41.686527 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d34b0-0276-4d25-a9af-acf6bbd519c4 None admin] PATH_INFO: `/v3/services/network` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:41.687134 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d34b0-0276-4d25-a9af-acf6bbd519c4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:41.688578 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d34b0-0276-4d25-a9af-acf6bbd519c4 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:41.698615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-8f8d34b0-0276-4d25-a9af-acf6bbd519c4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 08:26:41.698615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:41.698615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 08:26:41.698615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 08:26:41.698615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 08:26:41.698615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 08:26:41.698615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 08:26:41.698615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:26:41.698615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 08:26:41.698615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:41.698615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 08:26:41.698615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:41.698615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:41.698615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:41.698615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:41.698615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:41.698615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:41.700664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:41.700664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:41.700664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:41.700664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:41.700664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:41.700664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:41.700664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 08:26:41.700664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 08:26:41.700664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 08:26:41.700664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 08:26:41.700664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:41.700664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:41.700664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:41.700664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:41.700664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:41.700664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:41.702404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:41.702404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:41.702404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:41.702404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:41.702404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:41.702404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:41.702404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:41.702404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:41.702404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:41.702404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:41.702404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 08:26:41.702404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:26:41.702404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 08:26:41.702404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:41.705225 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 379/755] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:26:41 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:41.706007 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a592ba-778a-4ec7-bdad-3148e629af18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:41.706218 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d34b0-0276-4d25-a9af-acf6bbd519c4 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:41.706864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a592ba-778a-4ec7-bdad-3148e629af18 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:41.707240 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a592ba-778a-4ec7-bdad-3148e629af18 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:41.707627 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a592ba-778a-4ec7-bdad-3148e629af18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:41.716855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a592ba-778a-4ec7-bdad-3148e629af18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:41.718615 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a592ba-778a-4ec7-bdad-3148e629af18 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:41.733617 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-a4a592ba-778a-4ec7-bdad-3148e629af18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:41.733617 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:41.733617 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:41.733617 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:41.733617 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:41.733617 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:41.733617 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:41.733617 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:41.733617 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:41.733617 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:41.733617 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:41.733617 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:41.733617 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:26:41.733617 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:26:41.733617 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:26:41.736859 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:26:41.736859 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:41.736859 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:41.736859 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:41.736859 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:41.736859 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:41.736859 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:41.736859 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:41.736859 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:41.736859 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:41.736859 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:41.736859 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:41.736859 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:41.736859 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:41.736859 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:41.736859 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:41.736859 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:41.740647 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:26:41.740647 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:26:41.740647 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:26:41.740647 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:26:41.740647 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:26:41.740647 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:26:41.740647 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:41.740647 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:41.740647 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 377/756] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:26:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:41.740647 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a592ba-778a-4ec7-bdad-3148e629af18 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:41.841711 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d34b0-0276-4d25-a9af-acf6bbd519c4 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:41.872086 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a592ba-778a-4ec7-bdad-3148e629af18 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:41.887807 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1730ad-7304-485e-a6e2-ca3257d3b53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:41.888432 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1730ad-7304-485e-a6e2-ca3257d3b53d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:41.889008 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:41.889177 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1730ad-7304-485e-a6e2-ca3257d3b53d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:41.889818 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1730ad-7304-485e-a6e2-ca3257d3b53d None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:41.890548 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1730ad-7304-485e-a6e2-ca3257d3b53d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:41.890863 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1730ad-7304-485e-a6e2-ca3257d3b53d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:41.892427 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1730ad-7304-485e-a6e2-ca3257d3b53d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:41.908092 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 380/757] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:26:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:41.909872 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1730ad-7304-485e-a6e2-ca3257d3b53d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:41.916289 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19952e46-f28f-4ab5-857f-65bf8961bf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:41.916925 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19952e46-f28f-4ab5-857f-65bf8961bf54 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:41.917209 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19952e46-f28f-4ab5-857f-65bf8961bf54 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:41.917486 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19952e46-f28f-4ab5-857f-65bf8961bf54 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:41.918149 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19952e46-f28f-4ab5-857f-65bf8961bf54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:41.918458 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19952e46-f28f-4ab5-857f-65bf8961bf54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:41.919939 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19952e46-f28f-4ab5-857f-65bf8961bf54 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:41.939664 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 378/758] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:41.939664 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19952e46-f28f-4ab5-857f-65bf8961bf54 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:41.999121 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:42.077332 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19952e46-f28f-4ab5-857f-65bf8961bf54 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:42.090739 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1730ad-7304-485e-a6e2-ca3257d3b53d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:42.120491 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe2de9-c5b1-43c8-8cc6-7dae40dc020a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:42.120491 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe2de9-c5b1-43c8-8cc6-7dae40dc020a None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:42.120491 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe2de9-c5b1-43c8-8cc6-7dae40dc020a None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:42.120491 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe2de9-c5b1-43c8-8cc6-7dae40dc020a None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:42.121101 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe2de9-c5b1-43c8-8cc6-7dae40dc020a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:42.121101 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe2de9-c5b1-43c8-8cc6-7dae40dc020a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:42.122245 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe2de9-c5b1-43c8-8cc6-7dae40dc020a None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:42.136569 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 379/759] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:26:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:42.137561 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe2de9-c5b1-43c8-8cc6-7dae40dc020a None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:42.149371 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e1131-f002-4269-8c8b-de69848abf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:42.150128 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e1131-f002-4269-8c8b-de69848abf6f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:42.150406 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e1131-f002-4269-8c8b-de69848abf6f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:42.150681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e1131-f002-4269-8c8b-de69848abf6f None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:42.151450 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e1131-f002-4269-8c8b-de69848abf6f None admin] RBAC: Adding query filter params (name=network) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:42.151757 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e1131-f002-4269-8c8b-de69848abf6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:42.153214 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e1131-f002-4269-8c8b-de69848abf6f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:42.158669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 381/760] 10.222.0.26 () {56 vars in 1112 bytes} [Sun Sep 11 08:26:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:42.159547 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e1131-f002-4269-8c8b-de69848abf6f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:42.194722 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:42.274576 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe2de9-c5b1-43c8-8cc6-7dae40dc020a None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:42.316717 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654e33c-710d-4dbd-b5fb-1968243a324e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:42.317436 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654e33c-710d-4dbd-b5fb-1968243a324e None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:42.317716 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654e33c-710d-4dbd-b5fb-1968243a324e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:42.317994 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654e33c-710d-4dbd-b5fb-1968243a324e None admin] PATH_INFO: `/v3/projects/b6ed5f989f4248d7bab2548eb350fe17/users/e62bb9d2e13649b5af239bb56001ce16/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:42.320049 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e1131-f002-4269-8c8b-de69848abf6f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:42.320266 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9654e33c-710d-4dbd-b5fb-1968243a324e None admin] RBAC: Authorizing `identity:create_grant(project_id=b6ed5f989f4248d7bab2548eb350fe17, user_id=e62bb9d2e13649b5af239bb56001ce16, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:42.321801 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9654e33c-710d-4dbd-b5fb-1968243a324e None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:42.348611 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:42.377302 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee2030-6cda-447b-8a51-b1624e665556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:42.378130 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee2030-6cda-447b-8a51-b1624e665556 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:42.378548 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee2030-6cda-447b-8a51-b1624e665556 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:42.379005 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee2030-6cda-447b-8a51-b1624e665556 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:42.392589 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee2030-6cda-447b-8a51-b1624e665556 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:42.395928 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee2030-6cda-447b-8a51-b1624e665556 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:42.404150 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 380/761] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Sep 11 08:26:42 2022] PUT /identity/v3/projects/b6ed5f989f4248d7bab2548eb350fe17/users/e62bb9d2e13649b5af239bb56001ce16/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:26:42.411858 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654e33c-710d-4dbd-b5fb-1968243a324e None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:42.418519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-33ee2030-6cda-447b-8a51-b1624e665556 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 08:26:42.418519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:42.418519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:42.418519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:42.418519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:42.418519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:42.418519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:42.418519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:42.418519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:42.418519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:42.418519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:42.418519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:42.418519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:26:42.418519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:26:42.418519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:26:42.418519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:26:42.420383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:42.420383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:42.420383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:26:42.420383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:42.420383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:26:42.420383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:42.420383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:42.420383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:42.420383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:42.420383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:42.420383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:42.420383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:42.420383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:42.420383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:42.420383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:42.420383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:42.420383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:42.420383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:42.422519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:42.422519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:42.422519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:26:42.422519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:26:42.422519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:26:42.422519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:26:42.422519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:26:42.422519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:26:42.422519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 08:26:42.422519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:42.422519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 382/762] 10.222.0.26 () {56 vars in 1117 bytes} [Sun Sep 11 08:26:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:42.422519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee2030-6cda-447b-8a51-b1624e665556 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:42.585999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:42.597181 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee2030-6cda-447b-8a51-b1624e665556 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:42.603010 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654e33c-710d-4dbd-b5fb-1968243a324e None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:42.665847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0c8c7-2e82-43d8-b38b-36dc7bd9b119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:42.666384 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0c8c7-2e82-43d8-b38b-36dc7bd9b119 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:42.666662 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0c8c7-2e82-43d8-b38b-36dc7bd9b119 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:42.666988 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0c8c7-2e82-43d8-b38b-36dc7bd9b119 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:42.667761 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0c8c7-2e82-43d8-b38b-36dc7bd9b119 None admin] RBAC: Adding query filter params (role.id=d12af9f1dfb344cd8a6a493e165030ba, scope.project.id=b6ed5f989f4248d7bab2548eb350fe17, user.id=d1a4f25df9724d34afdd6a41e719546a) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:42.668133 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0c8c7-2e82-43d8-b38b-36dc7bd9b119 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:42.672817 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a0619-8763-4649-b601-bb0f2ed90d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:42.673118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0c8c7-2e82-43d8-b38b-36dc7bd9b119 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:42.673252 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a0619-8763-4649-b601-bb0f2ed90d54 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:42.673252 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a0619-8763-4649-b601-bb0f2ed90d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:42.673252 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a0619-8763-4649-b601-bb0f2ed90d54 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:42.673252 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a0619-8763-4649-b601-bb0f2ed90d54 None admin] RBAC: Adding query filter params (type=network) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:42.673252 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a0619-8763-4649-b601-bb0f2ed90d54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:42.675758 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a0619-8763-4649-b601-bb0f2ed90d54 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:42.676830 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 381/763] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:26:42 2022] GET /identity/v3/role_assignments?user.id=d1a4f25df9724d34afdd6a41e719546a&scope.project.id=b6ed5f989f4248d7bab2548eb350fe17&role.id=d12af9f1dfb344cd8a6a493e165030ba => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:42.684224 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c0ae4-0d71-455a-a482-793f58d54cd5 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:42.684224 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c0ae4-0d71-455a-a482-793f58d54cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:42.684224 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c0ae4-0d71-455a-a482-793f58d54cd5 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:42.684224 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 382/764] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:42.684224 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c0ae4-0d71-455a-a482-793f58d54cd5 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:42.698839 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 383/765] 10.222.0.26 () {56 vars in 1112 bytes} [Sun Sep 11 08:26:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:42.701446 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f61029-15d2-487a-8a5a-b929340294ad None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:42.701946 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f61029-15d2-487a-8a5a-b929340294ad None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:42.702796 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f61029-15d2-487a-8a5a-b929340294ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:42.743435 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-61f61029-15d2-487a-8a5a-b929340294ad None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:42.744681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-61f61029-15d2-487a-8a5a-b929340294ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:42.812472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:42.855089 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c0ae4-0d71-455a-a482-793f58d54cd5 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:42.895358 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 384/766] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:26:42.898741 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f61029-15d2-487a-8a5a-b929340294ad None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:42.927306 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc092c-0ca7-4aa2-b8bc-414ffb88240e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:42.928208 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc092c-0ca7-4aa2-b8bc-414ffb88240e None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:42.928819 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc092c-0ca7-4aa2-b8bc-414ffb88240e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:42.929359 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc092c-0ca7-4aa2-b8bc-414ffb88240e None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:42.930686 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc092c-0ca7-4aa2-b8bc-414ffb88240e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:42.939357 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc092c-0ca7-4aa2-b8bc-414ffb88240e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:42.942700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc092c-0ca7-4aa2-b8bc-414ffb88240e None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:42.997552 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 383/767] 10.222.0.26 () {56 vars in 1149 bytes} [Sun Sep 11 08:26:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:43.007171 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc092c-0ca7-4aa2-b8bc-414ffb88240e None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:43.035693 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:43.102330 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f61029-15d2-487a-8a5a-b929340294ad None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:43.144112 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81826f-1bd0-4055-ba21-9cf009cf29f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:43.144788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81826f-1bd0-4055-ba21-9cf009cf29f2 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:43.145082 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81826f-1bd0-4055-ba21-9cf009cf29f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:43.145393 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81826f-1bd0-4055-ba21-9cf009cf29f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:43.146154 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81826f-1bd0-4055-ba21-9cf009cf29f2 None admin] RBAC: Adding query filter params (interface=public, service_id=7e14df9931b744df8bb3ebeb4103ffd6, region_id=RegionOne) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:43.146518 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81826f-1bd0-4055-ba21-9cf009cf29f2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:43.147968 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81826f-1bd0-4055-ba21-9cf009cf29f2 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:43.156976 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 385/768] 10.222.0.26 () {56 vars in 1251 bytes} [Sun Sep 11 08:26:42 2022] GET /identity/v3/endpoints?service_id=7e14df9931b744df8bb3ebeb4103ffd6&interface=public®ion_id=RegionOne => generated 194 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:43.167552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81826f-1bd0-4055-ba21-9cf009cf29f2 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:43.205776 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc092c-0ca7-4aa2-b8bc-414ffb88240e None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:43.265562 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e481e-3443-4626-93e5-4f31f86f90ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:43.266525 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e481e-3443-4626-93e5-4f31f86f90ba None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:43.266997 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e481e-3443-4626-93e5-4f31f86f90ba None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:43.267514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e481e-3443-4626-93e5-4f31f86f90ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:43.268775 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:43.404508 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e481e-3443-4626-93e5-4f31f86f90ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:43.407136 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e481e-3443-4626-93e5-4f31f86f90ba None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:43.434641 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:43.470787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81826f-1bd0-4055-ba21-9cf009cf29f2 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:43.516150 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13a3f4-3ec8-4516-99cd-f084cf70ce18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:43.517242 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13a3f4-3ec8-4516-99cd-f084cf70ce18 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:43.517755 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13a3f4-3ec8-4516-99cd-f084cf70ce18 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:43.518245 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13a3f4-3ec8-4516-99cd-f084cf70ce18 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:43.519355 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13a3f4-3ec8-4516-99cd-f084cf70ce18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:43.522335 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13a3f4-3ec8-4516-99cd-f084cf70ce18 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:43.529871 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 386/769] 10.222.0.26 () {56 vars in 1087 bytes} [Sun Sep 11 08:26:43 2022] GET /identity/v3/services => generated 772 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:26:43.531720 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13a3f4-3ec8-4516-99cd-f084cf70ce18 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:43.560583 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 384/770] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:26:43 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 11 08:26:43.570943 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e481e-3443-4626-93e5-4f31f86f90ba None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:43.667677 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:43.672791 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13a3f4-3ec8-4516-99cd-f084cf70ce18 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:43.717533 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff299e-35f8-4210-814d-e6ea864a8a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:43.719065 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff299e-35f8-4210-814d-e6ea864a8a1c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:43.719446 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff299e-35f8-4210-814d-e6ea864a8a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:43.719816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff299e-35f8-4210-814d-e6ea864a8a1c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:43.720542 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff299e-35f8-4210-814d-e6ea864a8a1c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:43.722135 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff299e-35f8-4210-814d-e6ea864a8a1c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:43.733642 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-98ff299e-35f8-4210-814d-e6ea864a8a1c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 08:26:43.733642 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:43.733642 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 08:26:43.733642 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 08:26:43.733642 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 08:26:43.733642 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 08:26:43.733642 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 08:26:43.733642 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:26:43.733642 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 08:26:43.733642 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:43.733642 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 08:26:43.733642 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:43.733642 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:43.733642 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:43.733642 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:43.733642 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:43.733642 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:43.735861 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:43.735861 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:43.735861 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:43.735861 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:43.735861 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:43.735861 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:43.735861 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 08:26:43.735861 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 08:26:43.735861 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 08:26:43.735861 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 08:26:43.735861 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:43.735861 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:43.735861 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:43.735861 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:43.735861 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:43.735861 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:43.739180 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:43.739180 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:43.739180 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:43.739180 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:43.739180 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:43.739180 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:43.739180 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:43.739180 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:43.739180 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:43.739180 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:43.739180 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 08:26:43.739180 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:26:43.739180 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 08:26:43.739180 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:43.739180 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 387/771] 10.222.0.26 () {56 vars in 1129 bytes} [Sun Sep 11 08:26:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:43.747284 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff299e-35f8-4210-814d-e6ea864a8a1c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:43.881930 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff299e-35f8-4210-814d-e6ea864a8a1c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:43.888152 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e481e-3443-4626-93e5-4f31f86f90ba None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:43.919389 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:43.938128 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1260c-2088-4628-9737-816eccabd3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:43.938763 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1260c-2088-4628-9737-816eccabd3c4 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:43.939050 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1260c-2088-4628-9737-816eccabd3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:43.939363 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1260c-2088-4628-9737-816eccabd3c4 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:43.940193 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1260c-2088-4628-9737-816eccabd3c4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:43.940362 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1260c-2088-4628-9737-816eccabd3c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:43.941757 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1260c-2088-4628-9737-816eccabd3c4 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:43.950735 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 388/772] 10.222.0.26 () {56 vars in 1124 bytes} [Sun Sep 11 08:26:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:26:43.956911 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1260c-2088-4628-9737-816eccabd3c4 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:43.977097 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5e31f-f851-4785-a4d6-91336c0c2b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:43.980120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5e31f-f851-4785-a4d6-91336c0c2b15 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:43.981214 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5e31f-f851-4785-a4d6-91336c0c2b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:43.981946 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5e31f-f851-4785-a4d6-91336c0c2b15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:43.998345 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5e31f-f851-4785-a4d6-91336c0c2b15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:44.000020 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5e31f-f851-4785-a4d6-91336c0c2b15 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:44.002576 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:44.018192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-b2d5e31f-f851-4785-a4d6-91336c0c2b15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:44.018192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:44.018192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:44.018192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:44.018192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:44.018192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:44.018192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:44.018192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:44.018192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:44.018192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:44.018192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:44.018192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:44.018192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:44.018192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:44.018192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:44.018192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:44.020492 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:44.020492 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:44.020492 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:44.020492 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:44.020492 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:44.020492 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:44.020492 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:44.020492 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:44.020492 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:44.020492 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:44.020492 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:44.020492 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:44.020492 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:44.020492 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:44.020492 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:44.020492 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:44.020492 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:44.022414 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:44.022414 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:44.022414 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:44.022414 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 385/773] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 451 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:44.027942 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5e31f-f851-4785-a4d6-91336c0c2b15 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:44.181994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1260c-2088-4628-9737-816eccabd3c4 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:44.256056 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d25a16-e0c4-47c6-8375-42f77f820c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:44.256973 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d25a16-e0c4-47c6-8375-42f77f820c43 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:44.258727 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d25a16-e0c4-47c6-8375-42f77f820c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:44.259222 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d25a16-e0c4-47c6-8375-42f77f820c43 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:44.262776 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d25a16-e0c4-47c6-8375-42f77f820c43 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:44.263403 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d25a16-e0c4-47c6-8375-42f77f820c43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:44.265912 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d25a16-e0c4-47c6-8375-42f77f820c43 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:44.281273 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5e31f-f851-4785-a4d6-91336c0c2b15 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:44.296091 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 389/774] 10.222.0.26 () {56 vars in 1124 bytes} [Sun Sep 11 08:26:43 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:26:44.302654 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d25a16-e0c4-47c6-8375-42f77f820c43 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:44.373644 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57438e5-bd3e-4517-b79c-b0d910550dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:44.374265 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57438e5-bd3e-4517-b79c-b0d910550dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:44.374612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57438e5-bd3e-4517-b79c-b0d910550dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:44.374896 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57438e5-bd3e-4517-b79c-b0d910550dd2 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:44.375631 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57438e5-bd3e-4517-b79c-b0d910550dd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:44.375949 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57438e5-bd3e-4517-b79c-b0d910550dd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:44.377426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57438e5-bd3e-4517-b79c-b0d910550dd2 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:44.392551 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 386/775] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:44.398227 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57438e5-bd3e-4517-b79c-b0d910550dd2 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:44.429819 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:44.507733 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:44.510445 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57438e5-bd3e-4517-b79c-b0d910550dd2 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:44.521229 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d25a16-e0c4-47c6-8375-42f77f820c43 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:44.555474 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc36e4a-1951-4ecb-b560-8bd1afbd3782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:44.556676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc36e4a-1951-4ecb-b560-8bd1afbd3782 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:44.557016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc36e4a-1951-4ecb-b560-8bd1afbd3782 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:44.557295 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc36e4a-1951-4ecb-b560-8bd1afbd3782 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:44.578507 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc36e4a-1951-4ecb-b560-8bd1afbd3782 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:44.580309 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc36e4a-1951-4ecb-b560-8bd1afbd3782 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:44.605752 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-2fc36e4a-1951-4ecb-b560-8bd1afbd3782 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:44.605752 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:44.605752 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:44.605752 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:44.605752 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:44.605752 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:44.605752 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:44.605752 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:44.605752 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:44.605752 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:44.605752 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:44.605752 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:44.605752 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:26:44.605752 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:26:44.605752 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:26:44.606732 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:26:44.606732 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:44.606732 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:44.606732 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:44.606732 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:44.606732 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:44.606732 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:44.606732 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:44.606732 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:44.606732 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:44.606732 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:44.606732 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:44.606732 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:44.606732 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:44.606732 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:44.606732 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:44.606732 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:44.607666 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:26:44.607666 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:26:44.607666 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:26:44.607666 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:26:44.607666 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:26:44.607666 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:26:44.607666 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:44.607666 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:44.607666 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 387/776] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:26:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:44.613849 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fd40c-d35c-4379-8455-41e539f6c49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:44.614536 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fd40c-d35c-4379-8455-41e539f6c49b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:44.614823 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fd40c-d35c-4379-8455-41e539f6c49b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:44.615105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fd40c-d35c-4379-8455-41e539f6c49b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:44.615861 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9fd40c-d35c-4379-8455-41e539f6c49b None admin] RBAC: Adding query filter params (interface=public, service_id=d5455db78e094aa487160cbc800af957, region_id=RegionOne) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:44.616178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9fd40c-d35c-4379-8455-41e539f6c49b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:44.617960 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc36e4a-1951-4ecb-b560-8bd1afbd3782 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:44.618757 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9fd40c-d35c-4379-8455-41e539f6c49b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:44.628894 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 390/777] 10.222.0.26 () {56 vars in 1251 bytes} [Sun Sep 11 08:26:44 2022] GET /identity/v3/endpoints?service_id=d5455db78e094aa487160cbc800af957&interface=public®ion_id=RegionOne => generated 194 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:26:44.635026 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fd40c-d35c-4379-8455-41e539f6c49b None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:44.785780 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fd40c-d35c-4379-8455-41e539f6c49b None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:44.824282 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd004ac-8aeb-4d4d-abc6-ff89a261e892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:44.824998 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd004ac-8aeb-4d4d-abc6-ff89a261e892 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:44.825288 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd004ac-8aeb-4d4d-abc6-ff89a261e892 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:44.825567 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd004ac-8aeb-4d4d-abc6-ff89a261e892 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:44.826191 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd004ac-8aeb-4d4d-abc6-ff89a261e892 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:44.827631 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd004ac-8aeb-4d4d-abc6-ff89a261e892 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:44.834518 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 391/778] 10.222.0.26 () {56 vars in 1087 bytes} [Sun Sep 11 08:26:44 2022] GET /identity/v3/services => generated 772 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:44.858250 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:44.888452 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc36e4a-1951-4ecb-b560-8bd1afbd3782 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:44.963655 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4596d8-4e1a-4067-baba-17a734e1e865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:44.964707 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4596d8-4e1a-4067-baba-17a734e1e865 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:44.965203 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4596d8-4e1a-4067-baba-17a734e1e865 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:44.965693 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4596d8-4e1a-4067-baba-17a734e1e865 None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:44.966981 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4596d8-4e1a-4067-baba-17a734e1e865 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:44.967556 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4596d8-4e1a-4067-baba-17a734e1e865 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:44.970316 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4596d8-4e1a-4067-baba-17a734e1e865 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:44.994994 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 388/779] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:26:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:45.000771 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd004ac-8aeb-4d4d-abc6-ff89a261e892 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:45.042467 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:45.169957 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd004ac-8aeb-4d4d-abc6-ff89a261e892 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:45.212266 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51efd56e-be6e-4ac5-aba0-2022eb7394fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:45.213765 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efd56e-be6e-4ac5-aba0-2022eb7394fb None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:45.214246 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efd56e-be6e-4ac5-aba0-2022eb7394fb None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:45.214720 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efd56e-be6e-4ac5-aba0-2022eb7394fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:45.215803 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51efd56e-be6e-4ac5-aba0-2022eb7394fb None admin] RBAC: Adding query filter params (role.id=b936dc45662c4ac195fdbf9e8ac589b0, scope.project.id=b6ed5f989f4248d7bab2548eb350fe17, user.id=84fcccb19a5e43ac9da5d7ca501563e4) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:45.216367 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51efd56e-be6e-4ac5-aba0-2022eb7394fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:45.218032 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51efd56e-be6e-4ac5-aba0-2022eb7394fb None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:45.225123 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 392/780] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:26:44 2022] GET /identity/v3/role_assignments?user.id=84fcccb19a5e43ac9da5d7ca501563e4&scope.project.id=b6ed5f989f4248d7bab2548eb350fe17&role.id=b936dc45662c4ac195fdbf9e8ac589b0 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:45.954181 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5429366-bbb0-4d5a-a08b-3d10aa8b4708 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:45.954820 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5429366-bbb0-4d5a-a08b-3d10aa8b4708 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:45.955332 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5429366-bbb0-4d5a-a08b-3d10aa8b4708 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:45.957230 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 389/781] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:45.963380 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cccce0-576b-4bac-b2be-2ccbc2dea70c None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:45.963679 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cccce0-576b-4bac-b2be-2ccbc2dea70c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:45.963944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cccce0-576b-4bac-b2be-2ccbc2dea70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:45.992366 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-d6cccce0-576b-4bac-b2be-2ccbc2dea70c None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:45.993620 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d6cccce0-576b-4bac-b2be-2ccbc2dea70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:46.069741 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 393/782] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:26:46.447978 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8ae9a-6ffd-47aa-9c3e-f31e02d93ad7 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:46.448896 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8ae9a-6ffd-47aa-9c3e-f31e02d93ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:46.449324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8ae9a-6ffd-47aa-9c3e-f31e02d93ad7 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:46.451231 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 390/783] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:46.458221 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f63fbe-149c-40df-9020-3c40507dcfe0 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:46.458773 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f63fbe-149c-40df-9020-3c40507dcfe0 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:46.459054 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f63fbe-149c-40df-9020-3c40507dcfe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:46.463181 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8ae9a-6ffd-47aa-9c3e-f31e02d93ad7 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:46.482851 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-99f63fbe-149c-40df-9020-3c40507dcfe0 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:46.484355 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-99f63fbe-149c-40df-9020-3c40507dcfe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:46.493025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:46.562600 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 394/784] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:26:46.679742 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8ae9a-6ffd-47aa-9c3e-f31e02d93ad7 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:46.735409 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b297f-ec0c-4dd4-86fc-5b4d24a75763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:46.736129 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b297f-ec0c-4dd4-86fc-5b4d24a75763 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:46.736413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b297f-ec0c-4dd4-86fc-5b4d24a75763 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:46.736743 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b297f-ec0c-4dd4-86fc-5b4d24a75763 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:46.756335 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b297f-ec0c-4dd4-86fc-5b4d24a75763 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:26:46.761593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-861b297f-ec0c-4dd4-86fc-5b4d24a75763 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:26:46.761593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:46.761593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:46.761593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:46.761593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:46.761593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:46.761593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:46.761593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:46.761593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:46.761593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:46.761593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:46.761593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:46.761593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:26:46.761593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:26:46.761593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:26:46.761593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:26:46.762593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:26:46.762593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:26:46.762593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:26:46.762593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:26:46.762593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:46.762593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:46.762593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:46.762593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:46.762593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:46.762593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:46.762593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:46.762593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:46.762593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:46.762593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:46.762593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:46.762593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:46.763628 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:46.763628 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:46.763628 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:46.763628 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:46.763628 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:26:46.763628 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:26:46.763628 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:26:46.763628 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:26:46.763628 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:26:46.763628 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:26:46.763628 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:26:46.763628 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:46.763628 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 391/785] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:26:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:46.773535 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f63fbe-149c-40df-9020-3c40507dcfe0 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:46.891433 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b297f-ec0c-4dd4-86fc-5b4d24a75763 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:46.907643 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:46.932573 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f63fbe-149c-40df-9020-3c40507dcfe0 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:46.974355 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286cff3-9fc0-491b-8341-bb8aab71d423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:46.975634 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286cff3-9fc0-491b-8341-bb8aab71d423 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:46.976232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286cff3-9fc0-491b-8341-bb8aab71d423 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:46.976707 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286cff3-9fc0-491b-8341-bb8aab71d423 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:46.977592 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286cff3-9fc0-491b-8341-bb8aab71d423 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:46.978098 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286cff3-9fc0-491b-8341-bb8aab71d423 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:46.979840 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286cff3-9fc0-491b-8341-bb8aab71d423 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:46.990992 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 395/786] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:26:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:46.996684 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286cff3-9fc0-491b-8341-bb8aab71d423 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:47.003188 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:47.068706 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b297f-ec0c-4dd4-86fc-5b4d24a75763 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:47.110781 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad969675-546b-4a76-975f-d70a09db7cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:47.112046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad969675-546b-4a76-975f-d70a09db7cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:47.112499 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad969675-546b-4a76-975f-d70a09db7cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:47.112996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad969675-546b-4a76-975f-d70a09db7cd3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:47.128959 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad969675-546b-4a76-975f-d70a09db7cd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:26:47.136839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-ad969675-546b-4a76-975f-d70a09db7cd3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:26:47.136839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:47.136839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:47.136839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:47.136839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:47.136839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:47.136839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:47.136839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:47.136839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:47.136839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:47.136839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:47.136839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:47.136839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:26:47.136839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:26:47.136839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:26:47.136839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:26:47.138095 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:26:47.138095 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:26:47.138095 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:26:47.138095 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:26:47.138095 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:47.138095 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:47.138095 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:47.138095 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:47.138095 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:47.138095 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:47.138095 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:47.138095 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:47.138095 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:47.138095 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:47.138095 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:47.138095 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:47.139204 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:47.139204 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:47.139204 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:47.139204 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:47.139204 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:26:47.139204 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:26:47.139204 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:26:47.139204 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:26:47.139204 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:26:47.139204 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:26:47.139204 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:26:47.139204 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:47.142426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 392/787] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:26:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:47.149547 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad969675-546b-4a76-975f-d70a09db7cd3 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:47.235479 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:47.250208 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286cff3-9fc0-491b-8341-bb8aab71d423 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:47.297100 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad969675-546b-4a76-975f-d70a09db7cd3 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:47.322642 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ab199-8914-4c3d-a953-d064c40aa81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:47.324089 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ab199-8914-4c3d-a953-d064c40aa81c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:47.324769 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ab199-8914-4c3d-a953-d064c40aa81c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:47.325793 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ab199-8914-4c3d-a953-d064c40aa81c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:47.343841 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ab199-8914-4c3d-a953-d064c40aa81c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:47.345487 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ab199-8914-4c3d-a953-d064c40aa81c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:47.363109 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-207ab199-8914-4c3d-a953-d064c40aa81c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:47.363109 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:47.363109 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:47.363109 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:47.363109 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:47.363109 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:47.363109 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:47.363109 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:47.363109 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:47.363109 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:47.363109 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:47.363109 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:47.363109 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:47.363109 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:47.363109 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:47.363109 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:47.365787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:47.365787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:47.365787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:47.365787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:47.365787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:47.365787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:47.365787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:47.365787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:47.365787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:47.365787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:47.365787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:47.365787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:47.365787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:47.365787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:47.365787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:47.365787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:47.365787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:47.367962 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:47.367962 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:47.367962 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:47.367962 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 396/788] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:47.369161 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc2a01-30f4-4e25-8a28-e2c0f553c980 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:47.369548 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc2a01-30f4-4e25-8a28-e2c0f553c980 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:47.370022 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc2a01-30f4-4e25-8a28-e2c0f553c980 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:47.371721 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 397/789] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:47.372657 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc2a01-30f4-4e25-8a28-e2c0f553c980 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:47.379934 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef1cfa-ffa4-4776-b04f-4f4feb7f4da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:47.381210 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef1cfa-ffa4-4776-b04f-4f4feb7f4da0 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:47.381878 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef1cfa-ffa4-4776-b04f-4f4feb7f4da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:47.382578 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef1cfa-ffa4-4776-b04f-4f4feb7f4da0 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:47.384933 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef1cfa-ffa4-4776-b04f-4f4feb7f4da0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:47.385571 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef1cfa-ffa4-4776-b04f-4f4feb7f4da0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:47.390012 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef1cfa-ffa4-4776-b04f-4f4feb7f4da0 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:47.406060 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 393/790] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:26:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:26:47.411475 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d7230-7870-47b9-9b98-d218d0cdb139 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:47.411475 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d7230-7870-47b9-9b98-d218d0cdb139 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:47.411475 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d7230-7870-47b9-9b98-d218d0cdb139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:47.439086 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-892d7230-7870-47b9-9b98-d218d0cdb139 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:47.440428 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-892d7230-7870-47b9-9b98-d218d0cdb139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:47.491062 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:47.530343 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 394/791] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:26:47.531355 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d7230-7870-47b9-9b98-d218d0cdb139 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:47.608722 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:47.636306 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc2a01-30f4-4e25-8a28-e2c0f553c980 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:47.657711 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d7230-7870-47b9-9b98-d218d0cdb139 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:47.717769 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d96d25-8a07-4399-89d7-c6cea678afe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:47.724388 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d96d25-8a07-4399-89d7-c6cea678afe6 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:47.724921 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d96d25-8a07-4399-89d7-c6cea678afe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:47.725408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d96d25-8a07-4399-89d7-c6cea678afe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:47.763752 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d96d25-8a07-4399-89d7-c6cea678afe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:47.766778 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d96d25-8a07-4399-89d7-c6cea678afe6 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:47.778441 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44011783-8660-443f-a91c-a6c2ba1b3b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:47.779510 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44011783-8660-443f-a91c-a6c2ba1b3b0c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:47.779988 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44011783-8660-443f-a91c-a6c2ba1b3b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:47.780528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44011783-8660-443f-a91c-a6c2ba1b3b0c None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:47.783281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44011783-8660-443f-a91c-a6c2ba1b3b0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:47.787714 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44011783-8660-443f-a91c-a6c2ba1b3b0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:47.790338 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44011783-8660-443f-a91c-a6c2ba1b3b0c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:47.809099 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 398/792] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:47.809998 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44011783-8660-443f-a91c-a6c2ba1b3b0c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:47.811815 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-93d96d25-8a07-4399-89d7-c6cea678afe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:47.811815 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:47.811815 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:47.811815 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:47.811815 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:47.811815 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:47.811815 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:47.811815 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:47.811815 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:47.811815 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:47.811815 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:47.811815 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:47.811815 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:47.811815 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:47.811815 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:47.811815 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:47.812789 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:47.812789 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:47.812789 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:47.812789 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:47.812789 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:47.812789 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:47.812789 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:47.812789 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:47.812789 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:47.812789 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:47.812789 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:47.812789 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:47.812789 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:47.812789 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:47.812789 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:47.812789 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:47.812789 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:47.813685 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:47.813685 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:47.813685 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:47.815231 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 395/793] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:47.819440 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d96d25-8a07-4399-89d7-c6cea678afe6 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:47.933791 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44011783-8660-443f-a91c-a6c2ba1b3b0c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:47.956616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:47.981522 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab1579-39e6-435d-b6fe-9710385c01d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:47.982250 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab1579-39e6-435d-b6fe-9710385c01d8 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:47.982537 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab1579-39e6-435d-b6fe-9710385c01d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:47.982820 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab1579-39e6-435d-b6fe-9710385c01d8 None admin] PATH_INFO: `/v3/services/network` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:47.983511 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab1579-39e6-435d-b6fe-9710385c01d8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:47.984930 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab1579-39e6-435d-b6fe-9710385c01d8 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:47.996300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-bcab1579-39e6-435d-b6fe-9710385c01d8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 08:26:47.996300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:47.996300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 08:26:47.996300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 08:26:47.996300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 08:26:47.996300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 08:26:47.996300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 08:26:47.996300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:26:47.996300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 08:26:47.996300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:47.996300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 08:26:47.996300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:47.996300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:47.996300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:47.996300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:47.996300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:47.996300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:47.998472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:47.998472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:47.998472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:47.998472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:47.998472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:47.998472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:47.998472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 08:26:47.998472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 08:26:47.998472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 08:26:47.998472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 08:26:47.998472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:47.998472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:47.998472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:47.998472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:47.998472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:47.998472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:48.000383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:48.000383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:48.000383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:48.000383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:48.000383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:48.000383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:48.000383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:48.000383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:48.000383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:48.000383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:48.000383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 08:26:48.000383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:26:48.000383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 08:26:48.000383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:48.008554 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 399/794] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:26:47 2022] GET /identity/v3/services/network => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:48.009790 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab1579-39e6-435d-b6fe-9710385c01d8 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:48.046998 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d96d25-8a07-4399-89d7-c6cea678afe6 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:48.061327 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:48.090778 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad795d1b-58ac-4530-bc1e-ba1e56c2f098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:48.091627 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad795d1b-58ac-4530-bc1e-ba1e56c2f098 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:48.092071 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad795d1b-58ac-4530-bc1e-ba1e56c2f098 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:48.092461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad795d1b-58ac-4530-bc1e-ba1e56c2f098 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:48.111094 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad795d1b-58ac-4530-bc1e-ba1e56c2f098 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:48.116516 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad795d1b-58ac-4530-bc1e-ba1e56c2f098 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:48.150445 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-ad795d1b-58ac-4530-bc1e-ba1e56c2f098 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 08:26:48.150445 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:48.150445 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:48.150445 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:48.150445 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:48.150445 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:48.150445 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:48.150445 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:48.150445 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:48.150445 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:48.150445 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:48.150445 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:48.150445 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:26:48.150445 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:26:48.150445 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:26:48.150445 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:26:48.152305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:48.152305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:48.152305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:26:48.152305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:48.152305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:26:48.152305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:48.152305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:48.152305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:48.152305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:48.152305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:48.152305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:48.152305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:48.152305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:48.152305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:48.152305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:48.152305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:48.152305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:48.152305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:48.156864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:48.156864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:48.156864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:26:48.156864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:26:48.156864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:26:48.156864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:26:48.156864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:26:48.156864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:26:48.156864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 08:26:48.156864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:48.156864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 396/795] 10.222.0.26 () {56 vars in 1093 bytes} [Sun Sep 11 08:26:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:48.156864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad795d1b-58ac-4530-bc1e-ba1e56c2f098 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:48.185655 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab1579-39e6-435d-b6fe-9710385c01d8 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:48.224301 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf38c82-8d73-44c0-a322-3b50461a6599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:48.224957 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf38c82-8d73-44c0-a322-3b50461a6599 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:48.225240 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf38c82-8d73-44c0-a322-3b50461a6599 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:48.225545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf38c82-8d73-44c0-a322-3b50461a6599 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:48.226209 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf38c82-8d73-44c0-a322-3b50461a6599 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:48.226517 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf38c82-8d73-44c0-a322-3b50461a6599 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:48.227964 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf38c82-8d73-44c0-a322-3b50461a6599 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:48.243297 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 400/796] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:48.244136 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf38c82-8d73-44c0-a322-3b50461a6599 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:48.294659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:48.350710 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad795d1b-58ac-4530-bc1e-ba1e56c2f098 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:48.387612 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf38c82-8d73-44c0-a322-3b50461a6599 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:48.388684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d630cfe-1b68-4af9-aa20-5db97b19c7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:48.389310 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d630cfe-1b68-4af9-aa20-5db97b19c7eb None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:48.389587 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d630cfe-1b68-4af9-aa20-5db97b19c7eb None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:48.389859 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d630cfe-1b68-4af9-aa20-5db97b19c7eb None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:48.390498 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d630cfe-1b68-4af9-aa20-5db97b19c7eb None admin] RBAC: Adding query filter params (name=network) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:48.390801 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d630cfe-1b68-4af9-aa20-5db97b19c7eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:48.392648 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d630cfe-1b68-4af9-aa20-5db97b19c7eb None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:48.402269 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 397/797] 10.222.0.26 () {56 vars in 1112 bytes} [Sun Sep 11 08:26:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:48.402269 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe6c8c-1515-48dd-a7c6-84b1b43499f6 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:48.402269 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe6c8c-1515-48dd-a7c6-84b1b43499f6 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:48.402269 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe6c8c-1515-48dd-a7c6-84b1b43499f6 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:48.405520 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 398/798] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:48.406486 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe6c8c-1515-48dd-a7c6-84b1b43499f6 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:48.444127 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:48.449401 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d478d6-7e38-489d-bf31-769bfb213652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:48.450428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d478d6-7e38-489d-bf31-769bfb213652 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:48.450908 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d478d6-7e38-489d-bf31-769bfb213652 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:48.451412 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d478d6-7e38-489d-bf31-769bfb213652 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:48.452878 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d478d6-7e38-489d-bf31-769bfb213652 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:48.453427 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d478d6-7e38-489d-bf31-769bfb213652 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:48.456434 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d478d6-7e38-489d-bf31-769bfb213652 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:48.482512 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 401/799] 10.222.0.26 () {56 vars in 1133 bytes} [Sun Sep 11 08:26:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:48.483408 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d478d6-7e38-489d-bf31-769bfb213652 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:48.519885 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe6c8c-1515-48dd-a7c6-84b1b43499f6 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:48.557038 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b5097-ed30-4544-bc21-850bd419dffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:48.557758 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b5097-ed30-4544-bc21-850bd419dffc None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:48.557924 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b5097-ed30-4544-bc21-850bd419dffc None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:48.558204 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b5097-ed30-4544-bc21-850bd419dffc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:48.566312 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b5097-ed30-4544-bc21-850bd419dffc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:48.567858 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b5097-ed30-4544-bc21-850bd419dffc None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:48.579986 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-199b5097-ed30-4544-bc21-850bd419dffc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 08:26:48.579986 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:48.579986 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:48.579986 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:48.579986 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:48.579986 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:48.579986 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:48.579986 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:48.579986 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:48.579986 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:48.579986 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:48.579986 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:48.579986 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:26:48.579986 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:26:48.579986 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:26:48.579986 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:26:48.582118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:48.582118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:48.582118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:26:48.582118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:48.582118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:26:48.582118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:48.582118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:48.582118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:48.582118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:48.582118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:48.582118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:48.582118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:48.582118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:48.582118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:48.582118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:48.582118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:48.582118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:48.582118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:48.584538 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:48.584538 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:48.584538 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:26:48.584538 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:26:48.584538 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:26:48.584538 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:26:48.584538 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:26:48.584538 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:26:48.584538 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 08:26:48.584538 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:48.584538 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 399/800] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:26:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:48.584538 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d6778-f529-4dd5-b744-f6689865eab0 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:48.584538 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d6778-f529-4dd5-b744-f6689865eab0 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:48.585709 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d6778-f529-4dd5-b744-f6689865eab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:48.598126 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:48.604654 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d478d6-7e38-489d-bf31-769bfb213652 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:48.608065 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-926d6778-f529-4dd5-b744-f6689865eab0 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:48.610772 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-926d6778-f529-4dd5-b744-f6689865eab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:48.655141 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046d4fd-2938-489d-8a81-45a567d27c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:48.655978 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046d4fd-2938-489d-8a81-45a567d27c3e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:48.656375 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046d4fd-2938-489d-8a81-45a567d27c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:48.656794 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046d4fd-2938-489d-8a81-45a567d27c3e None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:48.657606 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046d4fd-2938-489d-8a81-45a567d27c3e None admin] RBAC: Adding query filter params (type=network) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:48.658005 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046d4fd-2938-489d-8a81-45a567d27c3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:48.659712 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046d4fd-2938-489d-8a81-45a567d27c3e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:48.666209 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 402/801] 10.222.0.26 () {56 vars in 1112 bytes} [Sun Sep 11 08:26:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:48.668413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9aa342-0b4f-4ab9-8a6a-22c9be26698b None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:48.668896 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9aa342-0b4f-4ab9-8a6a-22c9be26698b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:48.669378 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9aa342-0b4f-4ab9-8a6a-22c9be26698b None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:48.676320 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 403/802] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:48.676320 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9aa342-0b4f-4ab9-8a6a-22c9be26698b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:48.704767 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 400/803] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:26:48.705647 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d6778-f529-4dd5-b744-f6689865eab0 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:48.746317 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:48.808007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9aa342-0b4f-4ab9-8a6a-22c9be26698b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:48.871092 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ceaadf-cd40-487f-ae32-700ff267dbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:48.871991 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ceaadf-cd40-487f-ae32-700ff267dbf9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:48.872450 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ceaadf-cd40-487f-ae32-700ff267dbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:48.872897 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ceaadf-cd40-487f-ae32-700ff267dbf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:48.896757 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d6778-f529-4dd5-b744-f6689865eab0 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:48.928204 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:48.952861 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae316c48-a841-416c-a171-f0125be56790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:48.954087 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae316c48-a841-416c-a171-f0125be56790 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:48.954500 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae316c48-a841-416c-a171-f0125be56790 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:48.954950 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae316c48-a841-416c-a171-f0125be56790 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:48.956220 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae316c48-a841-416c-a171-f0125be56790 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:48.956726 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae316c48-a841-416c-a171-f0125be56790 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:48.959678 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae316c48-a841-416c-a171-f0125be56790 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:48.989352 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 401/804] 10.222.0.26 () {56 vars in 1135 bytes} [Sun Sep 11 08:26:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:48.990785 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae316c48-a841-416c-a171-f0125be56790 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:49.011153 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ceaadf-cd40-487f-ae32-700ff267dbf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:49.013918 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ceaadf-cd40-487f-ae32-700ff267dbf9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:49.097482 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:49.124841 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae316c48-a841-416c-a171-f0125be56790 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:49.182767 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e17df-7854-437e-af26-165400c9725e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:49.183911 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e17df-7854-437e-af26-165400c9725e None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:49.184408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e17df-7854-437e-af26-165400c9725e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:49.184900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e17df-7854-437e-af26-165400c9725e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:49.186204 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e17df-7854-437e-af26-165400c9725e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:49.188999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e17df-7854-437e-af26-165400c9725e None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:49.276789 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 404/805] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:26:48 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 08:26:49.278091 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e4dbf-a18b-4427-b978-c70b83aaecb9 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:49.278373 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e4dbf-a18b-4427-b978-c70b83aaecb9 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:49.278646 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e4dbf-a18b-4427-b978-c70b83aaecb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:49.292179 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 402/806] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:26:48 2022] POST /identity/v3/endpoints => generated 337 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:26:49.293260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e17df-7854-437e-af26-165400c9725e None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:49.308348 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-111e4dbf-a18b-4427-b978-c70b83aaecb9 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:49.310262 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-111e4dbf-a18b-4427-b978-c70b83aaecb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:49.394689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:49.417888 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 405/807] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:49 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:26:49.419585 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e4dbf-a18b-4427-b978-c70b83aaecb9 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:49.448657 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e17df-7854-437e-af26-165400c9725e None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:49.511662 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43dd4ea-e420-4de9-a018-5acd660cff4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:49.513388 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43dd4ea-e420-4de9-a018-5acd660cff4c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:49.514013 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43dd4ea-e420-4de9-a018-5acd660cff4c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:49.514487 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43dd4ea-e420-4de9-a018-5acd660cff4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:49.528723 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:49.535829 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43dd4ea-e420-4de9-a018-5acd660cff4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:49.538925 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43dd4ea-e420-4de9-a018-5acd660cff4c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:49.560738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-e43dd4ea-e420-4de9-a018-5acd660cff4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:49.560738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:49.560738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:49.560738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:49.560738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:49.560738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:49.560738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:49.560738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:49.560738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:49.560738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:49.560738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:49.560738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:49.560738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:49.560738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:49.560738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:49.560738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:49.562211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:49.562211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:49.562211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:49.562211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:49.562211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:49.562211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:49.562211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:49.562211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:49.562211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:49.562211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:49.562211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:49.562211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:49.562211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:49.562211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:49.562211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:49.562211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:49.562211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:49.563178 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:49.563178 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:49.563178 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:49.567388 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 403/808] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:49.571995 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43dd4ea-e420-4de9-a018-5acd660cff4c None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:49.646200 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e4dbf-a18b-4427-b978-c70b83aaecb9 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:49.708066 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c7b3f-95de-47d9-817e-5d7c8a9600fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:49.708742 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c7b3f-95de-47d9-817e-5d7c8a9600fc None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:49.709019 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c7b3f-95de-47d9-817e-5d7c8a9600fc None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:49.709286 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c7b3f-95de-47d9-817e-5d7c8a9600fc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:49.709929 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c7b3f-95de-47d9-817e-5d7c8a9600fc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:49.711451 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c7b3f-95de-47d9-817e-5d7c8a9600fc None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:49.721529 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-cf0c7b3f-95de-47d9-817e-5d7c8a9600fc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 08:26:49.721529 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:49.721529 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 08:26:49.721529 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 08:26:49.721529 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 08:26:49.721529 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 08:26:49.721529 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 08:26:49.721529 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:26:49.721529 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 08:26:49.721529 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:49.721529 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 08:26:49.721529 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:49.721529 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:49.721529 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:49.721529 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:49.721529 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:49.721529 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:49.722602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:49.722602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:49.722602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:49.722602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:49.722602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:49.722602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:49.722602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 08:26:49.722602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 08:26:49.722602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 08:26:49.722602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 08:26:49.722602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:49.722602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:49.722602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:49.722602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:49.722602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:49.722602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:49.723816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:49.723816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:49.723816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:49.723816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:49.723816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:49.723816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:49.723816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:49.723816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:49.723816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:49.723816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:49.723816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 08:26:49.723816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:26:49.723816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 08:26:49.723816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:49.723816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 406/809] 10.222.0.26 () {56 vars in 1129 bytes} [Sun Sep 11 08:26:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:49.728876 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c7b3f-95de-47d9-817e-5d7c8a9600fc None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:49.774677 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43dd4ea-e420-4de9-a018-5acd660cff4c None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:49.791355 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:49.835036 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078d6a5-6689-4258-99cd-0830ba55d577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:49.836146 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078d6a5-6689-4258-99cd-0830ba55d577 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:49.836638 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078d6a5-6689-4258-99cd-0830ba55d577 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:49.837134 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078d6a5-6689-4258-99cd-0830ba55d577 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:49.850717 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c7b3f-95de-47d9-817e-5d7c8a9600fc None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:49.851929 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2078d6a5-6689-4258-99cd-0830ba55d577 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:49.853946 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2078d6a5-6689-4258-99cd-0830ba55d577 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:49.872550 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-2078d6a5-6689-4258-99cd-0830ba55d577 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:49.872550 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:49.872550 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:49.872550 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:49.872550 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:49.872550 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:49.872550 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:49.872550 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:49.872550 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:49.872550 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:49.872550 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:49.872550 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:49.872550 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:49.872550 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:49.872550 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:49.872550 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:49.874670 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:49.874670 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:49.874670 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:49.874670 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:49.874670 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:49.874670 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:49.874670 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:49.874670 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:49.874670 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:49.874670 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:49.874670 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:49.874670 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:49.874670 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:49.874670 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:49.874670 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:49.874670 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:49.874670 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:49.876687 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:49.876687 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:49.876687 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:49.876687 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 404/810] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:49.876687 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078d6a5-6689-4258-99cd-0830ba55d577 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:49.894276 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b338f-62ed-400c-a39a-8309289101fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:49.894892 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b338f-62ed-400c-a39a-8309289101fa None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:49.895215 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b338f-62ed-400c-a39a-8309289101fa None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:49.895523 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b338f-62ed-400c-a39a-8309289101fa None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:49.896184 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b338f-62ed-400c-a39a-8309289101fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:49.896550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b338f-62ed-400c-a39a-8309289101fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:49.897990 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b338f-62ed-400c-a39a-8309289101fa None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:49.910530 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 407/811] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:49.911482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b338f-62ed-400c-a39a-8309289101fa None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:49.942274 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:50.025871 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078d6a5-6689-4258-99cd-0830ba55d577 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:50.033991 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b338f-62ed-400c-a39a-8309289101fa None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:50.049456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:50.073804 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e111a0e-8a66-42c4-83d5-e9bb1c0285d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:50.074883 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e111a0e-8a66-42c4-83d5-e9bb1c0285d1 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:50.075345 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e111a0e-8a66-42c4-83d5-e9bb1c0285d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:50.075788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e111a0e-8a66-42c4-83d5-e9bb1c0285d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:50.089888 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3aedb0-42ce-401d-a484-6565f3f047b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:50.090751 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3aedb0-42ce-401d-a484-6565f3f047b4 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:50.091194 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3aedb0-42ce-401d-a484-6565f3f047b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:50.091660 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3aedb0-42ce-401d-a484-6565f3f047b4 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:50.092706 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3aedb0-42ce-401d-a484-6565f3f047b4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:50.093197 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3aedb0-42ce-401d-a484-6565f3f047b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:50.095411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e111a0e-8a66-42c4-83d5-e9bb1c0285d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:26:50.095538 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3aedb0-42ce-401d-a484-6565f3f047b4 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:50.110130 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 405/812] 10.222.0.26 () {56 vars in 1124 bytes} [Sun Sep 11 08:26:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:50.110397 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-8e111a0e-8a66-42c4-83d5-e9bb1c0285d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:50.110397 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:50.110397 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:50.110397 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:50.110397 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:50.110397 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:50.110397 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:50.110397 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:50.110397 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:50.110397 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:50.110397 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:50.110397 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:50.110397 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:26:50.110397 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:26:50.110397 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:26:50.110397 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:26:50.112386 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:26:50.112386 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:26:50.112386 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:26:50.112386 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:26:50.112386 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:50.112386 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:50.112386 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:50.112386 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:50.112386 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:50.112386 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:50.112386 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:50.112386 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:50.112386 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:50.112386 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:50.112386 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:50.112386 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:50.114738 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:50.114738 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:50.114738 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:50.114738 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:50.114738 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:26:50.114738 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:26:50.114738 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:26:50.114738 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:26:50.114738 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:26:50.114738 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:26:50.114738 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:50.114738 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:50.122551 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3aedb0-42ce-401d-a484-6565f3f047b4 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:50.122688 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 408/813] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Sep 11 08:26:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:50.122688 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e111a0e-8a66-42c4-83d5-e9bb1c0285d1 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:50.240383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e111a0e-8a66-42c4-83d5-e9bb1c0285d1 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:50.269160 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3aedb0-42ce-401d-a484-6565f3f047b4 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:50.278830 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01197cb-aa8a-48ce-833b-1782cd4845d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:50.279505 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01197cb-aa8a-48ce-833b-1782cd4845d7 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:50.279783 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01197cb-aa8a-48ce-833b-1782cd4845d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:50.280048 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01197cb-aa8a-48ce-833b-1782cd4845d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:50.281567 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:50.287686 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01197cb-aa8a-48ce-833b-1782cd4845d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:50.289791 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01197cb-aa8a-48ce-833b-1782cd4845d7 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:50.304346 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-f01197cb-aa8a-48ce-833b-1782cd4845d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:50.304346 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:50.304346 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:50.304346 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:50.304346 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:50.304346 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:50.304346 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:50.304346 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:50.304346 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:50.304346 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:50.304346 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:50.304346 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:50.304346 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:26:50.304346 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:26:50.304346 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:26:50.306375 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:26:50.306375 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:50.306375 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:50.306375 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:50.306375 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:50.306375 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:50.306375 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:50.306375 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:50.306375 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:50.306375 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:50.306375 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:50.306375 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:50.306375 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:50.306375 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:50.306375 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:50.306375 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:50.306375 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:50.308602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:26:50.308602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:26:50.308602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:26:50.308602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:26:50.308602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:26:50.308602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:26:50.308602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:50.308602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:50.308602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 409/814] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:26:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:50.308602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01197cb-aa8a-48ce-833b-1782cd4845d7 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:50.321424 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757ba00-7c98-4608-8c62-54ac36407115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:50.322204 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757ba00-7c98-4608-8c62-54ac36407115 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:50.322647 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757ba00-7c98-4608-8c62-54ac36407115 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:50.323043 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757ba00-7c98-4608-8c62-54ac36407115 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:50.323929 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757ba00-7c98-4608-8c62-54ac36407115 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:50.324271 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757ba00-7c98-4608-8c62-54ac36407115 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:50.325787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757ba00-7c98-4608-8c62-54ac36407115 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:50.340074 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 406/815] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:50.340919 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757ba00-7c98-4608-8c62-54ac36407115 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:50.365767 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:50.465178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01197cb-aa8a-48ce-833b-1782cd4845d7 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:50.506446 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757ba00-7c98-4608-8c62-54ac36407115 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:50.509701 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75e410-d2b0-474a-80fc-ed8b593c9e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:50.510335 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75e410-d2b0-474a-80fc-ed8b593c9e9d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:50.510613 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75e410-d2b0-474a-80fc-ed8b593c9e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:50.510882 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75e410-d2b0-474a-80fc-ed8b593c9e9d None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:50.511578 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75e410-d2b0-474a-80fc-ed8b593c9e9d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:50.511884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75e410-d2b0-474a-80fc-ed8b593c9e9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:50.513312 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75e410-d2b0-474a-80fc-ed8b593c9e9d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:50.519205 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 410/816] 10.222.0.26 () {56 vars in 1124 bytes} [Sun Sep 11 08:26:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:50.520666 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75e410-d2b0-474a-80fc-ed8b593c9e9d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:50.549672 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9b42a-16e4-41c1-8690-db2f7cf4d8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:50.550276 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9b42a-16e4-41c1-8690-db2f7cf4d8de None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:50.550554 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9b42a-16e4-41c1-8690-db2f7cf4d8de None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:50.550825 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9b42a-16e4-41c1-8690-db2f7cf4d8de None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:50.552026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9b42a-16e4-41c1-8690-db2f7cf4d8de None admin] RBAC: Adding query filter params (name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:50.552328 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9b42a-16e4-41c1-8690-db2f7cf4d8de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:50.553676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9b42a-16e4-41c1-8690-db2f7cf4d8de None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:50.561510 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 407/817] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Sep 11 08:26:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:50.562305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9b42a-16e4-41c1-8690-db2f7cf4d8de None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:50.594881 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:50.633507 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:50.641991 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75e410-d2b0-474a-80fc-ed8b593c9e9d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:50.690344 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed692361-9b87-48c3-b0c9-15c4a58fd6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:50.691358 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed692361-9b87-48c3-b0c9-15c4a58fd6e7 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:50.691358 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed692361-9b87-48c3-b0c9-15c4a58fd6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:50.691675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed692361-9b87-48c3-b0c9-15c4a58fd6e7 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:50.693055 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed692361-9b87-48c3-b0c9-15c4a58fd6e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:50.693370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed692361-9b87-48c3-b0c9-15c4a58fd6e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:50.694912 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed692361-9b87-48c3-b0c9-15c4a58fd6e7 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:50.705014 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9b42a-16e4-41c1-8690-db2f7cf4d8de None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:50.710122 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 411/818] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:26:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:50.711017 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed692361-9b87-48c3-b0c9-15c4a58fd6e7 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:50.750761 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0f79d-c8be-461f-877e-7eeedae13193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:50.751463 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0f79d-c8be-461f-877e-7eeedae13193 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:50.751749 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0f79d-c8be-461f-877e-7eeedae13193 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:50.752031 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0f79d-c8be-461f-877e-7eeedae13193 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:50.760667 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0f79d-c8be-461f-877e-7eeedae13193 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:50.762173 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0f79d-c8be-461f-877e-7eeedae13193 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:50.776264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-d6c0f79d-c8be-461f-877e-7eeedae13193 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:50.776264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:50.776264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:50.776264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:50.776264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:50.776264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:50.776264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:50.776264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:50.776264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:50.776264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:50.776264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:50.776264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:50.776264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:26:50.776264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:26:50.776264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:26:50.777549 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:26:50.777549 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:50.777549 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:50.777549 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:50.777549 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:50.777549 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:50.777549 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:50.777549 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:50.777549 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:50.777549 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:50.777549 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:50.777549 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:50.777549 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:50.777549 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:50.777549 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:50.777549 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:50.777549 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:50.779321 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:26:50.779321 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:26:50.779321 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:26:50.779321 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:26:50.779321 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:26:50.779321 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:26:50.779321 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:50.779321 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:50.779321 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 408/819] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:26:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:50.779321 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0f79d-c8be-461f-877e-7eeedae13193 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:50.861206 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed692361-9b87-48c3-b0c9-15c4a58fd6e7 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:50.899618 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20a0f1-1c6e-4294-a29f-a63db164526d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:50.900316 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20a0f1-1c6e-4294-a29f-a63db164526d None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:50.900760 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20a0f1-1c6e-4294-a29f-a63db164526d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:50.901203 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20a0f1-1c6e-4294-a29f-a63db164526d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:50.902328 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20a0f1-1c6e-4294-a29f-a63db164526d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:50.904788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20a0f1-1c6e-4294-a29f-a63db164526d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:50.910470 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:50.925129 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0f79d-c8be-461f-877e-7eeedae13193 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:50.963702 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e385df2-d298-4d05-b7c2-1cbc220c0d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:50.964480 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e385df2-d298-4d05-b7c2-1cbc220c0d87 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:50.964846 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e385df2-d298-4d05-b7c2-1cbc220c0d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:50.965221 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e385df2-d298-4d05-b7c2-1cbc220c0d87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:50.977630 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e385df2-d298-4d05-b7c2-1cbc220c0d87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:50.979174 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e385df2-d298-4d05-b7c2-1cbc220c0d87 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:50.995417 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-2e385df2-d298-4d05-b7c2-1cbc220c0d87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:50.995417 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:50.995417 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:50.995417 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:50.995417 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:50.995417 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:50.995417 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:50.995417 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:50.995417 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:50.995417 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:50.995417 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:50.995417 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:50.995417 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:50.995417 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:50.995417 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:50.995417 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:50.997242 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:50.997242 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:50.997242 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:50.997242 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:50.997242 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:50.997242 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:50.997242 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:50.997242 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:50.997242 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:50.997242 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:50.997242 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:50.997242 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:50.997242 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:50.997242 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:50.997242 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:50.997242 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:50.997242 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:50.998490 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:50.998490 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:50.998490 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:50.998490 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 409/820] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:50.998490 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e385df2-d298-4d05-b7c2-1cbc220c0d87 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:51.015586 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 412/821] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:26:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:26:51.016350 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20a0f1-1c6e-4294-a29f-a63db164526d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:51.034997 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:51.168099 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e385df2-d298-4d05-b7c2-1cbc220c0d87 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:51.189049 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20a0f1-1c6e-4294-a29f-a63db164526d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:51.228476 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52da58a-5b39-4bcf-8b84-a2987a03f816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:51.229890 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52da58a-5b39-4bcf-8b84-a2987a03f816 None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:51.230417 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52da58a-5b39-4bcf-8b84-a2987a03f816 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:51.230888 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52da58a-5b39-4bcf-8b84-a2987a03f816 None admin] PATH_INFO: `/v3/projects/b6ed5f989f4248d7bab2548eb350fe17/users/d1a4f25df9724d34afdd6a41e719546a/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:51.234185 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52da58a-5b39-4bcf-8b84-a2987a03f816 None admin] RBAC: Authorizing `identity:create_grant(project_id=b6ed5f989f4248d7bab2548eb350fe17, user_id=d1a4f25df9724d34afdd6a41e719546a, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:51.236600 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52da58a-5b39-4bcf-8b84-a2987a03f816 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:51.246556 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b3166-b0d7-48dc-8c10-26295c2ab82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:51.247184 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b3166-b0d7-48dc-8c10-26295c2ab82e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:51.247495 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b3166-b0d7-48dc-8c10-26295c2ab82e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:51.247769 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b3166-b0d7-48dc-8c10-26295c2ab82e None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:51.248549 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b3166-b0d7-48dc-8c10-26295c2ab82e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:51.248859 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b3166-b0d7-48dc-8c10-26295c2ab82e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:51.250332 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b3166-b0d7-48dc-8c10-26295c2ab82e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:51.263316 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 413/822] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:26:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:51.264295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b3166-b0d7-48dc-8c10-26295c2ab82e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:51.312393 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:51.319115 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 410/823] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Sep 11 08:26:50 2022] PUT /identity/v3/projects/b6ed5f989f4248d7bab2548eb350fe17/users/d1a4f25df9724d34afdd6a41e719546a/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:26:51.321029 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52da58a-5b39-4bcf-8b84-a2987a03f816 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:51.368238 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:51.443578 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b3166-b0d7-48dc-8c10-26295c2ab82e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:51.489441 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52da58a-5b39-4bcf-8b84-a2987a03f816 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:51.528041 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f642a-806e-4fb4-8df5-03594e3f01d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:51.528673 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f642a-806e-4fb4-8df5-03594e3f01d6 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:51.529055 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f642a-806e-4fb4-8df5-03594e3f01d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:51.529224 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f642a-806e-4fb4-8df5-03594e3f01d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:51.529871 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f642a-806e-4fb4-8df5-03594e3f01d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:51.530174 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f642a-806e-4fb4-8df5-03594e3f01d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:51.533991 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f642a-806e-4fb4-8df5-03594e3f01d6 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:51.545546 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7d938-9dc7-4cee-ba53-8074bcbecbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:51.546240 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7d938-9dc7-4cee-ba53-8074bcbecbe3 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:51.546529 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7d938-9dc7-4cee-ba53-8074bcbecbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:51.546805 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7d938-9dc7-4cee-ba53-8074bcbecbe3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:51.547633 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7d938-9dc7-4cee-ba53-8074bcbecbe3 None admin] RBAC: Adding query filter params (role.id=d12af9f1dfb344cd8a6a493e165030ba, scope.project.id=b6ed5f989f4248d7bab2548eb350fe17, user.id=e62bb9d2e13649b5af239bb56001ce16) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:51.547955 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7d938-9dc7-4cee-ba53-8074bcbecbe3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:51.549436 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7d938-9dc7-4cee-ba53-8074bcbecbe3 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:51.557924 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 411/824] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:26:51 2022] GET /identity/v3/role_assignments?user.id=e62bb9d2e13649b5af239bb56001ce16&scope.project.id=b6ed5f989f4248d7bab2548eb350fe17&role.id=d12af9f1dfb344cd8a6a493e165030ba => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:51.572265 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 414/825] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:51.573710 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7d938-9dc7-4cee-ba53-8074bcbecbe3 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:51.682152 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:51.764188 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7d938-9dc7-4cee-ba53-8074bcbecbe3 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:51.831210 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1520d4-1209-4d2b-a5d4-584f57983438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:51.831856 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1520d4-1209-4d2b-a5d4-584f57983438 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:51.832137 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1520d4-1209-4d2b-a5d4-584f57983438 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:51.833207 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1520d4-1209-4d2b-a5d4-584f57983438 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:51.842246 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1520d4-1209-4d2b-a5d4-584f57983438 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:51.843773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1520d4-1209-4d2b-a5d4-584f57983438 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:51.857402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-5e1520d4-1209-4d2b-a5d4-584f57983438 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 08:26:51.857402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:51.857402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:51.857402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:51.857402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:51.857402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:51.857402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:51.857402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:51.857402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:51.857402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:51.857402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:51.857402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:51.857402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:26:51.857402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:26:51.857402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:26:51.857402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:26:51.859568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:51.859568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:51.859568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:26:51.859568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:51.859568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:26:51.859568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:51.859568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:51.859568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:51.859568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:51.859568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:51.859568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:51.859568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:51.859568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:51.859568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:51.859568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:51.859568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:51.859568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:51.859568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:51.861867 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:51.861867 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:51.861867 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:26:51.861867 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:26:51.861867 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:26:51.861867 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:26:51.861867 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:26:51.861867 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:26:51.861867 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 08:26:51.861867 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:51.861867 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 412/826] 10.222.0.26 () {56 vars in 1117 bytes} [Sun Sep 11 08:26:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:26:51.870758 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f642a-806e-4fb4-8df5-03594e3f01d6 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:52.080178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f642a-806e-4fb4-8df5-03594e3f01d6 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:52.127803 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:52.137458 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0bc1d2-1559-4698-ac95-9287f77364d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:52.138090 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bc1d2-1559-4698-ac95-9287f77364d0 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:52.138369 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bc1d2-1559-4698-ac95-9287f77364d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:52.138639 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bc1d2-1559-4698-ac95-9287f77364d0 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:52.139481 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0bc1d2-1559-4698-ac95-9287f77364d0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:52.140015 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0bc1d2-1559-4698-ac95-9287f77364d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:52.142267 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0bc1d2-1559-4698-ac95-9287f77364d0 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:52.162448 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 415/827] 10.222.0.26 () {56 vars in 1149 bytes} [Sun Sep 11 08:26:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:26:52.173664 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1520d4-1209-4d2b-a5d4-584f57983438 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:52.360493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1520d4-1209-4d2b-a5d4-584f57983438 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:52.406736 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:52.427366 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2daeb39-18fe-428c-a79c-30d8b1233842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:52.428942 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2daeb39-18fe-428c-a79c-30d8b1233842 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:52.429695 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2daeb39-18fe-428c-a79c-30d8b1233842 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:52.430465 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2daeb39-18fe-428c-a79c-30d8b1233842 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:52.610725 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2daeb39-18fe-428c-a79c-30d8b1233842 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:52.614072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2daeb39-18fe-428c-a79c-30d8b1233842 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:52.641720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-e2daeb39-18fe-428c-a79c-30d8b1233842 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:52.641720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:52.641720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:52.641720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:52.641720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:52.641720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:52.641720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:52.641720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:52.641720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:52.641720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:52.641720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:52.641720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:52.641720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:52.641720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:52.641720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:52.641720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:52.643612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:52.643612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:52.643612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:52.643612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:52.643612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:52.643612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:52.643612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:52.643612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:52.643612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:52.643612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:52.643612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:52.643612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:52.643612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:52.643612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:52.643612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:52.643612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:52.643612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:52.645967 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:52.645967 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:52.645967 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:52.649673 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 413/828] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 477 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:26:52.659024 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0bc1d2-1559-4698-ac95-9287f77364d0 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:52.843282 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0bc1d2-1559-4698-ac95-9287f77364d0 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:52.904022 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf1881-cf49-4bf2-823d-8fc01d0ef726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:52.904998 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf1881-cf49-4bf2-823d-8fc01d0ef726 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:52.904998 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf1881-cf49-4bf2-823d-8fc01d0ef726 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:52.905473 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf1881-cf49-4bf2-823d-8fc01d0ef726 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:52.906235 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf1881-cf49-4bf2-823d-8fc01d0ef726 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:52.906590 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf1881-cf49-4bf2-823d-8fc01d0ef726 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:52.908202 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf1881-cf49-4bf2-823d-8fc01d0ef726 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:52.926900 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 416/829] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:26:52.935571 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2daeb39-18fe-428c-a79c-30d8b1233842 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:53.071139 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2daeb39-18fe-428c-a79c-30d8b1233842 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:53.118846 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addd0de-5d87-42b8-89c4-5952829a30dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:53.119968 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addd0de-5d87-42b8-89c4-5952829a30dc None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:53.120454 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addd0de-5d87-42b8-89c4-5952829a30dc None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:53.163285 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addd0de-5d87-42b8-89c4-5952829a30dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:53.163285 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addd0de-5d87-42b8-89c4-5952829a30dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:53.163285 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addd0de-5d87-42b8-89c4-5952829a30dc None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:53.163285 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-8addd0de-5d87-42b8-89c4-5952829a30dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:53.163285 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:53.163285 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:53.163285 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:53.163285 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:53.163285 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:53.163285 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:53.164491 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:53.164491 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:53.164491 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:53.164491 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:53.164491 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:53.164491 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:26:53.164491 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:26:53.164491 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:26:53.164491 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:26:53.164491 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:53.164491 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:53.164491 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:53.164491 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:53.164491 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:53.164491 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:53.164491 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:53.164491 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:53.166092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:53.166092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:53.166092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:53.166092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:53.166092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:53.166092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:53.166092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:53.166092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:53.166092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:26:53.166092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:26:53.166092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:26:53.166092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:26:53.166092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:26:53.166092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:26:53.166092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:53.166092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:53.167653 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 414/830] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:26:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:53.177324 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf1881-cf49-4bf2-823d-8fc01d0ef726 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:53.263461 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:53.374951 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf1881-cf49-4bf2-823d-8fc01d0ef726 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:53.444425 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c404cd-be73-4ca3-8132-748e572bdc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:53.445312 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c404cd-be73-4ca3-8132-748e572bdc10 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:53.445763 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c404cd-be73-4ca3-8132-748e572bdc10 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:53.446209 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c404cd-be73-4ca3-8132-748e572bdc10 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:53.447556 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c404cd-be73-4ca3-8132-748e572bdc10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:53.448077 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c404cd-be73-4ca3-8132-748e572bdc10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:53.450687 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c404cd-be73-4ca3-8132-748e572bdc10 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:53.474864 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 417/831] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:26:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:53.483989 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addd0de-5d87-42b8-89c4-5952829a30dc None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:53.550544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:53.626857 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addd0de-5d87-42b8-89c4-5952829a30dc None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:53.665589 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721c629-201b-4797-9ada-ba711de079eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:53.666269 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721c629-201b-4797-9ada-ba711de079eb None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:53.666581 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721c629-201b-4797-9ada-ba711de079eb None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:53.666850 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721c629-201b-4797-9ada-ba711de079eb None admin] PATH_INFO: `/v3/projects/b6ed5f989f4248d7bab2548eb350fe17/users/84fcccb19a5e43ac9da5d7ca501563e4/roles/b936dc45662c4ac195fdbf9e8ac589b0` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:53.694546 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721c629-201b-4797-9ada-ba711de079eb None admin] RBAC: Authorizing `identity:create_grant(project_id=b6ed5f989f4248d7bab2548eb350fe17, user_id=84fcccb19a5e43ac9da5d7ca501563e4, role_id=b936dc45662c4ac195fdbf9e8ac589b0)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:53.695988 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721c629-201b-4797-9ada-ba711de079eb None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:53.758689 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 415/832] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Sep 11 08:26:53 2022] PUT /identity/v3/projects/b6ed5f989f4248d7bab2548eb350fe17/users/84fcccb19a5e43ac9da5d7ca501563e4/roles/b936dc45662c4ac195fdbf9e8ac589b0 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:26:54.236502 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b502c08-94d5-459d-8e77-2e04b4eff4fd None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:54.237058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b502c08-94d5-459d-8e77-2e04b4eff4fd None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:54.237436 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b502c08-94d5-459d-8e77-2e04b4eff4fd None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:54.240444 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 418/833] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:54.246237 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320bbc2-d968-4880-9c59-d7819dfa39d8 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:54.246524 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320bbc2-d968-4880-9c59-d7819dfa39d8 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:54.246806 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320bbc2-d968-4880-9c59-d7819dfa39d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:54.266707 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-f320bbc2-d968-4880-9c59-d7819dfa39d8 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:54.268137 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f320bbc2-d968-4880-9c59-d7819dfa39d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:54.363395 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 416/834] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 08:26:54.443430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df05192-7b2d-43e5-9004-2da6d0d3f553 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:54.443769 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df05192-7b2d-43e5-9004-2da6d0d3f553 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:54.443984 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df05192-7b2d-43e5-9004-2da6d0d3f553 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:54.445491 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 419/835] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:54.462676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03867a-d44c-4048-a18e-015f2918bc1b None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:54.463010 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03867a-d44c-4048-a18e-015f2918bc1b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:54.463274 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03867a-d44c-4048-a18e-015f2918bc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:54.494960 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-7b03867a-d44c-4048-a18e-015f2918bc1b None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:54.496143 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7b03867a-d44c-4048-a18e-015f2918bc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:54.515656 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:54.577036 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 417/836] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:26:54.762207 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df05192-7b2d-43e5-9004-2da6d0d3f553 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:54.934352 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03867a-d44c-4048-a18e-015f2918bc1b None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:54.967275 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df05192-7b2d-43e5-9004-2da6d0d3f553 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:54.982781 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:55.032384 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04625a8b-7bd2-41d1-9bf2-5e59f5971fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:55.033575 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04625a8b-7bd2-41d1-9bf2-5e59f5971fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:55.034065 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04625a8b-7bd2-41d1-9bf2-5e59f5971fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:55.034539 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04625a8b-7bd2-41d1-9bf2-5e59f5971fb0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:55.048826 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04625a8b-7bd2-41d1-9bf2-5e59f5971fb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:26:55.049770 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03867a-d44c-4048-a18e-015f2918bc1b None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:55.062492 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-04625a8b-7bd2-41d1-9bf2-5e59f5971fb0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:26:55.062492 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:55.062492 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:55.062492 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:55.062492 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:55.062492 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:55.062492 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:55.062492 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:55.062492 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:55.062492 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:55.062492 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:55.062492 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:55.062492 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:26:55.062492 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:26:55.062492 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:26:55.062492 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:26:55.063987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:26:55.063987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:26:55.063987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:26:55.063987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:26:55.063987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:55.063987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:55.063987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:55.063987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:55.063987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:55.063987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:55.063987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:55.063987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:55.063987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:55.063987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:55.063987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:55.063987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:55.065418 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:55.065418 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:55.065418 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:55.065418 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:55.065418 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:26:55.065418 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:26:55.065418 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:26:55.065418 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:26:55.065418 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:26:55.065418 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:26:55.065418 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:26:55.065418 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:55.065418 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 420/837] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:26:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:55.067766 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137cfaa-6900-4b0a-a2d0-48e5e1bd776c None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:55.067766 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137cfaa-6900-4b0a-a2d0-48e5e1bd776c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:55.067766 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137cfaa-6900-4b0a-a2d0-48e5e1bd776c None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:55.073927 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 421/838] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:55.073927 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137cfaa-6900-4b0a-a2d0-48e5e1bd776c None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:55.094675 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75cbe23-ad9c-454e-ae48-0b69da0fd99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:55.095480 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cbe23-ad9c-454e-ae48-0b69da0fd99c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:55.095741 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cbe23-ad9c-454e-ae48-0b69da0fd99c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:55.096034 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cbe23-ad9c-454e-ae48-0b69da0fd99c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:55.096634 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75cbe23-ad9c-454e-ae48-0b69da0fd99c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:55.098045 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75cbe23-ad9c-454e-ae48-0b69da0fd99c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:55.108363 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-d75cbe23-ad9c-454e-ae48-0b69da0fd99c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 08:26:55.108363 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:55.108363 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 08:26:55.108363 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 08:26:55.108363 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 08:26:55.108363 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 08:26:55.108363 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 08:26:55.108363 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:26:55.108363 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 08:26:55.108363 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:55.108363 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 08:26:55.108363 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:55.108363 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:55.108363 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:55.108363 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:55.108363 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:55.108363 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:55.109584 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:55.109584 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:55.109584 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:55.109584 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:55.109584 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:55.109584 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:55.109584 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 08:26:55.109584 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 08:26:55.109584 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 08:26:55.109584 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 08:26:55.109584 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:55.109584 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:55.109584 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:55.109584 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:55.109584 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:55.109584 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:55.110731 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:55.110731 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:55.110731 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:55.110731 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:55.110731 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:55.110731 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:55.110731 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:55.110731 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:55.110731 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:55.110731 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:55.110731 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 08:26:55.110731 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:26:55.110731 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 08:26:55.110731 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:55.111645 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 418/839] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Sep 11 08:26:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:55.114157 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ce844-970e-4b22-9d17-40dc4a440e76 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:55.114670 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ce844-970e-4b22-9d17-40dc4a440e76 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:55.115441 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ce844-970e-4b22-9d17-40dc4a440e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:55.140885 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-b85ce844-970e-4b22-9d17-40dc4a440e76 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:55.142168 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b85ce844-970e-4b22-9d17-40dc4a440e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:55.145363 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:55.255037 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 419/840] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:55 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:26:55.257604 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137cfaa-6900-4b0a-a2d0-48e5e1bd776c None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:55.261125 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ce844-970e-4b22-9d17-40dc4a440e76 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:55.338943 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512ec8b-7d53-4d33-a76e-e37e0b3cd00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:55.339956 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512ec8b-7d53-4d33-a76e-e37e0b3cd00a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:55.340425 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512ec8b-7d53-4d33-a76e-e37e0b3cd00a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:55.341126 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512ec8b-7d53-4d33-a76e-e37e0b3cd00a None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:55.343319 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512ec8b-7d53-4d33-a76e-e37e0b3cd00a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:55.343319 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512ec8b-7d53-4d33-a76e-e37e0b3cd00a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:55.345710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512ec8b-7d53-4d33-a76e-e37e0b3cd00a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:55.371873 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 422/841] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:26:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:55.374195 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512ec8b-7d53-4d33-a76e-e37e0b3cd00a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:55.447743 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:55.481182 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ce844-970e-4b22-9d17-40dc4a440e76 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:55.529522 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668efe3-1ecb-4a00-9cf2-95f7c3527251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:55.530147 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668efe3-1ecb-4a00-9cf2-95f7c3527251 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:55.530426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668efe3-1ecb-4a00-9cf2-95f7c3527251 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:55.530698 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668efe3-1ecb-4a00-9cf2-95f7c3527251 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:55.531489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668efe3-1ecb-4a00-9cf2-95f7c3527251 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:55.531799 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668efe3-1ecb-4a00-9cf2-95f7c3527251 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:55.533323 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668efe3-1ecb-4a00-9cf2-95f7c3527251 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:55.537195 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512ec8b-7d53-4d33-a76e-e37e0b3cd00a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:55.544917 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 420/842] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Sep 11 08:26:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:55.545969 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668efe3-1ecb-4a00-9cf2-95f7c3527251 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:55.551268 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:55.582800 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8369a-5640-42e2-844a-e6d3d85bb820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:55.583642 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8369a-5640-42e2-844a-e6d3d85bb820 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:55.583932 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8369a-5640-42e2-844a-e6d3d85bb820 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:55.584617 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8369a-5640-42e2-844a-e6d3d85bb820 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:55.599664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8369a-5640-42e2-844a-e6d3d85bb820 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:55.601873 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8369a-5640-42e2-844a-e6d3d85bb820 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:55.623469 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-98d8369a-5640-42e2-844a-e6d3d85bb820 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:55.623469 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:55.623469 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:55.623469 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:55.623469 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:55.623469 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:55.623469 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:55.623469 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:55.623469 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:55.623469 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:55.623469 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:55.623469 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:55.623469 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:55.623469 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:55.623469 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:55.623469 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:55.624651 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:55.624651 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:55.624651 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:55.624651 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:55.624651 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:55.624651 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:55.624651 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:55.624651 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:55.624651 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:55.624651 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:55.624651 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:55.624651 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:55.624651 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:55.624651 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:55.624651 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:55.624651 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:55.624651 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:55.626354 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:55.626354 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:55.626354 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:55.626354 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 423/843] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:55.626354 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8369a-5640-42e2-844a-e6d3d85bb820 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:55.683065 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668efe3-1ecb-4a00-9cf2-95f7c3527251 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:55.727576 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592412d-8228-4505-9638-b52347c69cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:55.728420 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592412d-8228-4505-9638-b52347c69cec None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:55.728888 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592412d-8228-4505-9638-b52347c69cec None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:55.729307 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592412d-8228-4505-9638-b52347c69cec None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:55.730367 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592412d-8228-4505-9638-b52347c69cec None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:55.730847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592412d-8228-4505-9638-b52347c69cec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:55.732403 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592412d-8228-4505-9638-b52347c69cec None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:55.747282 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 421/844] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Sep 11 08:26:55 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:55.747282 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592412d-8228-4505-9638-b52347c69cec None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:55.752009 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:55.782621 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8369a-5640-42e2-844a-e6d3d85bb820 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:55.849474 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197aa62a-7276-415d-8f73-6ce4c988ef6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:55.850610 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197aa62a-7276-415d-8f73-6ce4c988ef6d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:55.851052 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197aa62a-7276-415d-8f73-6ce4c988ef6d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:55.851511 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197aa62a-7276-415d-8f73-6ce4c988ef6d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:55.852666 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197aa62a-7276-415d-8f73-6ce4c988ef6d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:55.855261 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197aa62a-7276-415d-8f73-6ce4c988ef6d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:55.868391 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-197aa62a-7276-415d-8f73-6ce4c988ef6d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 08:26:55.868391 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:55.868391 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 08:26:55.868391 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 08:26:55.868391 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 08:26:55.868391 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 08:26:55.868391 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 08:26:55.868391 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:26:55.868391 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 08:26:55.868391 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:55.868391 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 08:26:55.868391 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:55.868391 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:55.868391 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:55.868391 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:55.868391 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:55.869632 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:55.869632 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:55.869632 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:55.869632 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:55.869632 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:55.869632 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:55.869632 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:55.869632 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 08:26:55.869632 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 08:26:55.869632 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 08:26:55.869632 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 08:26:55.869632 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:55.869632 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:55.869632 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:55.869632 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:55.869632 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:55.869632 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:55.870687 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:55.870687 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:55.870687 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:55.870687 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:55.870687 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:55.870687 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:55.870687 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:55.870687 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:55.870687 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:55.870687 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:55.870687 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 08:26:55.870687 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:26:55.870687 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 08:26:55.870687 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:55.874899 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:55.876264 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 424/845] 10.222.0.26 () {56 vars in 1132 bytes} [Sun Sep 11 08:26:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:55.882552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197aa62a-7276-415d-8f73-6ce4c988ef6d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:55.946966 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592412d-8228-4505-9638-b52347c69cec None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:56.019394 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0af553-5130-49a6-a750-b99c97a91d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:56.020406 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197aa62a-7276-415d-8f73-6ce4c988ef6d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:56.021200 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0af553-5130-49a6-a750-b99c97a91d77 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:56.022395 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0af553-5130-49a6-a750-b99c97a91d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:56.023030 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0af553-5130-49a6-a750-b99c97a91d77 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:56.026996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0af553-5130-49a6-a750-b99c97a91d77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:56.027847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0af553-5130-49a6-a750-b99c97a91d77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:56.031311 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0af553-5130-49a6-a750-b99c97a91d77 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:56.054612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 422/846] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:56.061500 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0af553-5130-49a6-a750-b99c97a91d77 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:56.065233 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d2c4f2-323b-4018-af3a-65e3fcd5f3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:56.065983 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2c4f2-323b-4018-af3a-65e3fcd5f3e8 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:56.066362 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2c4f2-323b-4018-af3a-65e3fcd5f3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:56.067344 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2c4f2-323b-4018-af3a-65e3fcd5f3e8 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:56.068130 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d2c4f2-323b-4018-af3a-65e3fcd5f3e8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:56.068510 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d2c4f2-323b-4018-af3a-65e3fcd5f3e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:56.069985 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d2c4f2-323b-4018-af3a-65e3fcd5f3e8 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:56.075655 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 425/847] 10.222.0.26 () {56 vars in 1126 bytes} [Sun Sep 11 08:26:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:26:56.082168 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d2c4f2-323b-4018-af3a-65e3fcd5f3e8 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:56.099211 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:56.222198 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d2c4f2-323b-4018-af3a-65e3fcd5f3e8 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:56.268993 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0af553-5130-49a6-a750-b99c97a91d77 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:56.272789 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16bd756-3dcb-4466-84ab-931ea6ddebba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:56.273489 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bd756-3dcb-4466-84ab-931ea6ddebba None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:56.274888 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bd756-3dcb-4466-84ab-931ea6ddebba None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:56.275275 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bd756-3dcb-4466-84ab-931ea6ddebba None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:56.276034 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16bd756-3dcb-4466-84ab-931ea6ddebba None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:56.276412 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16bd756-3dcb-4466-84ab-931ea6ddebba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:56.277953 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16bd756-3dcb-4466-84ab-931ea6ddebba None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:56.284373 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 426/848] 10.222.0.26 () {56 vars in 1126 bytes} [Sun Sep 11 08:26:56 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:56.328944 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:56.343547 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061d9ed-5814-4824-a2db-c9913247ce52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:56.344504 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061d9ed-5814-4824-a2db-c9913247ce52 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:56.345011 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061d9ed-5814-4824-a2db-c9913247ce52 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:56.345453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061d9ed-5814-4824-a2db-c9913247ce52 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:56.360257 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061d9ed-5814-4824-a2db-c9913247ce52 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:56.361783 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061d9ed-5814-4824-a2db-c9913247ce52 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:56.376392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-3061d9ed-5814-4824-a2db-c9913247ce52 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 08:26:56.376392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:56.376392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:56.376392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:56.376392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:56.376392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:56.376392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:56.376392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:56.376392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:56.376392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:56.376392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:56.376392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:56.376392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:26:56.376392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:26:56.376392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:26:56.376392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:26:56.377441 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:56.377441 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:56.377441 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:26:56.377441 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:56.377441 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:26:56.377441 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:56.377441 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:56.377441 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:56.377441 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:56.377441 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:56.377441 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:56.377441 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:56.377441 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:56.377441 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:56.377441 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:56.377441 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:56.377441 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:56.377441 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:56.378401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:56.378401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:56.378401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:26:56.378401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:26:56.378401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:26:56.378401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:26:56.378401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:26:56.378401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:26:56.378401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 08:26:56.378401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:56.378401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 423/849] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:26:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:56.384709 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16bd756-3dcb-4466-84ab-931ea6ddebba None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:56.488152 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:56.522566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16bd756-3dcb-4466-84ab-931ea6ddebba None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:56.561238 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21015c9d-f4c5-4c9b-8b21-2c847654defd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:56.561854 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21015c9d-f4c5-4c9b-8b21-2c847654defd None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:56.562193 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21015c9d-f4c5-4c9b-8b21-2c847654defd None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:56.562469 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21015c9d-f4c5-4c9b-8b21-2c847654defd None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:56.563204 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21015c9d-f4c5-4c9b-8b21-2c847654defd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:56.563567 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21015c9d-f4c5-4c9b-8b21-2c847654defd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:56.565004 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21015c9d-f4c5-4c9b-8b21-2c847654defd None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:56.585449 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 427/850] 10.222.0.26 () {56 vars in 1135 bytes} [Sun Sep 11 08:26:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:26:56.591606 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061d9ed-5814-4824-a2db-c9913247ce52 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:56.724327 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061d9ed-5814-4824-a2db-c9913247ce52 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:56.740566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d56b67-60e8-40a2-9617-faf3169eb796 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:56.740816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d56b67-60e8-40a2-9617-faf3169eb796 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:56.741138 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d56b67-60e8-40a2-9617-faf3169eb796 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:56.742365 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 428/851] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:56.748401 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef1010-46d8-442b-a43d-359731109bf9 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:56.748783 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef1010-46d8-442b-a43d-359731109bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:56.748929 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef1010-46d8-442b-a43d-359731109bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:56.763944 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2bb52-a693-40dd-b75b-f6979d1ad492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:56.764630 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2bb52-a693-40dd-b75b-f6979d1ad492 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:56.765054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2bb52-a693-40dd-b75b-f6979d1ad492 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:56.765221 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2bb52-a693-40dd-b75b-f6979d1ad492 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:56.770268 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-dfef1010-46d8-442b-a43d-359731109bf9 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:56.772700 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-dfef1010-46d8-442b-a43d-359731109bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:56.838756 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:56.854192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2bb52-a693-40dd-b75b-f6979d1ad492 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:56.859531 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2bb52-a693-40dd-b75b-f6979d1ad492 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:56.927483 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 429/852] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 08:26:57.039783 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 424/853] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:26:56 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 11 08:26:57.054190 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef1010-46d8-442b-a43d-359731109bf9 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:57.140458 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:57.200311 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2bb52-a693-40dd-b75b-f6979d1ad492 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:57.200863 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef1010-46d8-442b-a43d-359731109bf9 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:57.250133 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6d27a-3c4f-436e-a626-f307d3394126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:57.251358 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6d27a-3c4f-436e-a626-f307d3394126 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:57.251930 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6d27a-3c4f-436e-a626-f307d3394126 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:57.252483 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6d27a-3c4f-436e-a626-f307d3394126 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:57.264879 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6d27a-3c4f-436e-a626-f307d3394126 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:57.266831 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6d27a-3c4f-436e-a626-f307d3394126 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:57.284105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-77b6d27a-3c4f-436e-a626-f307d3394126 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:57.284105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:57.284105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:57.284105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:57.284105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:57.284105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:57.284105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:57.284105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:57.284105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:57.284105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:57.284105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:57.284105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:57.284105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:57.284105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:57.284105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:57.284105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:57.286139 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:57.286139 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:57.286139 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:57.286139 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:57.286139 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:57.286139 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:57.286139 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:57.286139 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:57.286139 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:57.286139 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:57.286139 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:57.286139 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:57.286139 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:57.286139 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:57.286139 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:57.286139 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:57.286139 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:57.287034 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:57.287034 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:57.287034 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:57.289307 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 430/854] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:57.299392 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6d27a-3c4f-436e-a626-f307d3394126 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:57.338332 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:57.356502 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2bb52-a693-40dd-b75b-f6979d1ad492 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:57.424150 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5942816-638a-437d-b89a-836e8312bb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:57.425673 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5942816-638a-437d-b89a-836e8312bb7f None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:57.426488 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5942816-638a-437d-b89a-836e8312bb7f None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:57.427224 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5942816-638a-437d-b89a-836e8312bb7f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:57.449545 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5942816-638a-437d-b89a-836e8312bb7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:26:57.460945 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-e5942816-638a-437d-b89a-836e8312bb7f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:57.460945 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:57.460945 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:57.460945 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:57.460945 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:57.460945 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:57.460945 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:57.460945 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:57.460945 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:57.460945 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:57.460945 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:57.460945 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:57.460945 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:26:57.460945 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:26:57.460945 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:26:57.460945 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:26:57.462817 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:26:57.462817 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:26:57.462817 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:26:57.462817 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:26:57.462817 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:57.462817 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:57.462817 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:57.462817 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:57.462817 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:57.462817 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:57.462817 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:57.462817 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:57.462817 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:57.462817 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:57.462817 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:57.462817 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:57.464356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:57.464356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:57.464356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:57.464356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:57.464356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:26:57.464356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:26:57.464356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:26:57.464356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:26:57.464356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:26:57.464356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:26:57.464356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:26:57.464356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:57.468698 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 425/855] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Sep 11 08:26:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:57.474829 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5942816-638a-437d-b89a-836e8312bb7f None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:57.487837 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6d27a-3c4f-436e-a626-f307d3394126 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:57.523483 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:57.566130 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7909f8-6206-4bdd-95bf-4942aaf85b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:57.567369 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7909f8-6206-4bdd-95bf-4942aaf85b6d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:57.567852 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7909f8-6206-4bdd-95bf-4942aaf85b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:57.568312 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7909f8-6206-4bdd-95bf-4942aaf85b6d None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:57.569848 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7909f8-6206-4bdd-95bf-4942aaf85b6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:57.570379 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7909f8-6206-4bdd-95bf-4942aaf85b6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:57.572459 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7909f8-6206-4bdd-95bf-4942aaf85b6d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:57.591197 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 431/856] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:57.600780 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7909f8-6206-4bdd-95bf-4942aaf85b6d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:57.628074 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5942816-638a-437d-b89a-836e8312bb7f None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:57.669475 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad324a7-417c-46bc-9db8-5dd8bb763229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:57.670108 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad324a7-417c-46bc-9db8-5dd8bb763229 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:57.670389 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad324a7-417c-46bc-9db8-5dd8bb763229 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:57.670661 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad324a7-417c-46bc-9db8-5dd8bb763229 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:57.672742 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad324a7-417c-46bc-9db8-5dd8bb763229 None admin] RBAC: Adding query filter params (name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:57.672742 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad324a7-417c-46bc-9db8-5dd8bb763229 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:57.673287 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad324a7-417c-46bc-9db8-5dd8bb763229 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:57.687607 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 426/857] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Sep 11 08:26:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:26:57.689184 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad324a7-417c-46bc-9db8-5dd8bb763229 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:57.704805 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:57.794411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7909f8-6206-4bdd-95bf-4942aaf85b6d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:57.805617 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad324a7-417c-46bc-9db8-5dd8bb763229 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:57.844054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cff0e1-cd5e-4ade-8e06-d04a521aaa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:57.844597 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cff0e1-cd5e-4ade-8e06-d04a521aaa3f None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:57.844873 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cff0e1-cd5e-4ade-8e06-d04a521aaa3f None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:57.845130 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cff0e1-cd5e-4ade-8e06-d04a521aaa3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:57.858074 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cff0e1-cd5e-4ade-8e06-d04a521aaa3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:57.859702 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cff0e1-cd5e-4ade-8e06-d04a521aaa3f None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:57.863733 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57f4ae-8f02-4ae3-845c-6e4d99a4576a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:57.865240 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57f4ae-8f02-4ae3-845c-6e4d99a4576a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:57.866027 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57f4ae-8f02-4ae3-845c-6e4d99a4576a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:57.866803 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57f4ae-8f02-4ae3-845c-6e4d99a4576a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:57.876796 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-43cff0e1-cd5e-4ade-8e06-d04a521aaa3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:57.876796 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:57.876796 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:57.876796 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:57.876796 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:57.876796 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:57.876796 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:57.876796 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:57.876796 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:57.876796 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:57.876796 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:57.876796 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:57.876796 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:57.876796 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:57.876796 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:57.876796 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:57.878654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:57.878654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:57.878654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:57.878654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:57.878654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:57.878654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:57.878654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:57.878654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:57.878654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:57.878654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:57.878654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:57.878654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:57.878654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:57.878654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:57.878654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:57.878654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:57.878654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:57.881011 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:57.881011 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:57.881011 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:57.883334 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 427/858] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:26:57.884476 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cff0e1-cd5e-4ade-8e06-d04a521aaa3f None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:57.886509 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57f4ae-8f02-4ae3-845c-6e4d99a4576a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:57.889604 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57f4ae-8f02-4ae3-845c-6e4d99a4576a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:57.913931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-4e57f4ae-8f02-4ae3-845c-6e4d99a4576a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:57.913931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:57.913931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:57.913931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:57.913931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:57.913931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:57.913931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:57.913931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:57.913931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:57.913931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:57.913931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:57.913931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:57.913931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:26:57.913931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:26:57.913931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:26:57.915722 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:26:57.915722 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:57.915722 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:57.915722 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:57.915722 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:57.915722 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:57.915722 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:57.915722 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:57.915722 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:57.915722 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:57.915722 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:57.915722 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:57.915722 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:57.915722 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:57.915722 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:57.915722 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:57.915722 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:57.917465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:26:57.917465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:26:57.917465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:26:57.917465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:26:57.917465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:26:57.917465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:26:57.917465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:57.917465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:26:57.921855 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 432/859] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:26:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:26:57.932189 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57f4ae-8f02-4ae3-845c-6e4d99a4576a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:57.984241 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:57.993821 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:58.007597 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cff0e1-cd5e-4ade-8e06-d04a521aaa3f None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:58.046872 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd75679-7693-4168-997e-ca1fd6b193d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:58.048949 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd75679-7693-4168-997e-ca1fd6b193d0 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:58.049758 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd75679-7693-4168-997e-ca1fd6b193d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:58.050193 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd75679-7693-4168-997e-ca1fd6b193d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:58.051574 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd75679-7693-4168-997e-ca1fd6b193d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:58.052040 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd75679-7693-4168-997e-ca1fd6b193d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:58.053723 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd75679-7693-4168-997e-ca1fd6b193d0 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:58.068408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 428/860] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:58.075056 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd75679-7693-4168-997e-ca1fd6b193d0 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:58.082848 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57f4ae-8f02-4ae3-845c-6e4d99a4576a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:58.131360 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c508f73-705e-49fb-a99e-bbf3c33c4667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:58.131913 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c508f73-705e-49fb-a99e-bbf3c33c4667 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:58.132191 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c508f73-705e-49fb-a99e-bbf3c33c4667 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:58.133545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c508f73-705e-49fb-a99e-bbf3c33c4667 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:58.134352 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c508f73-705e-49fb-a99e-bbf3c33c4667 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:58.134664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c508f73-705e-49fb-a99e-bbf3c33c4667 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:58.136279 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c508f73-705e-49fb-a99e-bbf3c33c4667 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:58.155146 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 433/861] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:26:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:58.163547 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c508f73-705e-49fb-a99e-bbf3c33c4667 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:58.227715 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd75679-7693-4168-997e-ca1fd6b193d0 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:58.261509 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:58.278116 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2ae3b-2a65-4346-8007-feaa5b2f8949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:58.279066 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2ae3b-2a65-4346-8007-feaa5b2f8949 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:58.279529 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2ae3b-2a65-4346-8007-feaa5b2f8949 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:58.279995 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2ae3b-2a65-4346-8007-feaa5b2f8949 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:58.290049 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c2ae3b-2a65-4346-8007-feaa5b2f8949 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:58.293290 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c2ae3b-2a65-4346-8007-feaa5b2f8949 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:58.314792 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-86c2ae3b-2a65-4346-8007-feaa5b2f8949 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 08:26:58.314792 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:58.314792 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:58.314792 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:58.314792 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:58.314792 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:58.314792 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:58.314792 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:58.314792 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:58.314792 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:58.314792 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:58.314792 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:58.314792 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:26:58.314792 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:26:58.314792 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:26:58.314792 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:26:58.316061 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:58.316061 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:58.316061 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:26:58.316061 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:58.316061 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:26:58.316061 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:26:58.316061 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:58.316061 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:58.316061 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:58.316061 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:58.316061 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:58.316061 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:58.316061 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:58.316061 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:58.316061 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:58.316061 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:58.316061 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:58.316061 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:58.317653 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:58.317653 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:58.317653 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:26:58.317653 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:26:58.317653 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:26:58.317653 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:26:58.317653 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:26:58.317653 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:26:58.317653 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 08:26:58.317653 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:58.326235 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 429/862] 10.222.0.26 () {56 vars in 1117 bytes} [Sun Sep 11 08:26:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:58.328911 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2ae3b-2a65-4346-8007-feaa5b2f8949 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:58.339594 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:58.351400 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c508f73-705e-49fb-a99e-bbf3c33c4667 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:58.403672 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa240a1-4ac6-4bd9-bb27-8522b41774fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:58.404376 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa240a1-4ac6-4bd9-bb27-8522b41774fd None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:58.404753 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa240a1-4ac6-4bd9-bb27-8522b41774fd None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:58.405117 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa240a1-4ac6-4bd9-bb27-8522b41774fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:58.405967 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa240a1-4ac6-4bd9-bb27-8522b41774fd None admin] RBAC: Adding query filter params (role.id=d12af9f1dfb344cd8a6a493e165030ba, scope.project.id=b6ed5f989f4248d7bab2548eb350fe17, user.id=d1a4f25df9724d34afdd6a41e719546a) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:58.406370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa240a1-4ac6-4bd9-bb27-8522b41774fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:58.407954 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa240a1-4ac6-4bd9-bb27-8522b41774fd None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:58.423299 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 434/863] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:26:58 2022] GET /identity/v3/role_assignments?user.id=d1a4f25df9724d34afdd6a41e719546a&scope.project.id=b6ed5f989f4248d7bab2548eb350fe17&role.id=d12af9f1dfb344cd8a6a493e165030ba => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:58.492583 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2ae3b-2a65-4346-8007-feaa5b2f8949 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:58.493091 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5fda2-d045-4a2b-af8b-017d908f6b32 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:58.493583 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5fda2-d045-4a2b-af8b-017d908f6b32 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:58.494040 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5fda2-d045-4a2b-af8b-017d908f6b32 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:58.502035 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 435/864] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:58 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:26:58.510795 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a96837-deeb-4987-bb20-1668d721b29a None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:58.511722 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a96837-deeb-4987-bb20-1668d721b29a None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:58.512462 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a96837-deeb-4987-bb20-1668d721b29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:58.542247 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6b3a7-f0c3-49c8-8091-bac593bfdc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:58.542887 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6b3a7-f0c3-49c8-8091-bac593bfdc0f None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:58.543162 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6b3a7-f0c3-49c8-8091-bac593bfdc0f None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:58.543491 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6b3a7-f0c3-49c8-8091-bac593bfdc0f None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:58.543912 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-67a96837-deeb-4987-bb20-1668d721b29a None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:58.544206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6b3a7-f0c3-49c8-8091-bac593bfdc0f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:58.544670 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6b3a7-f0c3-49c8-8091-bac593bfdc0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:58.546218 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6b3a7-f0c3-49c8-8091-bac593bfdc0f None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:58.547699 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-67a96837-deeb-4987-bb20-1668d721b29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:58.576903 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 430/865] 10.222.0.26 () {56 vars in 1149 bytes} [Sun Sep 11 08:26:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:26:58.578896 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6b3a7-f0c3-49c8-8091-bac593bfdc0f None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:58.638172 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:58.707679 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 436/866] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:26:58.717702 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6b3a7-f0c3-49c8-8091-bac593bfdc0f None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:58.757636 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af995949-7663-4701-b42b-6e2ab89584d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:58.758259 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af995949-7663-4701-b42b-6e2ab89584d5 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:58.758534 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af995949-7663-4701-b42b-6e2ab89584d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:58.758809 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af995949-7663-4701-b42b-6e2ab89584d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:58.891266 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af995949-7663-4701-b42b-6e2ab89584d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:58.894156 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af995949-7663-4701-b42b-6e2ab89584d5 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:58.974434 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:59.014010 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22273583-04de-494b-8c73-a43f3473c5ee None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:59.014512 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22273583-04de-494b-8c73-a43f3473c5ee None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:59.015005 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22273583-04de-494b-8c73-a43f3473c5ee None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:59.018777 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 437/867] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:26:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:26:59.024713 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d076e1a-2887-4946-b029-dad6794406ce None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:59.024999 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d076e1a-2887-4946-b029-dad6794406ce None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:59.025280 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d076e1a-2887-4946-b029-dad6794406ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:59.044852 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-6d076e1a-2887-4946-b029-dad6794406ce None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:26:59.046093 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6d076e1a-2887-4946-b029-dad6794406ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:26:59.073880 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 431/868] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:26:58 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 08:26:59.076323 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af995949-7663-4701-b42b-6e2ab89584d5 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:59.125226 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 438/869] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:26:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:26:59.125869 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d076e1a-2887-4946-b029-dad6794406ce None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:59.157213 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:59.222938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af995949-7663-4701-b42b-6e2ab89584d5 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:59.292560 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ad4a4-9af2-40bb-9483-f61a7c792043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:59.293555 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ad4a4-9af2-40bb-9483-f61a7c792043 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:59.294071 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ad4a4-9af2-40bb-9483-f61a7c792043 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:59.294553 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ad4a4-9af2-40bb-9483-f61a7c792043 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:59.300288 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d076e1a-2887-4946-b029-dad6794406ce None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:59.312263 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:59.317061 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ad4a4-9af2-40bb-9483-f61a7c792043 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:59.320569 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ad4a4-9af2-40bb-9483-f61a7c792043 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:59.342941 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42c915-9381-4913-9273-0f091735f952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:59.344364 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42c915-9381-4913-9273-0f091735f952 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:59.345205 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42c915-9381-4913-9273-0f091735f952 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:59.345895 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42c915-9381-4913-9273-0f091735f952 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:59.347385 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb42c915-9381-4913-9273-0f091735f952 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:59.349052 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb42c915-9381-4913-9273-0f091735f952 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:59.351401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-782ad4a4-9af2-40bb-9483-f61a7c792043 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:59.351401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:59.351401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:59.351401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:59.351401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:59.351401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:59.351401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:59.351401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:59.351401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:59.351401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:59.351401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:59.351401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:59.351401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:26:59.351401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:26:59.351401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:26:59.351401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:26:59.352370 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:59.352370 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:59.352370 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:59.352370 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:59.352370 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:59.352370 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:59.352370 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:59.352370 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:59.352370 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:59.352370 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:59.352370 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:59.352370 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:59.352370 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:59.352370 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:59.352370 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:59.352370 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:59.352370 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:26:59.353283 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:26:59.353283 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:26:59.353283 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:59.360008 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 432/870] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:26:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:59.363866 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ad4a4-9af2-40bb-9483-f61a7c792043 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:59.462061 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 439/871] 10.222.0.26 () {60 vars in 1141 bytes} [Sun Sep 11 08:26:59 2022] POST /identity/v3/services => generated 251 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:26:59.462880 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42c915-9381-4913-9273-0f091735f952 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:59.512981 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ad4a4-9af2-40bb-9483-f61a7c792043 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:59.577944 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3a5a8-97a0-4239-9f3d-6ae0d96fe2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:59.578527 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3a5a8-97a0-4239-9f3d-6ae0d96fe2ce None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:59.579190 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3a5a8-97a0-4239-9f3d-6ae0d96fe2ce None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:59.579533 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3a5a8-97a0-4239-9f3d-6ae0d96fe2ce None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:59.580353 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3a5a8-97a0-4239-9f3d-6ae0d96fe2ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:26:59.580657 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3a5a8-97a0-4239-9f3d-6ae0d96fe2ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:59.582545 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3a5a8-97a0-4239-9f3d-6ae0d96fe2ce None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:59.606333 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 433/872] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:26:59.606583 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3a5a8-97a0-4239-9f3d-6ae0d96fe2ce None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:26:59.618426 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:59.668467 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42c915-9381-4913-9273-0f091735f952 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:59.704824 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:26:59.743724 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516b1e2-eb78-4dac-9acd-361a8463df5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:59.744975 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516b1e2-eb78-4dac-9acd-361a8463df5d None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:59.745646 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516b1e2-eb78-4dac-9acd-361a8463df5d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:59.746355 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516b1e2-eb78-4dac-9acd-361a8463df5d None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:59.747598 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516b1e2-eb78-4dac-9acd-361a8463df5d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:59.749938 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516b1e2-eb78-4dac-9acd-361a8463df5d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:59.785085 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3a5a8-97a0-4239-9f3d-6ae0d96fe2ce None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:26:59.830669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2119c79-783a-4b2a-a070-6c817aea4ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:26:59.831747 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2119c79-783a-4b2a-a070-6c817aea4ece None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:26:59.837101 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2119c79-783a-4b2a-a070-6c817aea4ece None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:26:59.837101 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2119c79-783a-4b2a-a070-6c817aea4ece None admin] PATH_INFO: `/v3/projects/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:26:59.837542 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 440/873] 10.222.0.26 () {60 vars in 1141 bytes} [Sun Sep 11 08:26:59 2022] POST /identity/v3/services => generated 269 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:26:59.847135 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2119c79-783a-4b2a-a070-6c817aea4ece None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:26:59.850537 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2119c79-783a-4b2a-a070-6c817aea4ece None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:26:59.872297 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-c2119c79-783a-4b2a-a070-6c817aea4ece None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:59.872297 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:26:59.872297 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:26:59.872297 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:26:59.872297 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:26:59.872297 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:26:59.872297 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:26:59.872297 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:26:59.872297 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:26:59.872297 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:26:59.872297 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:26:59.872297 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:26:59.872297 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:26:59.872297 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:26:59.872297 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:26:59.873865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:26:59.873865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:26:59.873865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:26:59.873865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:26:59.873865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:26:59.873865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:26:59.873865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:26:59.873865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:26:59.873865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:26:59.873865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:26:59.873865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:26:59.873865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:26:59.873865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:26:59.873865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:26:59.873865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:26:59.873865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:26:59.873865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:26:59.875577 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:26:59.875577 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:26:59.875577 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:26:59.875577 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:26:59.875577 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:26:59.875577 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:26:59.875577 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:26:59.875577 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:26:59.879600 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 434/874] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:26:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:26:59.889371 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516b1e2-eb78-4dac-9acd-361a8463df5d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:00.090167 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516b1e2-eb78-4dac-9acd-361a8463df5d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:00.123115 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:00.128199 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107a9b3-7c78-47b1-b841-dd86bed2bf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:00.128811 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107a9b3-7c78-47b1-b841-dd86bed2bf34 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:00.129073 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107a9b3-7c78-47b1-b841-dd86bed2bf34 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:00.129356 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107a9b3-7c78-47b1-b841-dd86bed2bf34 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:00.130067 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107a9b3-7c78-47b1-b841-dd86bed2bf34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:00.130452 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107a9b3-7c78-47b1-b841-dd86bed2bf34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:00.131950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107a9b3-7c78-47b1-b841-dd86bed2bf34 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:00.145291 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 441/875] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:26:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:00.151982 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2119c79-783a-4b2a-a070-6c817aea4ece None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:00.343991 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2119c79-783a-4b2a-a070-6c817aea4ece None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:00.362634 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:00.407691 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e8257-628e-4cb9-9f6f-7d95315627c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:00.408734 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e8257-628e-4cb9-9f6f-7d95315627c9 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:00.409228 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e8257-628e-4cb9-9f6f-7d95315627c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:00.409717 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e8257-628e-4cb9-9f6f-7d95315627c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:00.411834 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e8257-628e-4cb9-9f6f-7d95315627c9 None admin] RBAC: Adding query filter params (role.id=b936dc45662c4ac195fdbf9e8ac589b0, scope.project.id=b6ed5f989f4248d7bab2548eb350fe17, user.id=84fcccb19a5e43ac9da5d7ca501563e4) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:00.412394 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e8257-628e-4cb9-9f6f-7d95315627c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:00.415361 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e8257-628e-4cb9-9f6f-7d95315627c9 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:00.428199 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 435/876] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:27:00 2022] GET /identity/v3/role_assignments?user.id=84fcccb19a5e43ac9da5d7ca501563e4&scope.project.id=b6ed5f989f4248d7bab2548eb350fe17&role.id=b936dc45662c4ac195fdbf9e8ac589b0 => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:27:01.052486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42b1fe-4d1c-4676-9143-464ef05e90db None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:01.054035 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42b1fe-4d1c-4676-9143-464ef05e90db None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:01.054876 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42b1fe-4d1c-4676-9143-464ef05e90db None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:01.057990 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 442/877] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:27:01.067209 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3f04d-6757-41b1-90a5-08774c29e1e7 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:01.067505 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3f04d-6757-41b1-90a5-08774c29e1e7 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:01.067830 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3f04d-6757-41b1-90a5-08774c29e1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:01.087641 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-c9b3f04d-6757-41b1-90a5-08774c29e1e7 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:01.088842 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c9b3f04d-6757-41b1-90a5-08774c29e1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:01.163721 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 436/878] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:01 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 08:27:01.656517 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42b1fe-4d1c-4676-9143-464ef05e90db None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:01.851273 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42b1fe-4d1c-4676-9143-464ef05e90db None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:01.919908 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df15702-a1ed-443b-937e-f18c8bc3a754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:01.921427 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df15702-a1ed-443b-937e-f18c8bc3a754 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:01.922187 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df15702-a1ed-443b-937e-f18c8bc3a754 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:01.922932 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df15702-a1ed-443b-937e-f18c8bc3a754 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:01.924339 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df15702-a1ed-443b-937e-f18c8bc3a754 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:01.927652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df15702-a1ed-443b-937e-f18c8bc3a754 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:01.946564 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-8df15702-a1ed-443b-937e-f18c8bc3a754 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 08:27:01.946564 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:01.946564 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 08:27:01.946564 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 08:27:01.946564 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 08:27:01.946564 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 08:27:01.946564 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 08:27:01.946564 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:27:01.946564 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 08:27:01.946564 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:01.946564 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 08:27:01.946564 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:01.946564 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:01.946564 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:01.946564 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:01.946564 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:01.946564 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:01.948605 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:01.948605 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:01.948605 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:01.948605 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:01.948605 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:01.948605 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:01.948605 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 08:27:01.948605 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 08:27:01.948605 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 08:27:01.948605 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 08:27:01.948605 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:01.948605 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:01.948605 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:01.948605 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:01.948605 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:01.948605 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:01.950274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:01.950274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:01.950274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:01.950274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:01.950274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:01.950274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:01.950274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:01.950274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:01.950274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:01.950274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:01.950274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 08:27:01.950274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:27:01.950274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 08:27:01.950274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:01.955698 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 443/879] 10.222.0.26 () {56 vars in 1126 bytes} [Sun Sep 11 08:27:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:27:01.965500 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3f04d-6757-41b1-90a5-08774c29e1e7 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:02.000337 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c4216-e6a0-4bd4-b08b-85d9e6797c73 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:02.001296 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c4216-e6a0-4bd4-b08b-85d9e6797c73 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:02.002055 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c4216-e6a0-4bd4-b08b-85d9e6797c73 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:02.005803 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 444/880] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:27:02.012768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcb436-3098-4031-bb09-cf0993980c27 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:02.013388 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcb436-3098-4031-bb09-cf0993980c27 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:02.014040 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcb436-3098-4031-bb09-cf0993980c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:02.037519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-b2bcb436-3098-4031-bb09-cf0993980c27 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:02.039761 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b2bcb436-3098-4031-bb09-cf0993980c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:02.107876 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:02.115413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3f04d-6757-41b1-90a5-08774c29e1e7 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:02.118219 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:02.126997 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 445/881] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:02 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 08:27:02.163648 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce6a91-a53b-4fc0-bc57-3a57a58c57f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:02.164829 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce6a91-a53b-4fc0-bc57-3a57a58c57f0 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:02.166018 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce6a91-a53b-4fc0-bc57-3a57a58c57f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:02.166649 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce6a91-a53b-4fc0-bc57-3a57a58c57f0 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:02.167522 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce6a91-a53b-4fc0-bc57-3a57a58c57f0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:02.168049 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce6a91-a53b-4fc0-bc57-3a57a58c57f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:02.169709 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce6a91-a53b-4fc0-bc57-3a57a58c57f0 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:02.179349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 437/882] 10.222.0.26 () {56 vars in 1122 bytes} [Sun Sep 11 08:27:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:02.183723 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bcb436-3098-4031-bb09-cf0993980c27 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:02.306460 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bcb436-3098-4031-bb09-cf0993980c27 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:02.342445 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dfebdc-6134-418d-8440-2c5a33928e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:02.343066 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfebdc-6134-418d-8440-2c5a33928e29 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:02.343422 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfebdc-6134-418d-8440-2c5a33928e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:02.343718 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfebdc-6134-418d-8440-2c5a33928e29 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:02.344366 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dfebdc-6134-418d-8440-2c5a33928e29 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:02.344857 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dfebdc-6134-418d-8440-2c5a33928e29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:02.346549 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dfebdc-6134-418d-8440-2c5a33928e29 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:02.352406 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 446/883] 10.222.0.26 () {56 vars in 1122 bytes} [Sun Sep 11 08:27:02 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:02.467353 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce6a91-a53b-4fc0-bc57-3a57a58c57f0 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:02.613793 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce6a91-a53b-4fc0-bc57-3a57a58c57f0 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:02.670687 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66ae4f-093a-471d-b849-ba778635c585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:02.671062 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66ae4f-093a-471d-b849-ba778635c585 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:02.671241 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66ae4f-093a-471d-b849-ba778635c585 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:02.671557 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66ae4f-093a-471d-b849-ba778635c585 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:02.672166 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c66ae4f-093a-471d-b849-ba778635c585 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:02.674114 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c66ae4f-093a-471d-b849-ba778635c585 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:02.690620 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-8c66ae4f-093a-471d-b849-ba778635c585 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 08:27:02.690620 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:02.690620 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 08:27:02.690620 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 08:27:02.690620 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 08:27:02.690620 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 08:27:02.690620 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 08:27:02.690620 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:27:02.690620 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 08:27:02.690620 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:02.690620 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 08:27:02.690620 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:02.690620 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:02.690620 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:02.690620 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:02.690620 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:02.690620 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:02.691927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:02.691927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:02.691927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:02.691927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:02.691927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:02.691927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:02.691927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 08:27:02.691927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 08:27:02.691927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 08:27:02.691927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 08:27:02.691927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:02.691927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:02.691927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:02.691927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:02.691927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:02.691927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:02.692793 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:02.692793 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:02.692793 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:02.692793 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:02.692793 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:02.692793 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:02.692793 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:02.692793 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:02.692793 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:02.692793 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:02.692793 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 08:27:02.692793 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:27:02.692793 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 08:27:02.692793 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:02.699279 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 438/884] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Sep 11 08:27:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:27:02.700630 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dfebdc-6134-418d-8440-2c5a33928e29 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:02.793985 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:02.891594 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dfebdc-6134-418d-8440-2c5a33928e29 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:02.954963 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f90ff-ceef-46a3-9cf2-f616d0aab472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:02.956063 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f90ff-ceef-46a3-9cf2-f616d0aab472 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:02.956366 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce769a3a-12ba-4c66-b117-6eef74576e11 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:02.956567 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f90ff-ceef-46a3-9cf2-f616d0aab472 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:02.957608 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce769a3a-12ba-4c66-b117-6eef74576e11 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:02.957721 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f90ff-ceef-46a3-9cf2-f616d0aab472 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:02.958188 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce769a3a-12ba-4c66-b117-6eef74576e11 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:02.958806 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f90ff-ceef-46a3-9cf2-f616d0aab472 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:02.959389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f90ff-ceef-46a3-9cf2-f616d0aab472 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:02.960600 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 439/885] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:27:02.964617 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f90ff-ceef-46a3-9cf2-f616d0aab472 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:02.966209 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecbb32-e356-4261-bb5e-6bd9c57983c5 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:02.966498 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecbb32-e356-4261-bb5e-6bd9c57983c5 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:02.966770 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecbb32-e356-4261-bb5e-6bd9c57983c5 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:02.968260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 440/886] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:27:02.969219 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617ea17-7689-4540-8b82-3c6ea7a13833 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:02.969507 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617ea17-7689-4540-8b82-3c6ea7a13833 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:02.969784 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617ea17-7689-4540-8b82-3c6ea7a13833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:02.971725 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 447/887] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Sep 11 08:27:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:02.976035 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce2a7e-e380-40f0-9d0d-4f0e0a0b8738 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:02.976532 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce2a7e-e380-40f0-9d0d-4f0e0a0b8738 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:02.977453 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce2a7e-e380-40f0-9d0d-4f0e0a0b8738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:02.990035 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-9617ea17-7689-4540-8b82-3c6ea7a13833 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:02.991385 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9617ea17-7689-4540-8b82-3c6ea7a13833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:03.011329 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-45ce2a7e-e380-40f0-9d0d-4f0e0a0b8738 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:03.014777 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-45ce2a7e-e380-40f0-9d0d-4f0e0a0b8738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:03.028386 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:03.103556 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 441/888] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:02 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:27:03.103556 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617ea17-7689-4540-8b82-3c6ea7a13833 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:03.142359 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 448/889] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:02 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:27:03.313489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617ea17-7689-4540-8b82-3c6ea7a13833 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:03.379711 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cab4f5-f5b6-4b07-abdd-2b6ed749dc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:03.380654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cab4f5-f5b6-4b07-abdd-2b6ed749dc31 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:03.381200 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cab4f5-f5b6-4b07-abdd-2b6ed749dc31 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:03.381689 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cab4f5-f5b6-4b07-abdd-2b6ed749dc31 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:03.382852 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cab4f5-f5b6-4b07-abdd-2b6ed749dc31 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:03.383419 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cab4f5-f5b6-4b07-abdd-2b6ed749dc31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:03.385845 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cab4f5-f5b6-4b07-abdd-2b6ed749dc31 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:03.399292 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 442/890] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Sep 11 08:27:03 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:03.404769 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce2a7e-e380-40f0-9d0d-4f0e0a0b8738 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:03.492198 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:03.555307 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce2a7e-e380-40f0-9d0d-4f0e0a0b8738 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:03.576175 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cab4f5-f5b6-4b07-abdd-2b6ed749dc31 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:03.595064 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41428df0-fd08-4182-bf42-ba30f0ec57a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:03.595796 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41428df0-fd08-4182-bf42-ba30f0ec57a2 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:03.596077 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41428df0-fd08-4182-bf42-ba30f0ec57a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:03.596353 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41428df0-fd08-4182-bf42-ba30f0ec57a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:03.597196 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41428df0-fd08-4182-bf42-ba30f0ec57a2 None admin] RBAC: Adding query filter params (interface=public, service_id=e024475764944823afa533ed08131d7a, region_id=RegionOne) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:03.597545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41428df0-fd08-4182-bf42-ba30f0ec57a2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:03.599087 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41428df0-fd08-4182-bf42-ba30f0ec57a2 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:03.609504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 449/891] 10.222.0.26 () {56 vars in 1251 bytes} [Sun Sep 11 08:27:03 2022] GET /identity/v3/endpoints?service_id=e024475764944823afa533ed08131d7a&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:27:03.609504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41428df0-fd08-4182-bf42-ba30f0ec57a2 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:03.615797 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:03.710828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cab4f5-f5b6-4b07-abdd-2b6ed749dc31 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:03.748655 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41428df0-fd08-4182-bf42-ba30f0ec57a2 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:03.759026 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:03.762716 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42cdce-2c64-44e9-ad0b-a4c9c3326e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:03.763400 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42cdce-2c64-44e9-ad0b-a4c9c3326e25 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:03.763685 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42cdce-2c64-44e9-ad0b-a4c9c3326e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:03.764013 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42cdce-2c64-44e9-ad0b-a4c9c3326e25 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:03.764611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42cdce-2c64-44e9-ad0b-a4c9c3326e25 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:03.765989 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42cdce-2c64-44e9-ad0b-a4c9c3326e25 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:03.776161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-9a42cdce-2c64-44e9-ad0b-a4c9c3326e25 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 08:27:03.776161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:03.776161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 08:27:03.776161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 08:27:03.776161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 08:27:03.776161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 08:27:03.776161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 08:27:03.776161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:27:03.776161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 08:27:03.776161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:03.776161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 08:27:03.776161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:03.776161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:03.776161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:03.776161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:03.776161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:03.777870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:03.777870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:03.777870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:03.777870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:03.777870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:03.777870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:03.777870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:03.777870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 08:27:03.777870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 08:27:03.777870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 08:27:03.777870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 08:27:03.777870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:03.777870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:03.777870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:03.777870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:03.777870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:03.777870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:03.780407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:03.780407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:03.780407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:03.780407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:03.780407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:03.780407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:03.780407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:03.780407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:03.780407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:03.780407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:03.780407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 08:27:03.780407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:27:03.780407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 08:27:03.780407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:03.780407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 443/892] 10.222.0.26 () {56 vars in 1132 bytes} [Sun Sep 11 08:27:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:27:03.781969 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42cdce-2c64-44e9-ad0b-a4c9c3326e25 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:03.796930 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf21588-fc7b-411c-a6a9-1c95c6f6e47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:03.797580 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf21588-fc7b-411c-a6a9-1c95c6f6e47e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:03.797937 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf21588-fc7b-411c-a6a9-1c95c6f6e47e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:03.798158 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf21588-fc7b-411c-a6a9-1c95c6f6e47e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:03.810879 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf21588-fc7b-411c-a6a9-1c95c6f6e47e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:27:03.816058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-aaf21588-fc7b-411c-a6a9-1c95c6f6e47e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 08:27:03.816058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:03.816058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:03.816058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:03.816058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:03.816058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:03.816058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:03.816058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:03.816058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:03.816058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:03.816058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:03.816058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:03.816058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:27:03.816058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:27:03.816058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:27:03.816058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:27:03.817760 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:27:03.817760 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:27:03.817760 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:27:03.817760 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:27:03.817760 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:03.817760 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:03.817760 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:03.817760 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:03.817760 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:03.817760 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:03.817760 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:03.817760 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:03.817760 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:03.817760 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:03.817760 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:03.817760 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:03.819428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:03.819428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:03.819428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:03.819428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:03.819428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:27:03.819428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:27:03.819428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:27:03.819428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:27:03.819428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:27:03.819428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:27:03.819428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 08:27:03.819428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:03.819428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 450/893] 10.222.0.26 () {56 vars in 1120 bytes} [Sun Sep 11 08:27:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:27:03.819428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf21588-fc7b-411c-a6a9-1c95c6f6e47e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:03.898470 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:03.917732 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42cdce-2c64-44e9-ad0b-a4c9c3326e25 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:03.955205 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb612456-2682-4c24-a459-f27a4f6d48d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:03.956232 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb612456-2682-4c24-a459-f27a4f6d48d9 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:03.956814 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb612456-2682-4c24-a459-f27a4f6d48d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:03.957305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb612456-2682-4c24-a459-f27a4f6d48d9 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:03.958402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb612456-2682-4c24-a459-f27a4f6d48d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:03.960823 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb612456-2682-4c24-a459-f27a4f6d48d9 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:03.964753 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf21588-fc7b-411c-a6a9-1c95c6f6e47e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:03.970594 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 444/894] 10.222.0.26 () {56 vars in 1087 bytes} [Sun Sep 11 08:27:03 2022] GET /identity/v3/services => generated 1268 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:27:03.971892 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb612456-2682-4c24-a459-f27a4f6d48d9 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:04.027383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9588af-5ce6-487c-a1ef-f02258d24ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:04.028517 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9588af-5ce6-487c-a1ef-f02258d24ecf None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:04.028958 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9588af-5ce6-487c-a1ef-f02258d24ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:04.029406 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9588af-5ce6-487c-a1ef-f02258d24ecf None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:04.030587 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9588af-5ce6-487c-a1ef-f02258d24ecf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:04.031114 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9588af-5ce6-487c-a1ef-f02258d24ecf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:04.033779 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9588af-5ce6-487c-a1ef-f02258d24ecf None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:04.043824 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 451/895] 10.222.0.26 () {56 vars in 1126 bytes} [Sun Sep 11 08:27:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:04.052463 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9588af-5ce6-487c-a1ef-f02258d24ecf None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:04.101281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:04.146222 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb612456-2682-4c24-a459-f27a4f6d48d9 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:04.197985 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9588af-5ce6-487c-a1ef-f02258d24ecf None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:04.209315 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9321d-9acf-4cfc-b25d-49d1d80b8bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:04.210535 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9321d-9acf-4cfc-b25d-49d1d80b8bcf None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:04.211546 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9321d-9acf-4cfc-b25d-49d1d80b8bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:04.211668 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9321d-9acf-4cfc-b25d-49d1d80b8bcf None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:04.213086 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9321d-9acf-4cfc-b25d-49d1d80b8bcf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:04.213472 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9321d-9acf-4cfc-b25d-49d1d80b8bcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:04.216054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9321d-9acf-4cfc-b25d-49d1d80b8bcf None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:04.232447 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 445/896] 10.222.0.26 () {56 vars in 1115 bytes} [Sun Sep 11 08:27:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:04.243208 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae9204-20ec-4553-8e92-daf7b48f2151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:04.244233 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae9204-20ec-4553-8e92-daf7b48f2151 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:04.244810 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae9204-20ec-4553-8e92-daf7b48f2151 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:04.245098 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9321d-9acf-4cfc-b25d-49d1d80b8bcf None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:04.245254 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae9204-20ec-4553-8e92-daf7b48f2151 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:04.245729 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae9204-20ec-4553-8e92-daf7b48f2151 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:04.246096 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae9204-20ec-4553-8e92-daf7b48f2151 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:04.247526 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae9204-20ec-4553-8e92-daf7b48f2151 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:04.254530 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 452/897] 10.222.0.26 () {56 vars in 1126 bytes} [Sun Sep 11 08:27:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:04.260374 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae9204-20ec-4553-8e92-daf7b48f2151 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:04.277031 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:04.405806 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:04.415094 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9321d-9acf-4cfc-b25d-49d1d80b8bcf None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:04.424072 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae9204-20ec-4553-8e92-daf7b48f2151 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:04.471293 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b443e2f-181e-4f94-9650-ac58cf9ae2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:04.472352 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b443e2f-181e-4f94-9650-ac58cf9ae2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:04.472835 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b443e2f-181e-4f94-9650-ac58cf9ae2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:04.473363 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b443e2f-181e-4f94-9650-ac58cf9ae2e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:04.474267 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b443e2f-181e-4f94-9650-ac58cf9ae2e8 None admin] RBAC: Adding query filter params (interface=public, service_id=33d6d33968944b4ab1444ddc7e577577, region_id=RegionOne) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:04.474853 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b443e2f-181e-4f94-9650-ac58cf9ae2e8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:04.476546 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b443e2f-181e-4f94-9650-ac58cf9ae2e8 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:04.487771 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 453/898] 10.222.0.26 () {56 vars in 1251 bytes} [Sun Sep 11 08:27:04 2022] GET /identity/v3/endpoints?service_id=33d6d33968944b4ab1444ddc7e577577&interface=public®ion_id=RegionOne => generated 194 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:27:04.489225 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b443e2f-181e-4f94-9650-ac58cf9ae2e8 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:04.489414 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6098a-b86a-40e8-b583-1b316369523c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:04.490500 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6098a-b86a-40e8-b583-1b316369523c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:04.490978 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6098a-b86a-40e8-b583-1b316369523c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:04.491506 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6098a-b86a-40e8-b583-1b316369523c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:04.523981 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6098a-b86a-40e8-b583-1b316369523c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:04.527815 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6098a-b86a-40e8-b583-1b316369523c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:04.561119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-0af6098a-b86a-40e8-b583-1b316369523c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:27:04.561119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:04.561119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:04.561119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:04.561119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:04.561119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:04.561119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:04.561119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:04.561119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:04.561119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:04.561119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:04.561119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:04.561119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:27:04.561119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:27:04.561119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:27:04.561119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:27:04.562724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:04.562724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:04.562724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:04.562724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:04.562724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:04.562724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:04.562724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:04.562724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:04.562724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:04.562724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:04.562724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:04.562724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:04.562724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:04.562724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:04.562724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:04.562724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:04.562724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:27:04.564045 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:27:04.564045 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:27:04.564045 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:04.566850 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 446/899] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:27:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:27:04.577678 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6098a-b86a-40e8-b583-1b316369523c None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:04.663806 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b443e2f-181e-4f94-9650-ac58cf9ae2e8 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:04.683526 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:04.719318 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd207e-9828-48a6-b036-fac05020101f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:04.720383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd207e-9828-48a6-b036-fac05020101f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:04.720869 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd207e-9828-48a6-b036-fac05020101f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:04.721426 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd207e-9828-48a6-b036-fac05020101f None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:04.722252 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd207e-9828-48a6-b036-fac05020101f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:04.723957 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd207e-9828-48a6-b036-fac05020101f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:04.736927 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 454/900] 10.222.0.26 () {56 vars in 1087 bytes} [Sun Sep 11 08:27:04 2022] GET /identity/v3/services => generated 1268 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:27:04.767236 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6098a-b86a-40e8-b583-1b316369523c None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:04.839223 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7b241-7e1e-42ce-a1f9-61f7b8722612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:04.840324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7b241-7e1e-42ce-a1f9-61f7b8722612 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:04.840820 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7b241-7e1e-42ce-a1f9-61f7b8722612 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:04.841302 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7b241-7e1e-42ce-a1f9-61f7b8722612 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:04.842525 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7b241-7e1e-42ce-a1f9-61f7b8722612 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:04.843049 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7b241-7e1e-42ce-a1f9-61f7b8722612 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:04.845335 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7b241-7e1e-42ce-a1f9-61f7b8722612 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:04.868864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 447/901] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:04.877978 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd207e-9828-48a6-b036-fac05020101f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:04.934034 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:05.034231 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd207e-9828-48a6-b036-fac05020101f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:05.073851 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4be0e-d35a-43af-adb2-f456be4ab8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:05.074889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4be0e-d35a-43af-adb2-f456be4ab8a9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:05.075441 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4be0e-d35a-43af-adb2-f456be4ab8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:05.075998 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4be0e-d35a-43af-adb2-f456be4ab8a9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:05.086039 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4be0e-d35a-43af-adb2-f456be4ab8a9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:05.087947 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4be0e-d35a-43af-adb2-f456be4ab8a9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:05.101444 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-65f4be0e-d35a-43af-adb2-f456be4ab8a9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 08:27:05.101444 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:05.101444 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:05.101444 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:05.101444 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:05.101444 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:05.101444 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:05.101444 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:05.101444 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:05.101444 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:05.101444 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:05.101444 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:05.101444 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:27:05.101444 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:27:05.101444 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:27:05.101444 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:27:05.102482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:05.102482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:05.102482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:27:05.102482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:27:05.102482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:27:05.102482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:27:05.102482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:05.102482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:05.102482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:05.102482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:05.102482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:05.102482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:05.102482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:05.102482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:05.102482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:05.102482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:05.102482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:05.102482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:05.103489 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:05.103489 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:05.103489 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:27:05.103489 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:27:05.103489 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:27:05.103489 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:27:05.103489 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:27:05.103489 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:27:05.103489 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 08:27:05.103489 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:05.105653 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 455/902] 10.222.0.26 () {56 vars in 1117 bytes} [Sun Sep 11 08:27:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:27:05.114625 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7b241-7e1e-42ce-a1f9-61f7b8722612 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:05.205535 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab79ab-b8f0-43d4-9afa-080bc39ea905 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:05.206394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab79ab-b8f0-43d4-9afa-080bc39ea905 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:05.207448 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab79ab-b8f0-43d4-9afa-080bc39ea905 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:05.208958 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 456/903] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:27:05.222231 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5346296-bfde-47fc-92a2-5c037eaa71ff None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:05.222963 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5346296-bfde-47fc-92a2-5c037eaa71ff None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:05.223574 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5346296-bfde-47fc-92a2-5c037eaa71ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:05.254315 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-d5346296-bfde-47fc-92a2-5c037eaa71ff None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:05.257191 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d5346296-bfde-47fc-92a2-5c037eaa71ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:05.297715 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7b241-7e1e-42ce-a1f9-61f7b8722612 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:05.348808 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:05.364521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f1ea8-1cde-43b9-b9b9-58d9603ceccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:05.365967 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f1ea8-1cde-43b9-b9b9-58d9603ceccc None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:05.366737 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f1ea8-1cde-43b9-b9b9-58d9603ceccc None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:05.367561 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f1ea8-1cde-43b9-b9b9-58d9603ceccc None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:05.369151 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f1ea8-1cde-43b9-b9b9-58d9603ceccc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:05.369940 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f1ea8-1cde-43b9-b9b9-58d9603ceccc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:05.372801 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f1ea8-1cde-43b9-b9b9-58d9603ceccc None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:05.405748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 457/904] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:05 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:27:05.412065 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 448/905] 10.222.0.26 () {56 vars in 1149 bytes} [Sun Sep 11 08:27:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:05.423317 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5346296-bfde-47fc-92a2-5c037eaa71ff None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:05.448055 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:05.610647 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5346296-bfde-47fc-92a2-5c037eaa71ff None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:05.679127 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d75369-3492-42ef-b5cd-2d710d2a54a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:05.680220 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d75369-3492-42ef-b5cd-2d710d2a54a1 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:05.680702 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d75369-3492-42ef-b5cd-2d710d2a54a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:05.681170 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d75369-3492-42ef-b5cd-2d710d2a54a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:05.821033 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d75369-3492-42ef-b5cd-2d710d2a54a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:05.823784 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d75369-3492-42ef-b5cd-2d710d2a54a1 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:05.853765 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:05.943024 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f1ea8-1cde-43b9-b9b9-58d9603ceccc None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:05.987506 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 458/906] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:27:05 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 08:27:05.990754 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d75369-3492-42ef-b5cd-2d710d2a54a1 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:06.087904 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f1ea8-1cde-43b9-b9b9-58d9603ceccc None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:06.130335 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca2ad5-cf2a-41ee-a004-125573ffaa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:06.131292 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca2ad5-cf2a-41ee-a004-125573ffaa19 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:06.132640 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca2ad5-cf2a-41ee-a004-125573ffaa19 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:06.133105 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca2ad5-cf2a-41ee-a004-125573ffaa19 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:06.133997 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca2ad5-cf2a-41ee-a004-125573ffaa19 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:06.135948 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca2ad5-cf2a-41ee-a004-125573ffaa19 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:06.189936 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d75369-3492-42ef-b5cd-2d710d2a54a1 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:06.215241 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 449/907] 10.222.0.26 () {60 vars in 1141 bytes} [Sun Sep 11 08:27:05 2022] POST /identity/v3/services => generated 241 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:27:06.226562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:06.252376 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80cd53f-803c-45ae-b46f-4091cd776359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:06.252954 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cd53f-803c-45ae-b46f-4091cd776359 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:06.253108 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cd53f-803c-45ae-b46f-4091cd776359 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:06.254321 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cd53f-803c-45ae-b46f-4091cd776359 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:06.267515 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80cd53f-803c-45ae-b46f-4091cd776359 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:06.269732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80cd53f-803c-45ae-b46f-4091cd776359 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:06.288012 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-a80cd53f-803c-45ae-b46f-4091cd776359 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:27:06.288012 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:06.288012 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:06.288012 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:06.288012 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:06.288012 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:06.288012 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:06.288012 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:06.288012 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:06.288012 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:06.288012 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:06.288012 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:06.288012 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:27:06.288012 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:27:06.288012 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:27:06.288012 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:27:06.289961 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:06.289961 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:06.289961 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:06.289961 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:06.289961 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:06.289961 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:06.289961 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:06.289961 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:06.289961 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:06.289961 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:06.289961 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:06.289961 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:06.289961 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:06.289961 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:06.289961 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:06.289961 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:06.289961 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:27:06.292869 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:27:06.292869 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:27:06.292869 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:06.292869 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 459/908] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:27:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:27:06.297531 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca2ad5-cf2a-41ee-a004-125573ffaa19 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:06.399819 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:06.506617 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca2ad5-cf2a-41ee-a004-125573ffaa19 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:06.571906 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4ea74-8315-49e3-868d-3fb91919ec50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:06.572973 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4ea74-8315-49e3-868d-3fb91919ec50 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:06.573557 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4ea74-8315-49e3-868d-3fb91919ec50 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:06.573890 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4ea74-8315-49e3-868d-3fb91919ec50 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:06.575117 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4ea74-8315-49e3-868d-3fb91919ec50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:06.575639 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4ea74-8315-49e3-868d-3fb91919ec50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:06.578254 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4ea74-8315-49e3-868d-3fb91919ec50 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:06.609265 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 450/909] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:27:06.619117 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80cd53f-803c-45ae-b46f-4091cd776359 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:06.814968 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80cd53f-803c-45ae-b46f-4091cd776359 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:06.881611 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317bab9-b2b3-44f1-990b-543fe990c15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:06.882735 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317bab9-b2b3-44f1-990b-543fe990c15d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:06.883088 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317bab9-b2b3-44f1-990b-543fe990c15d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:06.883437 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317bab9-b2b3-44f1-990b-543fe990c15d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:06.897773 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317bab9-b2b3-44f1-990b-543fe990c15d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:06.900211 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317bab9-b2b3-44f1-990b-543fe990c15d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:06.921898 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-4317bab9-b2b3-44f1-990b-543fe990c15d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:27:06.921898 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:06.921898 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:06.921898 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:06.921898 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:06.921898 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:06.921898 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:06.921898 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:06.921898 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:06.921898 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:06.921898 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:06.921898 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:06.921898 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:27:06.921898 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:27:06.921898 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:27:06.922958 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:27:06.922958 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:06.922958 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:06.922958 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:06.922958 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:06.922958 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:06.922958 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:06.922958 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:06.922958 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:06.922958 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:06.922958 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:06.922958 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:06.922958 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:06.922958 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:06.922958 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:06.922958 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:06.922958 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:06.923931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:27:06.923931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:27:06.923931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:27:06.923931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:27:06.923931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:27:06.923931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:27:06.923931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:27:06.923931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:06.924862 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 460/910] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:27:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:27:06.935082 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4ea74-8315-49e3-868d-3fb91919ec50 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:07.060856 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96416af4-02f4-4045-8dee-fad3082e6377 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:07.061342 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96416af4-02f4-4045-8dee-fad3082e6377 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:07.061844 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96416af4-02f4-4045-8dee-fad3082e6377 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:07.065071 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 461/911] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:27:07.072316 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f51c81-5a71-4f23-b3ec-8f2e1fd158e2 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:07.072847 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f51c81-5a71-4f23-b3ec-8f2e1fd158e2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:07.073298 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f51c81-5a71-4f23-b3ec-8f2e1fd158e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:07.100627 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-b3f51c81-5a71-4f23-b3ec-8f2e1fd158e2 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:07.103365 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b3f51c81-5a71-4f23-b3ec-8f2e1fd158e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:07.119591 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4ea74-8315-49e3-868d-3fb91919ec50 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:07.122421 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:07.142258 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:07.161336 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856b0d2-e6b6-44a7-914c-58cb1857f7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:07.161961 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856b0d2-e6b6-44a7-914c-58cb1857f7fe None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:07.162304 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856b0d2-e6b6-44a7-914c-58cb1857f7fe None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:07.162581 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856b0d2-e6b6-44a7-914c-58cb1857f7fe None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:07.163305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856b0d2-e6b6-44a7-914c-58cb1857f7fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:07.163615 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856b0d2-e6b6-44a7-914c-58cb1857f7fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:07.165064 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856b0d2-e6b6-44a7-914c-58cb1857f7fe None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:07.179444 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 451/912] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:27:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:07.185107 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856b0d2-e6b6-44a7-914c-58cb1857f7fe None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:07.222049 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 462/913] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:27:07.307913 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856b0d2-e6b6-44a7-914c-58cb1857f7fe None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:07.345604 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7236418-ab13-4f22-b7cf-a05a6c7ed077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:07.346632 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7236418-ab13-4f22-b7cf-a05a6c7ed077 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:07.347165 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7236418-ab13-4f22-b7cf-a05a6c7ed077 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:07.348193 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7236418-ab13-4f22-b7cf-a05a6c7ed077 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:07.349134 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7236418-ab13-4f22-b7cf-a05a6c7ed077 None admin] RBAC: Adding query filter params (role.id=f316277cb750448ab2bd8bc9125fa166, scope.project.id=b6ed5f989f4248d7bab2548eb350fe17, user.id=84fcccb19a5e43ac9da5d7ca501563e4) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:07.349667 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7236418-ab13-4f22-b7cf-a05a6c7ed077 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:07.351339 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7236418-ab13-4f22-b7cf-a05a6c7ed077 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:07.358244 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 452/914] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:27:07 2022] GET /identity/v3/role_assignments?user.id=84fcccb19a5e43ac9da5d7ca501563e4&scope.project.id=b6ed5f989f4248d7bab2548eb350fe17&role.id=f316277cb750448ab2bd8bc9125fa166 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:27:07.762396 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f51c81-5a71-4f23-b3ec-8f2e1fd158e2 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:07.885990 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f51c81-5a71-4f23-b3ec-8f2e1fd158e2 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:07.928122 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2ed45-31a8-4ed2-82b4-c184b1c8509d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:07.929180 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2ed45-31a8-4ed2-82b4-c184b1c8509d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:07.929698 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2ed45-31a8-4ed2-82b4-c184b1c8509d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:07.930172 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2ed45-31a8-4ed2-82b4-c184b1c8509d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:07.930989 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2ed45-31a8-4ed2-82b4-c184b1c8509d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:07.932593 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2ed45-31a8-4ed2-82b4-c184b1c8509d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:07.942809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-62b2ed45-31a8-4ed2-82b4-c184b1c8509d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 08:27:07.942809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:07.942809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 08:27:07.942809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 08:27:07.942809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 08:27:07.942809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 08:27:07.942809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 08:27:07.942809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:27:07.942809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 08:27:07.942809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:07.942809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 08:27:07.942809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:07.942809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:07.942809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:07.942809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:07.942809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:07.942809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:07.943880 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:07.943880 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:07.943880 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:07.943880 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:07.943880 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:07.943880 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:07.943880 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 08:27:07.943880 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 08:27:07.943880 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 08:27:07.943880 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 08:27:07.943880 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:07.943880 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:07.943880 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:07.943880 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:07.943880 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:07.943880 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:07.944740 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:07.944740 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:07.944740 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:07.944740 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:07.944740 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:07.944740 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:07.944740 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:07.944740 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:07.944740 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:07.944740 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:07.944740 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 08:27:07.944740 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:27:07.944740 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 08:27:07.944740 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:07.947522 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 463/915] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Sep 11 08:27:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:27:07.957190 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7236418-ab13-4f22-b7cf-a05a6c7ed077 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:08.014110 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:08.148826 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7236418-ab13-4f22-b7cf-a05a6c7ed077 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:08.190114 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217854d-7d8a-43ce-9e62-5e678cddaf8d None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:08.190114 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217854d-7d8a-43ce-9e62-5e678cddaf8d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:08.190371 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217854d-7d8a-43ce-9e62-5e678cddaf8d None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:08.199394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 464/916] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:27:08.202553 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4dc9a-c9dd-4139-937d-1b768e6009fb None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:08.203034 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4dc9a-c9dd-4139-937d-1b768e6009fb None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:08.203835 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4dc9a-c9dd-4139-937d-1b768e6009fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:08.204666 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279c181-fb23-42dc-851a-75a43a6099b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:08.205536 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279c181-fb23-42dc-851a-75a43a6099b1 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:08.206015 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279c181-fb23-42dc-851a-75a43a6099b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:08.206577 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279c181-fb23-42dc-851a-75a43a6099b1 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:08.207459 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f279c181-fb23-42dc-851a-75a43a6099b1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:08.207972 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f279c181-fb23-42dc-851a-75a43a6099b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:08.209762 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f279c181-fb23-42dc-851a-75a43a6099b1 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:08.216379 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 453/917] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Sep 11 08:27:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:08.226570 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279c181-fb23-42dc-851a-75a43a6099b1 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:08.235852 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-b0c4dc9a-c9dd-4139-937d-1b768e6009fb None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:08.238478 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b0c4dc9a-c9dd-4139-937d-1b768e6009fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:08.263316 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:08.353914 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:08.363524 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 465/918] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 08:27:08.364237 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279c181-fb23-42dc-851a-75a43a6099b1 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:08.398905 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db316a0-4efd-4336-88da-a452a574e091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:08.399548 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db316a0-4efd-4336-88da-a452a574e091 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:08.399828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db316a0-4efd-4336-88da-a452a574e091 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:08.400107 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db316a0-4efd-4336-88da-a452a574e091 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:08.401782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db316a0-4efd-4336-88da-a452a574e091 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:08.402116 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db316a0-4efd-4336-88da-a452a574e091 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:08.403514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db316a0-4efd-4336-88da-a452a574e091 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:08.409013 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 454/919] 10.222.0.26 () {56 vars in 1114 bytes} [Sun Sep 11 08:27:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:08.419003 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4dc9a-c9dd-4139-937d-1b768e6009fb None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:08.604806 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4dc9a-c9dd-4139-937d-1b768e6009fb None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:08.643160 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0aa3a-71c8-4391-8f17-cb86b1e76de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:08.643809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0aa3a-71c8-4391-8f17-cb86b1e76de9 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:08.644853 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0aa3a-71c8-4391-8f17-cb86b1e76de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:08.645139 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0aa3a-71c8-4391-8f17-cb86b1e76de9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:08.646047 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0aa3a-71c8-4391-8f17-cb86b1e76de9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:08.647542 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0aa3a-71c8-4391-8f17-cb86b1e76de9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:08.758268 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 466/920] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:27:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:27:08.760767 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d0a16-d671-4095-a129-f4c5cc4aff5b None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:08.761111 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d0a16-d671-4095-a129-f4c5cc4aff5b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:08.761390 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d0a16-d671-4095-a129-f4c5cc4aff5b None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:08.762916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 455/921] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:27:08.769546 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c9c1f-a100-462f-9f7d-61951faa1b93 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:08.770380 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c9c1f-a100-462f-9f7d-61951faa1b93 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:08.770380 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c9c1f-a100-462f-9f7d-61951faa1b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:08.777079 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:08.781353 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d0a16-d671-4095-a129-f4c5cc4aff5b None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:08.791664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-195c9c1f-a100-462f-9f7d-61951faa1b93 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:08.797802 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-195c9c1f-a100-462f-9f7d-61951faa1b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:08.884239 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 467/922] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 08:27:08.925389 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d0a16-d671-4095-a129-f4c5cc4aff5b None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:08.968841 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd57f6-87c2-4f63-90f0-b7d26bb16095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:08.969560 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd57f6-87c2-4f63-90f0-b7d26bb16095 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:08.969869 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd57f6-87c2-4f63-90f0-b7d26bb16095 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:08.970137 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd57f6-87c2-4f63-90f0-b7d26bb16095 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:08.970732 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd57f6-87c2-4f63-90f0-b7d26bb16095 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:08.972251 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd57f6-87c2-4f63-90f0-b7d26bb16095 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:08.982787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-c5fd57f6-87c2-4f63-90f0-b7d26bb16095 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 08:27:08.982787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:08.982787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 08:27:08.982787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 08:27:08.982787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 08:27:08.982787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 08:27:08.982787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 08:27:08.982787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:27:08.982787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 08:27:08.982787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:08.982787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 08:27:08.982787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:08.982787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:08.982787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:08.982787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:08.982787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:08.984708 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:08.984708 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:08.984708 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:08.984708 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:08.984708 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:08.984708 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:08.984708 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:08.984708 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 08:27:08.984708 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 08:27:08.984708 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 08:27:08.984708 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 08:27:08.984708 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:08.984708 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:08.984708 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:08.984708 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:08.984708 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:08.984708 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:08.986133 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:08.986133 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:08.986133 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:08.986133 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:08.986133 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:08.986133 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:08.986133 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:08.986133 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:08.986133 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:08.986133 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:08.986133 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 08:27:08.986133 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:27:08.986133 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 08:27:08.986133 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:08.990119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 456/923] 10.222.0.26 () {56 vars in 1132 bytes} [Sun Sep 11 08:27:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:27:08.992836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c9c1f-a100-462f-9f7d-61951faa1b93 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:09.111787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c9c1f-a100-462f-9f7d-61951faa1b93 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:09.141863 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:09.151403 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a00561-a011-4645-bf86-eb10b59e823d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:09.152032 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a00561-a011-4645-bf86-eb10b59e823d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:09.152317 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a00561-a011-4645-bf86-eb10b59e823d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:09.152645 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a00561-a011-4645-bf86-eb10b59e823d None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:09.158059 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a00561-a011-4645-bf86-eb10b59e823d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:09.158059 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a00561-a011-4645-bf86-eb10b59e823d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:09.158059 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a00561-a011-4645-bf86-eb10b59e823d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:09.164995 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 468/924] 10.222.0.26 () {56 vars in 1126 bytes} [Sun Sep 11 08:27:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:09.166986 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd57f6-87c2-4f63-90f0-b7d26bb16095 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:09.192312 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:09.287449 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd57f6-87c2-4f63-90f0-b7d26bb16095 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:09.324776 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a00561-a011-4645-bf86-eb10b59e823d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:09.358326 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a3060-9bbc-43c3-a889-d51bdafa5444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:09.358940 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a3060-9bbc-43c3-a889-d51bdafa5444 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:09.359221 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a3060-9bbc-43c3-a889-d51bdafa5444 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:09.359531 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a3060-9bbc-43c3-a889-d51bdafa5444 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:09.360181 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a3060-9bbc-43c3-a889-d51bdafa5444 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:09.360484 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a3060-9bbc-43c3-a889-d51bdafa5444 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:09.361959 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a3060-9bbc-43c3-a889-d51bdafa5444 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:09.368256 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 457/925] 10.222.0.26 () {56 vars in 1126 bytes} [Sun Sep 11 08:27:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:27:09.374143 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a3060-9bbc-43c3-a889-d51bdafa5444 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:09.473696 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:09.492052 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a00561-a011-4645-bf86-eb10b59e823d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:09.492724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a3060-9bbc-43c3-a889-d51bdafa5444 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:09.533814 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31ffbc-9dde-4276-b286-8a83fb984fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:09.536618 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31ffbc-9dde-4276-b286-8a83fb984fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:09.537026 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31ffbc-9dde-4276-b286-8a83fb984fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:09.537384 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31ffbc-9dde-4276-b286-8a83fb984fa2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:09.538079 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31ffbc-9dde-4276-b286-8a83fb984fa2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:09.539803 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31ffbc-9dde-4276-b286-8a83fb984fa2 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:09.543331 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77f0dc-339c-43f1-8162-da63eaf4cfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:09.544313 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77f0dc-339c-43f1-8162-da63eaf4cfe0 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:09.544781 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77f0dc-339c-43f1-8162-da63eaf4cfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:09.545284 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77f0dc-339c-43f1-8162-da63eaf4cfe0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:09.546292 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77f0dc-339c-43f1-8162-da63eaf4cfe0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:09.547964 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77f0dc-339c-43f1-8162-da63eaf4cfe0 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:09.552271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-6c31ffbc-9dde-4276-b286-8a83fb984fa2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 08:27:09.552271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:09.552271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 08:27:09.552271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 08:27:09.552271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 08:27:09.552271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 08:27:09.552271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 08:27:09.552271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:27:09.552271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 08:27:09.552271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:09.552271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 08:27:09.552271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:09.552271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:09.552271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:09.552271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:09.552271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:09.552271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:09.553327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:09.553327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:09.553327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:09.553327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:09.553327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:09.553327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:09.553327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 08:27:09.553327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 08:27:09.553327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 08:27:09.553327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 08:27:09.553327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:09.553327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:09.553327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:09.553327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:09.553327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:09.553327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:09.554178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:09.554178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:09.554178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:09.554178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:09.554178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:09.554178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:09.554178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:09.554178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:09.554178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:09.554178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:09.554178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 08:27:09.554178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:27:09.554178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 08:27:09.554178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:09.558716 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 469/926] 10.222.0.26 () {56 vars in 1126 bytes} [Sun Sep 11 08:27:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:27:09.559923 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31ffbc-9dde-4276-b286-8a83fb984fa2 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:09.622710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:09.658399 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 458/927] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:27:09 2022] POST /identity/v3/endpoints => generated 347 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:27:09.697324 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31ffbc-9dde-4276-b286-8a83fb984fa2 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:09.767870 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aeb366-c460-42ef-82ea-51dcc7646aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:09.768853 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aeb366-c460-42ef-82ea-51dcc7646aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:09.769387 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aeb366-c460-42ef-82ea-51dcc7646aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:09.769839 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aeb366-c460-42ef-82ea-51dcc7646aa6 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:09.770935 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aeb366-c460-42ef-82ea-51dcc7646aa6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:09.771469 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aeb366-c460-42ef-82ea-51dcc7646aa6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:09.773946 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aeb366-c460-42ef-82ea-51dcc7646aa6 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:09.783061 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 470/928] 10.222.0.26 () {56 vars in 1122 bytes} [Sun Sep 11 08:27:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:09.792932 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77f0dc-339c-43f1-8162-da63eaf4cfe0 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:09.983952 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77f0dc-339c-43f1-8162-da63eaf4cfe0 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:09.999677 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060d335-5f25-4b1d-b519-95a87b9c159c None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:10.000143 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060d335-5f25-4b1d-b519-95a87b9c159c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:10.000545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060d335-5f25-4b1d-b519-95a87b9c159c None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:10.003491 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 471/929] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:27:10.009885 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc47f0c-79f8-401f-850d-1c46b16f8436 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:10.010140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc47f0c-79f8-401f-850d-1c46b16f8436 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:10.010480 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc47f0c-79f8-401f-850d-1c46b16f8436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:10.037584 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-7fc47f0c-79f8-401f-850d-1c46b16f8436 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:10.038779 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7fc47f0c-79f8-401f-850d-1c46b16f8436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:10.052866 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44754a0-2829-4ab2-b74f-56e83e54af63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:10.053870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44754a0-2829-4ab2-b74f-56e83e54af63 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:10.054337 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44754a0-2829-4ab2-b74f-56e83e54af63 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:10.054798 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44754a0-2829-4ab2-b74f-56e83e54af63 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:10.055944 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44754a0-2829-4ab2-b74f-56e83e54af63 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:10.056430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44754a0-2829-4ab2-b74f-56e83e54af63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:10.058891 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44754a0-2829-4ab2-b74f-56e83e54af63 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:10.068399 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 459/930] 10.222.0.26 () {56 vars in 1122 bytes} [Sun Sep 11 08:27:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:10.077721 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44754a0-2829-4ab2-b74f-56e83e54af63 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:10.082785 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:10.171313 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 472/931] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 08:27:10.222979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44754a0-2829-4ab2-b74f-56e83e54af63 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:10.287424 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8028e-fba2-4513-a39b-2a36297989a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:10.289122 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8028e-fba2-4513-a39b-2a36297989a9 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:10.289592 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8028e-fba2-4513-a39b-2a36297989a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:10.290255 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8028e-fba2-4513-a39b-2a36297989a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:10.291166 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8028e-fba2-4513-a39b-2a36297989a9 None admin] RBAC: Adding query filter params (interface=public, service_id=57227022f6ec4ad4a6b827db37f4e3d7, region_id=RegionOne) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:10.291821 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8028e-fba2-4513-a39b-2a36297989a9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:10.293699 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8028e-fba2-4513-a39b-2a36297989a9 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:10.305812 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 460/932] 10.222.0.26 () {56 vars in 1251 bytes} [Sun Sep 11 08:27:10 2022] GET /identity/v3/endpoints?service_id=57227022f6ec4ad4a6b827db37f4e3d7&interface=public®ion_id=RegionOne => generated 194 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:10.312713 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc47f0c-79f8-401f-850d-1c46b16f8436 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:10.378848 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:10.459322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8028e-fba2-4513-a39b-2a36297989a9 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:10.459590 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc47f0c-79f8-401f-850d-1c46b16f8436 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:10.491936 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab935c96-203c-4fc9-bd1e-aa8fc9c9ade9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:10.492559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab935c96-203c-4fc9-bd1e-aa8fc9c9ade9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:10.492842 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab935c96-203c-4fc9-bd1e-aa8fc9c9ade9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:10.493120 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab935c96-203c-4fc9-bd1e-aa8fc9c9ade9 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:10.493754 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab935c96-203c-4fc9-bd1e-aa8fc9c9ade9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:10.495182 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab935c96-203c-4fc9-bd1e-aa8fc9c9ade9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:10.502831 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 473/933] 10.222.0.26 () {56 vars in 1087 bytes} [Sun Sep 11 08:27:10 2022] GET /identity/v3/services => generated 1497 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:27:10.592166 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:10.665909 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8028e-fba2-4513-a39b-2a36297989a9 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:10.724956 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de9a8c-ef75-40b9-9fa1-bc215deb69a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:10.725691 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de9a8c-ef75-40b9-9fa1-bc215deb69a5 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:10.726019 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de9a8c-ef75-40b9-9fa1-bc215deb69a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:10.726503 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de9a8c-ef75-40b9-9fa1-bc215deb69a5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:10.748019 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de9a8c-ef75-40b9-9fa1-bc215deb69a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:27:10.759457 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-38de9a8c-ef75-40b9-9fa1-bc215deb69a5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 08:27:10.759457 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:10.759457 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:10.759457 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:10.759457 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:10.759457 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:10.759457 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:10.759457 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:10.759457 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:10.759457 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:10.759457 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:10.759457 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:10.759457 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:27:10.759457 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:27:10.759457 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:27:10.759457 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:27:10.760463 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:27:10.760463 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:27:10.760463 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:27:10.760463 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:27:10.760463 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:10.760463 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:10.760463 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:10.760463 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:10.760463 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:10.760463 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:10.760463 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:10.760463 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:10.760463 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:10.760463 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:10.760463 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:10.760463 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:10.761314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:10.761314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:10.761314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:10.761314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:10.761314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:27:10.761314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:27:10.761314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:27:10.761314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:27:10.761314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:27:10.761314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:27:10.761314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 08:27:10.761314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:10.761957 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 461/934] 10.222.0.26 () {56 vars in 1120 bytes} [Sun Sep 11 08:27:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:27:10.769995 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab935c96-203c-4fc9-bd1e-aa8fc9c9ade9 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:10.955572 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab935c96-203c-4fc9-bd1e-aa8fc9c9ade9 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:10.976195 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:11.018120 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b381c-bdad-40d4-9d4d-6e54fb130975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:11.019690 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b381c-bdad-40d4-9d4d-6e54fb130975 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:11.020450 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b381c-bdad-40d4-9d4d-6e54fb130975 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:11.021133 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b381c-bdad-40d4-9d4d-6e54fb130975 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:11.022568 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b381c-bdad-40d4-9d4d-6e54fb130975 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:11.023456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b381c-bdad-40d4-9d4d-6e54fb130975 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:11.025817 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b381c-bdad-40d4-9d4d-6e54fb130975 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:11.041715 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 474/935] 10.222.0.26 () {56 vars in 1115 bytes} [Sun Sep 11 08:27:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:11.051561 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de9a8c-ef75-40b9-9fa1-bc215deb69a5 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:11.217780 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de9a8c-ef75-40b9-9fa1-bc215deb69a5 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:11.248253 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:11.257214 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b49190-ce45-4b16-9ac6-edbbdb8c6d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:11.257869 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b49190-ce45-4b16-9ac6-edbbdb8c6d1c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:11.258153 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b49190-ce45-4b16-9ac6-edbbdb8c6d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:11.258438 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b49190-ce45-4b16-9ac6-edbbdb8c6d1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:11.270612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b49190-ce45-4b16-9ac6-edbbdb8c6d1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:11.272215 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b49190-ce45-4b16-9ac6-edbbdb8c6d1c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:11.288368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-e1b49190-ce45-4b16-9ac6-edbbdb8c6d1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:27:11.288368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:11.288368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:11.288368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:11.288368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:11.288368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:11.288368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:11.288368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:11.288368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:11.288368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:11.288368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:11.288368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:11.288368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:27:11.288368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:27:11.288368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:27:11.288368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:27:11.290413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:11.290413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:11.290413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:11.290413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:11.290413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:11.290413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:11.290413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:11.290413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:11.290413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:11.290413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:11.290413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:11.290413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:11.290413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:11.290413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:11.290413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:11.290413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:11.290413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:27:11.292213 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:27:11.292213 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:27:11.292213 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:11.292213 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 462/936] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:27:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:27:11.296566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b381c-bdad-40d4-9d4d-6e54fb130975 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:11.447867 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b381c-bdad-40d4-9d4d-6e54fb130975 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:11.489399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceee565-c045-452a-9285-30880b9bbb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:11.490442 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceee565-c045-452a-9285-30880b9bbb13 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:11.490727 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceee565-c045-452a-9285-30880b9bbb13 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:11.491008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceee565-c045-452a-9285-30880b9bbb13 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:11.491728 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceee565-c045-452a-9285-30880b9bbb13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:11.492040 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceee565-c045-452a-9285-30880b9bbb13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:11.493502 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceee565-c045-452a-9285-30880b9bbb13 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:11.508440 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 475/937] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:11.514251 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b49190-ce45-4b16-9ac6-edbbdb8c6d1c None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:11.527467 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67927f13-fcb4-4a1d-845d-14dabf77f235 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:11.527870 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67927f13-fcb4-4a1d-845d-14dabf77f235 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:11.528097 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67927f13-fcb4-4a1d-845d-14dabf77f235 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:11.529734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 476/938] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:27:11.536194 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ebfb2-aec6-4548-af1b-1872aee993a9 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:11.536524 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ebfb2-aec6-4548-af1b-1872aee993a9 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:11.536733 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ebfb2-aec6-4548-af1b-1872aee993a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:11.556557 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-440ebfb2-aec6-4548-af1b-1872aee993a9 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:11.557831 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-440ebfb2-aec6-4548-af1b-1872aee993a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:11.589802 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:11.635552 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b49190-ce45-4b16-9ac6-edbbdb8c6d1c None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:11.637933 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 477/939] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 08:27:11.682237 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762288b-f889-4c71-b241-519bb439b1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:11.682237 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762288b-f889-4c71-b241-519bb439b1ed None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:11.682237 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762288b-f889-4c71-b241-519bb439b1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:11.682237 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762288b-f889-4c71-b241-519bb439b1ed None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:11.691335 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b762288b-f889-4c71-b241-519bb439b1ed None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:11.691335 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b762288b-f889-4c71-b241-519bb439b1ed None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:11.701971 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-b762288b-f889-4c71-b241-519bb439b1ed None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 08:27:11.701971 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:11.701971 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:11.701971 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:11.701971 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:11.701971 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:11.701971 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:11.701971 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:11.701971 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:11.701971 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:11.701971 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:11.701971 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:11.701971 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:27:11.701971 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:27:11.701971 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:27:11.701971 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:27:11.704106 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:11.704106 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:11.704106 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:27:11.704106 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:27:11.704106 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:27:11.704106 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:27:11.704106 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:11.704106 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:11.704106 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:11.704106 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:11.704106 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:11.704106 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:11.704106 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:11.704106 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:11.704106 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:11.704106 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:11.704106 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:11.704106 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:11.706012 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:11.706012 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:11.706012 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:27:11.706012 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:27:11.706012 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:27:11.706012 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:27:11.706012 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:27:11.706012 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:27:11.706012 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 08:27:11.706012 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:11.708772 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 463/940] 10.222.0.26 () {56 vars in 1117 bytes} [Sun Sep 11 08:27:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:27:11.713203 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ebfb2-aec6-4548-af1b-1872aee993a9 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:11.915398 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762288b-f889-4c71-b241-519bb439b1ed None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:11.920416 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ebfb2-aec6-4548-af1b-1872aee993a9 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:11.965925 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:11.991563 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f18ee-bdb7-47ea-a242-e059fd315062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:11.992670 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f18ee-bdb7-47ea-a242-e059fd315062 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:11.993223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f18ee-bdb7-47ea-a242-e059fd315062 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:11.993704 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f18ee-bdb7-47ea-a242-e059fd315062 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:11.995088 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f18ee-bdb7-47ea-a242-e059fd315062 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:11.995730 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f18ee-bdb7-47ea-a242-e059fd315062 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:11.998474 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f18ee-bdb7-47ea-a242-e059fd315062 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:12.035873 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 478/941] 10.222.0.26 () {56 vars in 1149 bytes} [Sun Sep 11 08:27:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:12.041598 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f18ee-bdb7-47ea-a242-e059fd315062 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:12.043188 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762288b-f889-4c71-b241-519bb439b1ed None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:12.072210 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:12.136300 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82eca88-d9b9-41be-8107-1c558a9bf665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:12.138972 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82eca88-d9b9-41be-8107-1c558a9bf665 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:12.140250 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82eca88-d9b9-41be-8107-1c558a9bf665 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:12.141028 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82eca88-d9b9-41be-8107-1c558a9bf665 None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:12.144590 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82eca88-d9b9-41be-8107-1c558a9bf665 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:12.147394 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82eca88-d9b9-41be-8107-1c558a9bf665 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:12.153593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: WARNING keystone.server.flask.common [None req-a82eca88-d9b9-41be-8107-1c558a9bf665 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 11 08:27:12.184862 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f18ee-bdb7-47ea-a242-e059fd315062 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:12.224536 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.sql.core [None req-a82eca88-d9b9-41be-8107-1c558a9bf665 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 11 08:27:12.224536 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 11 08:27:12.224536 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [parameters: {'id': '9ba89b629e2f444c8b585649bbbfdd68', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 11 08:27:12.224536 dv-cinder-856941-2-smb devstack@keystone.service[81645]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81645) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 11 08:27:12.229684 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e43820-ccee-4a19-9953-540ea209a718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:12.230413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e43820-ccee-4a19-9953-540ea209a718 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:12.230759 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e43820-ccee-4a19-9953-540ea209a718 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:12.231141 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e43820-ccee-4a19-9953-540ea209a718 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:12.241137 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-a82eca88-d9b9-41be-8107-1c558a9bf665 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9ba89b629e2f444c8b585649bbbfdd68.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9ba89b629e2f444c8b585649bbbfdd68. Sep 11 08:27:12.241137 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:12.241137 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 08:27:12.241137 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 08:27:12.241137 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 08:27:12.241137 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 08:27:12.241137 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 08:27:12.241137 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 08:27:12.241137 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 08:27:12.241137 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application conn.query(q) Sep 11 08:27:12.241137 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 08:27:12.241137 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 08:27:12.241137 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 08:27:12.242782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application result.read() Sep 11 08:27:12.242782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 08:27:12.242782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 08:27:12.242782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 08:27:12.242782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 08:27:12.242782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 08:27:12.242782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 08:27:12.242782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 08:27:12.242782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 08:27:12.242782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 11 08:27:12.242782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:12.242782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 11 08:27:12.242782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:12.242782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:12.242782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 11 08:27:12.242782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 11 08:27:12.242782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 11 08:27:12.242782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 11 08:27:12.244724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 08:27:12.244724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application next(self.gen) Sep 11 08:27:12.244724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 11 08:27:12.244724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application yield resource Sep 11 08:27:12.244724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 08:27:12.244724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application next(self.gen) Sep 11 08:27:12.244724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 11 08:27:12.244724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self.session.rollback() Sep 11 08:27:12.244724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 11 08:27:12.244724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self.force_reraise() Sep 11 08:27:12.244724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 11 08:27:12.244724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise self.value Sep 11 08:27:12.244724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 11 08:27:12.244724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 11 08:27:12.244724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 11 08:27:12.244724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application session.commit() Sep 11 08:27:12.244724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 11 08:27:12.246573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 11 08:27:12.246573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 11 08:27:12.246573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._prepare_impl() Sep 11 08:27:12.246573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 11 08:27:12.246573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self.session.flush() Sep 11 08:27:12.246573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 11 08:27:12.246573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._flush(objects) Sep 11 08:27:12.246573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 11 08:27:12.246573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 11 08:27:12.246573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 11 08:27:12.246573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application compat.raise_( Sep 11 08:27:12.246573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 08:27:12.246573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception Sep 11 08:27:12.246573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 11 08:27:12.246573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application flush_context.execute() Sep 11 08:27:12.246573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 11 08:27:12.246573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rec.execute(self) Sep 11 08:27:12.251679 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 11 08:27:12.251679 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 11 08:27:12.251679 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 11 08:27:12.251679 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 11 08:27:12.251679 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 11 08:27:12.251679 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 11 08:27:12.251679 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 11 08:27:12.251679 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 11 08:27:12.251679 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 11 08:27:12.251679 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 11 08:27:12.251679 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 11 08:27:12.251679 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 11 08:27:12.251679 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 11 08:27:12.251679 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 11 08:27:12.251679 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 11 08:27:12.255072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 11 08:27:12.255072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 08:27:12.255072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception Sep 11 08:27:12.255072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 08:27:12.255072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 08:27:12.255072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 08:27:12.255072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 08:27:12.255072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 08:27:12.255072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 08:27:12.255072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 08:27:12.255072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application conn.query(q) Sep 11 08:27:12.255072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 08:27:12.255072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 08:27:12.255072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 08:27:12.255072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application result.read() Sep 11 08:27:12.255072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 08:27:12.255072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 08:27:12.259965 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 08:27:12.259965 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 08:27:12.259965 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 08:27:12.259965 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 08:27:12.259965 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 08:27:12.259965 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 08:27:12.259965 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 11 08:27:12.259965 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 11 08:27:12.259965 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [parameters: {'id': '9ba89b629e2f444c8b585649bbbfdd68', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 11 08:27:12.259965 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 11 08:27:12.259965 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:12.259965 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 08:27:12.259965 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:12.259965 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:12.259965 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 11 08:27:12.262706 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 11 08:27:12.262706 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 11 08:27:12.262706 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 11 08:27:12.262706 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 11 08:27:12.262706 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:12.262706 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 08:27:12.262706 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:12.262706 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:12.262706 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:12.262706 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:12.262706 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:12.262706 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:12.262706 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:12.262706 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:12.262706 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:12.262706 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:12.262706 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:12.268001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:12.268001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 11 08:27:12.268001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 11 08:27:12.268001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:12.268001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:12.268001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 11 08:27:12.268001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 11 08:27:12.268001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9ba89b629e2f444c8b585649bbbfdd68. Sep 11 08:27:12.268001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:12.268001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 464/942] 10.222.0.26 () {60 vars in 1140 bytes} [Sun Sep 11 08:27:11 2022] POST /identity/v3/projects => generated 262 bytes in 329 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:27:12.268001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82eca88-d9b9-41be-8107-1c558a9bf665 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:12.270908 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e43820-ccee-4a19-9953-540ea209a718 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:12.270908 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e43820-ccee-4a19-9953-540ea209a718 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:12.286165 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-16e43820-ccee-4a19-9953-540ea209a718 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:27:12.286165 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:12.286165 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:12.286165 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:12.286165 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:12.286165 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:12.286165 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:12.286165 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:12.286165 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:12.286165 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:12.286165 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:12.286165 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:12.286165 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:27:12.286165 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:27:12.286165 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:27:12.286165 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:27:12.291581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:12.291581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:12.291581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:12.291581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:12.291581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:12.291581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:12.291581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:12.291581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:12.291581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:12.291581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:12.291581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:12.291581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:12.291581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:12.291581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:12.291581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:12.291581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:12.291581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:27:12.296962 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:27:12.296962 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:27:12.296962 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:12.296962 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 479/943] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:27:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:27:12.296962 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e43820-ccee-4a19-9953-540ea209a718 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:12.442135 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:12.443848 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:12.455985 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82eca88-d9b9-41be-8107-1c558a9bf665 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:12.513292 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e43820-ccee-4a19-9953-540ea209a718 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:12.523272 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91aaa0-d8ad-4dc6-9319-e555ec9e97c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:12.524467 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91aaa0-d8ad-4dc6-9319-e555ec9e97c5 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:12.525009 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91aaa0-d8ad-4dc6-9319-e555ec9e97c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:12.525578 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91aaa0-d8ad-4dc6-9319-e555ec9e97c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:12.539611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91aaa0-d8ad-4dc6-9319-e555ec9e97c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:12.543482 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91aaa0-d8ad-4dc6-9319-e555ec9e97c5 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:12.570669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-bc91aaa0-d8ad-4dc6-9319-e555ec9e97c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:27:12.570669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:12.570669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:12.570669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:12.570669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:12.570669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:12.570669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:12.570669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:12.570669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:12.570669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:12.570669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:12.570669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:12.570669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:27:12.570669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:27:12.570669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:27:12.571684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:27:12.571684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:12.571684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:12.571684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:12.571684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:12.571684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:12.571684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:12.571684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:12.571684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:12.571684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:12.571684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:12.571684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:12.571684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:12.571684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:12.571684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:12.571684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:12.571684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:12.572599 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:27:12.572599 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:27:12.572599 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:27:12.572599 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:27:12.572599 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:27:12.572599 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:27:12.572599 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:27:12.572599 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:12.573503 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 465/944] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:27:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:27:12.574482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef213800-84c8-4d78-b853-eaef8a40852b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:12.575144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef213800-84c8-4d78-b853-eaef8a40852b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:12.575476 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef213800-84c8-4d78-b853-eaef8a40852b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:12.576123 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef213800-84c8-4d78-b853-eaef8a40852b None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:12.576448 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef213800-84c8-4d78-b853-eaef8a40852b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:12.576764 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef213800-84c8-4d78-b853-eaef8a40852b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:12.578263 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef213800-84c8-4d78-b853-eaef8a40852b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:12.580682 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91e267-dc0a-4a00-9748-99c41e741db4 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:12.581554 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91e267-dc0a-4a00-9748-99c41e741db4 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:12.582564 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91e267-dc0a-4a00-9748-99c41e741db4 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:12.587714 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 466/945] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:12 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:27:12.589416 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91e267-dc0a-4a00-9748-99c41e741db4 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:12.597530 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 480/946] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:12.599803 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25410365-10a7-43da-84ff-7349777f8aca None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:12.600299 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25410365-10a7-43da-84ff-7349777f8aca None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:12.600832 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25410365-10a7-43da-84ff-7349777f8aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:12.629745 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-25410365-10a7-43da-84ff-7349777f8aca None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:12.631214 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-25410365-10a7-43da-84ff-7349777f8aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:12.757211 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 481/947] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:27:12.758875 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25410365-10a7-43da-84ff-7349777f8aca None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:12.771195 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91e267-dc0a-4a00-9748-99c41e741db4 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:12.815126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1aeea-46df-49b3-b37f-fdce380c726d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:12.816191 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1aeea-46df-49b3-b37f-fdce380c726d None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:12.817045 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1aeea-46df-49b3-b37f-fdce380c726d None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:12.817509 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1aeea-46df-49b3-b37f-fdce380c726d None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:12.818668 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1aeea-46df-49b3-b37f-fdce380c726d None admin] RBAC: Adding query filter params (name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:12.819166 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1aeea-46df-49b3-b37f-fdce380c726d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:12.820832 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1aeea-46df-49b3-b37f-fdce380c726d None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:12.852879 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 467/948] 10.222.0.26 () {56 vars in 1112 bytes} [Sun Sep 11 08:27:12 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:12.916046 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:12.971637 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25410365-10a7-43da-84ff-7349777f8aca None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:13.044248 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3540eff-cb7a-4ab4-8bec-db9d31fe270b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:13.045273 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3540eff-cb7a-4ab4-8bec-db9d31fe270b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:13.045770 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3540eff-cb7a-4ab4-8bec-db9d31fe270b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:13.046253 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3540eff-cb7a-4ab4-8bec-db9d31fe270b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:13.059897 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3540eff-cb7a-4ab4-8bec-db9d31fe270b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:13.062699 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3540eff-cb7a-4ab4-8bec-db9d31fe270b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:13.080506 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d544fe-5d95-4a3f-94ba-c6ede521c4d2 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:13.080873 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d544fe-5d95-4a3f-94ba-c6ede521c4d2 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:13.081070 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d544fe-5d95-4a3f-94ba-c6ede521c4d2 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:13.083215 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 468/949] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:27:13.085952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-e3540eff-cb7a-4ab4-8bec-db9d31fe270b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:27:13.085952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:13.085952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:13.085952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:13.085952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:13.085952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:13.085952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:13.085952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:13.085952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:13.085952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:13.085952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:13.085952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:13.085952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:27:13.085952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:27:13.085952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:27:13.087051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:27:13.087051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:13.087051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:13.087051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:13.087051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:13.087051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:13.087051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:13.087051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:13.087051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:13.087051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:13.087051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:13.087051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:13.087051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:13.087051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:13.087051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:13.087051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:13.087051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:13.088066 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:27:13.088066 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:27:13.088066 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:27:13.088066 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:27:13.088066 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:27:13.088066 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:27:13.088066 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:27:13.088066 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:13.088519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 482/950] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:27:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:27:13.088596 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb552b-075f-454b-bac7-5500ebdfd04b None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:13.088815 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb552b-075f-454b-bac7-5500ebdfd04b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:13.089313 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb552b-075f-454b-bac7-5500ebdfd04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:13.096580 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3540eff-cb7a-4ab4-8bec-db9d31fe270b None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:13.113373 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-00fb552b-075f-454b-bac7-5500ebdfd04b None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:13.114056 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-00fb552b-075f-454b-bac7-5500ebdfd04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:13.129346 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:13.207278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 469/951] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:27:13.248183 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3540eff-cb7a-4ab4-8bec-db9d31fe270b None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:13.272561 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:13.276780 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb552b-075f-454b-bac7-5500ebdfd04b None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:13.295598 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37328a-7e73-4f5c-bf42-641b29914f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:13.296503 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37328a-7e73-4f5c-bf42-641b29914f10 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:13.296999 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37328a-7e73-4f5c-bf42-641b29914f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:13.297456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37328a-7e73-4f5c-bf42-641b29914f10 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:13.298939 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37328a-7e73-4f5c-bf42-641b29914f10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:13.299508 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37328a-7e73-4f5c-bf42-641b29914f10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:13.302316 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37328a-7e73-4f5c-bf42-641b29914f10 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:13.325769 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 483/952] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:27:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:13.333338 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37328a-7e73-4f5c-bf42-641b29914f10 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:13.457972 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb552b-075f-454b-bac7-5500ebdfd04b None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:13.470728 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37328a-7e73-4f5c-bf42-641b29914f10 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:13.508970 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45efc7b-1d55-48c0-9278-6b39add2b8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:13.509977 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45efc7b-1d55-48c0-9278-6b39add2b8b4 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:13.510267 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45efc7b-1d55-48c0-9278-6b39add2b8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:13.510539 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45efc7b-1d55-48c0-9278-6b39add2b8b4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:13.511130 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45efc7b-1d55-48c0-9278-6b39add2b8b4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:13.512542 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45efc7b-1d55-48c0-9278-6b39add2b8b4 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:13.522369 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-d45efc7b-1d55-48c0-9278-6b39add2b8b4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 08:27:13.522369 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:13.522369 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 08:27:13.522369 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 08:27:13.522369 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 08:27:13.522369 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 08:27:13.522369 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 08:27:13.522369 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:27:13.522369 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 08:27:13.522369 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:13.522369 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 08:27:13.522369 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:13.522369 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:13.522369 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:13.522369 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:13.522369 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:13.522369 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:13.523580 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:13.523580 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:13.523580 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:13.523580 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:13.523580 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:13.523580 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:13.523580 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 08:27:13.523580 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 08:27:13.523580 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 08:27:13.523580 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 08:27:13.523580 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:13.523580 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:13.523580 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:13.523580 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:13.523580 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:13.523580 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:13.524521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:13.524521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:13.524521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:13.524521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:13.524521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:13.524521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:13.524521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:13.524521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:13.524521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:13.524521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:13.524521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 08:27:13.524521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:27:13.524521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 08:27:13.524521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:13.524521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 470/953] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:27:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:27:13.525348 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45efc7b-1d55-48c0-9278-6b39add2b8b4 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:13.528921 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d101a6-c6ba-4a04-a8f9-d52d052be18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:13.529601 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d101a6-c6ba-4a04-a8f9-d52d052be18e None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:13.529882 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d101a6-c6ba-4a04-a8f9-d52d052be18e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:13.530161 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d101a6-c6ba-4a04-a8f9-d52d052be18e None admin] PATH_INFO: `/v3/projects/b6ed5f989f4248d7bab2548eb350fe17/users/84fcccb19a5e43ac9da5d7ca501563e4/roles/f316277cb750448ab2bd8bc9125fa166` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:13.532707 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d101a6-c6ba-4a04-a8f9-d52d052be18e None admin] RBAC: Authorizing `identity:create_grant(project_id=b6ed5f989f4248d7bab2548eb350fe17, user_id=84fcccb19a5e43ac9da5d7ca501563e4, role_id=f316277cb750448ab2bd8bc9125fa166)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:13.534230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d101a6-c6ba-4a04-a8f9-d52d052be18e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:13.548470 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:13.635532 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 484/954] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Sep 11 08:27:13 2022] PUT /identity/v3/projects/b6ed5f989f4248d7bab2548eb350fe17/users/84fcccb19a5e43ac9da5d7ca501563e4/roles/f316277cb750448ab2bd8bc9125fa166 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:27:13.637389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d101a6-c6ba-4a04-a8f9-d52d052be18e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:13.730870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45efc7b-1d55-48c0-9278-6b39add2b8b4 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:13.740359 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:13.790515 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d3036-1d6d-43fc-830d-6b41ac17ff6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:13.791386 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d3036-1d6d-43fc-830d-6b41ac17ff6e None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:13.791864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d3036-1d6d-43fc-830d-6b41ac17ff6e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:13.792280 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d3036-1d6d-43fc-830d-6b41ac17ff6e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:13.793101 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d3036-1d6d-43fc-830d-6b41ac17ff6e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:13.794740 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d3036-1d6d-43fc-830d-6b41ac17ff6e None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:13.819470 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-1c2d3036-1d6d-43fc-830d-6b41ac17ff6e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 08:27:13.819470 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:13.819470 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 08:27:13.819470 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 08:27:13.819470 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 08:27:13.819470 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 08:27:13.819470 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 08:27:13.819470 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:27:13.819470 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 08:27:13.819470 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:13.819470 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 08:27:13.819470 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:13.819470 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:13.819470 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:13.819470 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:13.819470 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:13.819470 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:13.821426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:13.821426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:13.821426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:13.821426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:13.821426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:13.821426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:13.821426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 08:27:13.821426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 08:27:13.821426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 08:27:13.821426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 08:27:13.821426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:13.821426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:13.821426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:13.821426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:13.821426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:13.821426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:13.822727 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:13.822727 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:13.822727 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:13.822727 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:13.822727 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:13.822727 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:13.822727 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:13.822727 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:13.822727 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:13.822727 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:13.822727 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 08:27:13.822727 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:27:13.822727 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 08:27:13.822727 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:13.822727 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 471/955] 10.222.0.26 () {56 vars in 1126 bytes} [Sun Sep 11 08:27:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:27:13.837537 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d3036-1d6d-43fc-830d-6b41ac17ff6e None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:13.879673 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d101a6-c6ba-4a04-a8f9-d52d052be18e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:13.958481 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47b99c-58c1-495f-aaf1-4ceb006a9d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:13.959832 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47b99c-58c1-495f-aaf1-4ceb006a9d0f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:13.960316 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47b99c-58c1-495f-aaf1-4ceb006a9d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:13.960785 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47b99c-58c1-495f-aaf1-4ceb006a9d0f None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:13.961898 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47b99c-58c1-495f-aaf1-4ceb006a9d0f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:13.962424 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47b99c-58c1-495f-aaf1-4ceb006a9d0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:13.965207 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47b99c-58c1-495f-aaf1-4ceb006a9d0f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:13.973761 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 485/956] 10.222.0.26 () {56 vars in 1112 bytes} [Sun Sep 11 08:27:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:13.980438 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47b99c-58c1-495f-aaf1-4ceb006a9d0f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:13.994171 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:14.045673 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d3036-1d6d-43fc-830d-6b41ac17ff6e None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:14.115615 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564a80c-2985-4d3c-9118-81130ea0d1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:14.116500 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564a80c-2985-4d3c-9118-81130ea0d1e3 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:14.116968 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564a80c-2985-4d3c-9118-81130ea0d1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:14.117434 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564a80c-2985-4d3c-9118-81130ea0d1e3 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:14.118513 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564a80c-2985-4d3c-9118-81130ea0d1e3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:14.119024 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564a80c-2985-4d3c-9118-81130ea0d1e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:14.122133 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564a80c-2985-4d3c-9118-81130ea0d1e3 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:14.134632 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 472/957] 10.222.0.26 () {56 vars in 1122 bytes} [Sun Sep 11 08:27:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:14.142828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564a80c-2985-4d3c-9118-81130ea0d1e3 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:14.171444 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47b99c-58c1-495f-aaf1-4ceb006a9d0f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:14.186743 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:14.242058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edc736-c7bf-4d92-b898-fe3243a8b416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:14.243722 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edc736-c7bf-4d92-b898-fe3243a8b416 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:14.244846 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edc736-c7bf-4d92-b898-fe3243a8b416 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:14.245960 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edc736-c7bf-4d92-b898-fe3243a8b416 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:14.247687 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edc736-c7bf-4d92-b898-fe3243a8b416 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:14.248495 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edc736-c7bf-4d92-b898-fe3243a8b416 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:14.252222 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edc736-c7bf-4d92-b898-fe3243a8b416 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:14.268197 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 486/958] 10.222.0.26 () {56 vars in 1112 bytes} [Sun Sep 11 08:27:13 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:27:14.327952 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564a80c-2985-4d3c-9118-81130ea0d1e3 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:14.394217 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896a18a-18b0-4738-9650-ab2a99f730e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:14.395147 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896a18a-18b0-4738-9650-ab2a99f730e4 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:14.395711 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896a18a-18b0-4738-9650-ab2a99f730e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:14.396175 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896a18a-18b0-4738-9650-ab2a99f730e4 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:14.397230 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896a18a-18b0-4738-9650-ab2a99f730e4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:14.397749 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896a18a-18b0-4738-9650-ab2a99f730e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:14.400157 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896a18a-18b0-4738-9650-ab2a99f730e4 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:14.410311 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 473/959] 10.222.0.26 () {56 vars in 1122 bytes} [Sun Sep 11 08:27:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:27:14.419079 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edc736-c7bf-4d92-b898-fe3243a8b416 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:14.612077 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edc736-c7bf-4d92-b898-fe3243a8b416 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:14.684663 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4412d-ea12-4218-acf2-cd9420ae21e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:14.685841 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4412d-ea12-4218-acf2-cd9420ae21e7 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:14.692453 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4412d-ea12-4218-acf2-cd9420ae21e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:14.692453 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4412d-ea12-4218-acf2-cd9420ae21e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:14.692453 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af4412d-ea12-4218-acf2-cd9420ae21e7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:14.692453 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af4412d-ea12-4218-acf2-cd9420ae21e7 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:14.791413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 487/960] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:27:14 2022] POST /identity/v3/endpoints => generated 349 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:27:16.118593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bee7f8-d235-4c4c-ab35-c4f4b1e467e9 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:16.119132 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bee7f8-d235-4c4c-ab35-c4f4b1e467e9 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:16.119132 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bee7f8-d235-4c4c-ab35-c4f4b1e467e9 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:16.121077 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 474/961] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:27:16.126849 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34297f57-bb22-4271-aefb-b15440137ae3 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:16.129929 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34297f57-bb22-4271-aefb-b15440137ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:16.129929 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34297f57-bb22-4271-aefb-b15440137ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:16.149960 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-34297f57-bb22-4271-aefb-b15440137ae3 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:16.151225 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-34297f57-bb22-4271-aefb-b15440137ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:16.176494 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:16.241759 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 488/962] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:27:16.338426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22149c03-e58a-4889-a004-a7d842854f54 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:16.338922 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22149c03-e58a-4889-a004-a7d842854f54 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:16.339458 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22149c03-e58a-4889-a004-a7d842854f54 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:16.342449 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 475/963] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:27:16.349496 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae16a9-dea1-4909-9ae0-7f7366d56bca None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:16.349976 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae16a9-dea1-4909-9ae0-7f7366d56bca None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:16.350263 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae16a9-dea1-4909-9ae0-7f7366d56bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:16.375800 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f9ae16a9-dea1-4909-9ae0-7f7366d56bca None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:16.376925 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f9ae16a9-dea1-4909-9ae0-7f7366d56bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:16.455388 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 489/964] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:27:16.542390 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22149c03-e58a-4889-a004-a7d842854f54 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:16.545454 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:16.658613 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22149c03-e58a-4889-a004-a7d842854f54 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:16.704240 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458061e-0945-440b-a4cb-7720429c87ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:16.705238 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458061e-0945-440b-a4cb-7720429c87ea None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:16.705751 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458061e-0945-440b-a4cb-7720429c87ea None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:16.706811 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458061e-0945-440b-a4cb-7720429c87ea None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:16.707731 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458061e-0945-440b-a4cb-7720429c87ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:16.709439 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458061e-0945-440b-a4cb-7720429c87ea None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:16.731545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae16a9-dea1-4909-9ae0-7f7366d56bca None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:16.759479 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.sql.core [None req-1458061e-0945-440b-a4cb-7720429c87ea None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 11 08:27:16.759479 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 11 08:27:16.759479 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [parameters: {'user_id': 'b1ddd3a3c1dd4b30a807b7a69cd2db70', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 11 08:27:16.759479 dv-cinder-856941-2-smb devstack@keystone.service[81645]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81645) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 11 08:27:16.767496 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-1458061e-0945-440b-a4cb-7720429c87ea None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 11 08:27:16.767496 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:16.767496 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 08:27:16.767496 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 08:27:16.767496 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 08:27:16.767496 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 08:27:16.767496 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 08:27:16.767496 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 08:27:16.767496 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 08:27:16.767496 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application conn.query(q) Sep 11 08:27:16.767496 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 08:27:16.767496 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 08:27:16.767496 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 08:27:16.767496 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application result.read() Sep 11 08:27:16.767496 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 08:27:16.769219 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 08:27:16.769219 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 08:27:16.769219 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 08:27:16.769219 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 08:27:16.769219 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 08:27:16.769219 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 08:27:16.769219 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 08:27:16.769219 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 11 08:27:16.769219 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:16.769219 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 11 08:27:16.769219 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:16.769219 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:16.769219 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 11 08:27:16.769219 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 11 08:27:16.769219 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 11 08:27:16.769219 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 11 08:27:16.769219 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 08:27:16.769219 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application next(self.gen) Sep 11 08:27:16.771453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 11 08:27:16.771453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application yield resource Sep 11 08:27:16.771453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 08:27:16.771453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application next(self.gen) Sep 11 08:27:16.771453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 11 08:27:16.771453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self.session.rollback() Sep 11 08:27:16.771453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 11 08:27:16.771453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self.force_reraise() Sep 11 08:27:16.771453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 11 08:27:16.771453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise self.value Sep 11 08:27:16.771453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 11 08:27:16.771453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 11 08:27:16.771453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 11 08:27:16.771453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application session.commit() Sep 11 08:27:16.771453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 11 08:27:16.771453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 11 08:27:16.771453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 11 08:27:16.772495 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._prepare_impl() Sep 11 08:27:16.772495 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 11 08:27:16.772495 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self.session.flush() Sep 11 08:27:16.772495 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 11 08:27:16.772495 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._flush(objects) Sep 11 08:27:16.772495 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 11 08:27:16.772495 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 11 08:27:16.772495 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 11 08:27:16.772495 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application compat.raise_( Sep 11 08:27:16.772495 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 08:27:16.772495 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception Sep 11 08:27:16.772495 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 11 08:27:16.772495 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application flush_context.execute() Sep 11 08:27:16.772495 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 11 08:27:16.772495 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rec.execute(self) Sep 11 08:27:16.772495 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 11 08:27:16.772495 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 11 08:27:16.773394 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 11 08:27:16.773394 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 11 08:27:16.773394 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 11 08:27:16.773394 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 11 08:27:16.773394 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 11 08:27:16.773394 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 11 08:27:16.773394 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 11 08:27:16.773394 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 11 08:27:16.773394 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 11 08:27:16.773394 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 11 08:27:16.773394 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 11 08:27:16.773394 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 11 08:27:16.773394 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 11 08:27:16.773394 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 11 08:27:16.773394 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 08:27:16.773394 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception Sep 11 08:27:16.774592 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 08:27:16.774592 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 08:27:16.774592 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 08:27:16.774592 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 08:27:16.774592 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 08:27:16.774592 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 08:27:16.774592 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 08:27:16.774592 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application conn.query(q) Sep 11 08:27:16.774592 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 08:27:16.774592 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 08:27:16.774592 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 08:27:16.774592 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application result.read() Sep 11 08:27:16.774592 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 08:27:16.774592 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 08:27:16.774592 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 08:27:16.774592 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 08:27:16.776041 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 08:27:16.776041 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 08:27:16.776041 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 08:27:16.776041 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 08:27:16.776041 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 11 08:27:16.776041 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 11 08:27:16.776041 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b1ddd3a3c1dd4b30a807b7a69cd2db70', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 11 08:27:16.776041 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 11 08:27:16.776041 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:16.776041 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 08:27:16.776041 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:16.776041 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:16.776041 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:16.776041 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:16.776041 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:16.779179 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:16.779179 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:16.779179 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:16.779179 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:16.779179 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:16.779179 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:16.779179 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:16.779179 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 11 08:27:16.779179 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 11 08:27:16.779179 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:16.779179 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:16.779179 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:27:16.779179 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:27:16.779179 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:27:16.779179 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:27:16.779179 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 11 08:27:16.779179 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 11 08:27:16.785701 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 11 08:27:16.785701 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 11 08:27:16.785701 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 11 08:27:16.785701 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 11 08:27:16.785701 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 11 08:27:16.785701 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:16.785701 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 476/965] 10.222.0.26 () {60 vars in 1131 bytes} [Sun Sep 11 08:27:16 2022] POST /identity/v3/users => generated 160 bytes in 228 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:27:16.785701 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458061e-0945-440b-a4cb-7720429c87ea None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:16.894039 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:16.898247 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:16.933789 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae16a9-dea1-4909-9ae0-7f7366d56bca None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:16.946128 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458061e-0945-440b-a4cb-7720429c87ea None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:17.008092 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fea0e1-baf7-4f93-a3ad-9567d38819ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:17.009275 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fea0e1-baf7-4f93-a3ad-9567d38819ae None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:17.009779 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fea0e1-baf7-4f93-a3ad-9567d38819ae None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:17.010281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fea0e1-baf7-4f93-a3ad-9567d38819ae None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:17.016905 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffdd01-dfab-4df3-b742-45eba45c6ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:17.018055 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffdd01-dfab-4df3-b742-45eba45c6ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:17.018536 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffdd01-dfab-4df3-b742-45eba45c6ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:17.018992 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffdd01-dfab-4df3-b742-45eba45c6ec9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:17.029981 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffdd01-dfab-4df3-b742-45eba45c6ec9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:17.031356 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fea0e1-baf7-4f93-a3ad-9567d38819ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:27:17.031678 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffdd01-dfab-4df3-b742-45eba45c6ec9 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:17.040895 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-e0fea0e1-baf7-4f93-a3ad-9567d38819ae None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 08:27:17.040895 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:17.040895 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:17.040895 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:17.040895 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:17.040895 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:17.040895 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:17.040895 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:17.040895 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:17.040895 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:17.040895 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:17.040895 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:17.040895 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:27:17.040895 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:27:17.040895 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:27:17.040895 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:27:17.042799 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:27:17.042799 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:27:17.042799 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:27:17.042799 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:27:17.042799 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:17.042799 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:17.042799 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:17.042799 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:17.042799 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:17.042799 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:17.042799 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:17.042799 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:17.042799 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:17.042799 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:17.042799 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:17.042799 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:17.052768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:17.052768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:17.052768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:17.052768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:17.052768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:27:17.052768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:27:17.052768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:27:17.052768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:27:17.052768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:27:17.052768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:27:17.052768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 08:27:17.052768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:17.052768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 490/966] 10.222.0.26 () {56 vars in 1120 bytes} [Sun Sep 11 08:27:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:27:17.052768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec3f5f-b7e7-4c23-a398-7d31b0367873 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:17.058144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec3f5f-b7e7-4c23-a398-7d31b0367873 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:17.058397 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-eaffdd01-dfab-4df3-b742-45eba45c6ec9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 08:27:17.058397 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:17.058397 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:17.058397 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:17.058397 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:17.058397 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:17.058397 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:17.058397 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:17.058397 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:17.058397 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:17.058397 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:17.058397 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:17.058397 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:27:17.058397 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:27:17.058397 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:27:17.058397 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:27:17.064054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:17.064054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:17.064054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:27:17.064054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:27:17.064054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:27:17.064054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:27:17.064054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:17.064054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:17.064054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:17.064054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:17.064054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:17.064054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:17.064054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:17.064054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:17.064054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:17.064054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:17.064054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:17.064054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:17.070119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:17.070119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:17.070119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:27:17.070119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:27:17.070119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:27:17.070119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:27:17.070119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:27:17.070119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:27:17.070119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 08:27:17.070119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:17.075333 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec3f5f-b7e7-4c23-a398-7d31b0367873 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:17.075772 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 477/967] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:27:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:27:17.075772 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffdd01-dfab-4df3-b742-45eba45c6ec9 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:17.076228 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 491/968] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:17 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:27:17.076228 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9a6a2-776b-46b3-8339-669f5e0041cf None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:17.076228 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9a6a2-776b-46b3-8339-669f5e0041cf None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:17.076228 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9a6a2-776b-46b3-8339-669f5e0041cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:17.092308 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-42f9a6a2-776b-46b3-8339-669f5e0041cf None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:17.094435 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-42f9a6a2-776b-46b3-8339-669f5e0041cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:17.183940 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffdd01-dfab-4df3-b742-45eba45c6ec9 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:17.215661 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:17.217376 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 492/969] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:27:17.218693 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9a6a2-776b-46b3-8339-669f5e0041cf None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:17.228314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e066e61-5d74-418e-b991-f7b440e80c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:17.228942 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e066e61-5d74-418e-b991-f7b440e80c40 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:17.238161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e066e61-5d74-418e-b991-f7b440e80c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:17.238161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e066e61-5d74-418e-b991-f7b440e80c40 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:17.238161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e066e61-5d74-418e-b991-f7b440e80c40 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:17.238161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e066e61-5d74-418e-b991-f7b440e80c40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:17.238161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e066e61-5d74-418e-b991-f7b440e80c40 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:17.275286 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 478/970] 10.222.0.26 () {56 vars in 1101 bytes} [Sun Sep 11 08:27:17 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:17.276650 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de544750-2cad-4d8a-931e-428f62851e28 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:17.277017 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de544750-2cad-4d8a-931e-428f62851e28 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:17.277297 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de544750-2cad-4d8a-931e-428f62851e28 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:17.278940 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 479/971] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:27:17.288168 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3923c-14ee-4e18-8d43-24f95740b98c None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:17.288659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3923c-14ee-4e18-8d43-24f95740b98c None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:17.289146 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3923c-14ee-4e18-8d43-24f95740b98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:17.318071 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-bef3923c-14ee-4e18-8d43-24f95740b98c None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:17.320456 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-bef3923c-14ee-4e18-8d43-24f95740b98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:17.343048 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:17.396128 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9a6a2-776b-46b3-8339-669f5e0041cf None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:17.451945 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 480/972] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 08:27:17.455093 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b96fc-9196-4c73-b32d-611c708d9223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:17.455881 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b96fc-9196-4c73-b32d-611c708d9223 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:17.456299 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b96fc-9196-4c73-b32d-611c708d9223 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:17.456707 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b96fc-9196-4c73-b32d-611c708d9223 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:17.457503 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b96fc-9196-4c73-b32d-611c708d9223 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:17.457914 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b96fc-9196-4c73-b32d-611c708d9223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:17.463586 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b96fc-9196-4c73-b32d-611c708d9223 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:17.480297 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 493/973] 10.222.0.26 () {56 vars in 1115 bytes} [Sun Sep 11 08:27:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:17.487371 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3923c-14ee-4e18-8d43-24f95740b98c None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:17.536548 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b96fc-9196-4c73-b32d-611c708d9223 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:17.645026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3923c-14ee-4e18-8d43-24f95740b98c None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:17.664374 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:17.698783 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b097175-f7f1-4dd9-a91d-9a23e241e793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:17.699533 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b097175-f7f1-4dd9-a91d-9a23e241e793 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:17.699733 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b097175-f7f1-4dd9-a91d-9a23e241e793 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:17.700001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b097175-f7f1-4dd9-a91d-9a23e241e793 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:17.712366 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b96fc-9196-4c73-b32d-611c708d9223 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:17.715299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b097175-f7f1-4dd9-a91d-9a23e241e793 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:17.716469 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b097175-f7f1-4dd9-a91d-9a23e241e793 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:17.735220 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-5b097175-f7f1-4dd9-a91d-9a23e241e793 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:27:17.735220 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:17.735220 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:17.735220 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:17.735220 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:17.735220 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:17.735220 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:17.735220 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:17.735220 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:17.735220 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:17.735220 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:17.735220 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:17.735220 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:27:17.735220 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:27:17.735220 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:27:17.735220 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:27:17.736665 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:17.736665 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:17.736665 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:17.736665 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:17.736665 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:17.736665 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:17.736665 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:17.736665 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:17.736665 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:17.736665 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:17.736665 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:17.736665 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:17.736665 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:17.736665 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:17.736665 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:17.736665 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:17.736665 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:27:17.737696 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:27:17.737696 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:27:17.737696 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:17.737696 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 481/974] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:27:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:27:17.737696 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b097175-f7f1-4dd9-a91d-9a23e241e793 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:17.752862 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19acad1-74e0-457e-91fd-f1f36a2f1e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:17.753478 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19acad1-74e0-457e-91fd-f1f36a2f1e77 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:17.753753 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19acad1-74e0-457e-91fd-f1f36a2f1e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:17.754030 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19acad1-74e0-457e-91fd-f1f36a2f1e77 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:17.754692 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19acad1-74e0-457e-91fd-f1f36a2f1e77 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:17.756419 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19acad1-74e0-457e-91fd-f1f36a2f1e77 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:17.760459 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:17.849442 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 494/975] 10.222.0.26 () {60 vars in 1141 bytes} [Sun Sep 11 08:27:17 2022] POST /identity/v3/services => generated 242 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:27:17.850327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19acad1-74e0-457e-91fd-f1f36a2f1e77 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:17.870468 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b097175-f7f1-4dd9-a91d-9a23e241e793 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:17.926402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db0436-0d71-4fe9-9f2d-0007eafc512b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:17.927220 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db0436-0d71-4fe9-9f2d-0007eafc512b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:17.927544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db0436-0d71-4fe9-9f2d-0007eafc512b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:17.927819 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db0436-0d71-4fe9-9f2d-0007eafc512b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:17.928444 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db0436-0d71-4fe9-9f2d-0007eafc512b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:17.929902 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db0436-0d71-4fe9-9f2d-0007eafc512b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:17.940984 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-f3db0436-0d71-4fe9-9f2d-0007eafc512b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 08:27:17.940984 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:17.940984 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 08:27:17.940984 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 08:27:17.940984 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 08:27:17.940984 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 08:27:17.940984 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 08:27:17.940984 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:27:17.940984 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 08:27:17.940984 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:17.940984 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 08:27:17.940984 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:17.940984 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:17.940984 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:17.940984 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:17.940984 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:17.940984 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:17.942505 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:17.942505 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:17.942505 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:17.942505 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:17.942505 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:17.942505 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:17.942505 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 08:27:17.942505 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 08:27:17.942505 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 08:27:17.942505 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 08:27:17.942505 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:17.942505 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:17.942505 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:17.942505 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:17.942505 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:17.942505 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:17.943996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:17.943996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:17.943996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:17.943996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:17.943996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:17.943996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:17.943996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:17.943996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:17.943996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:17.943996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:17.943996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 08:27:17.943996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:27:17.943996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 08:27:17.943996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:17.943996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 482/976] 10.222.0.26 () {56 vars in 1126 bytes} [Sun Sep 11 08:27:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:27:17.948923 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db0436-0d71-4fe9-9f2d-0007eafc512b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:17.981154 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:18.045764 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19acad1-74e0-457e-91fd-f1f36a2f1e77 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:18.089247 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a626fa-502b-42c3-83a2-3ae5c4bcaddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:18.089877 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a626fa-502b-42c3-83a2-3ae5c4bcaddb None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:18.090194 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a626fa-502b-42c3-83a2-3ae5c4bcaddb None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:18.090476 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a626fa-502b-42c3-83a2-3ae5c4bcaddb None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:18.091143 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a626fa-502b-42c3-83a2-3ae5c4bcaddb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:18.092448 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a626fa-502b-42c3-83a2-3ae5c4bcaddb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:18.093926 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a626fa-502b-42c3-83a2-3ae5c4bcaddb None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:18.094401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db0436-0d71-4fe9-9f2d-0007eafc512b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:18.107723 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 495/977] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:18.113607 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a626fa-502b-42c3-83a2-3ae5c4bcaddb None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:18.141663 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2308fd-247f-496f-92d7-5bf17c985928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:18.142573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2308fd-247f-496f-92d7-5bf17c985928 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:18.142854 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2308fd-247f-496f-92d7-5bf17c985928 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:18.143126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2308fd-247f-496f-92d7-5bf17c985928 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:18.144379 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2308fd-247f-496f-92d7-5bf17c985928 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:18.144946 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2308fd-247f-496f-92d7-5bf17c985928 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:18.146750 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2308fd-247f-496f-92d7-5bf17c985928 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:18.157903 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 483/978] 10.222.0.26 () {56 vars in 1122 bytes} [Sun Sep 11 08:27:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:27:18.159401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2308fd-247f-496f-92d7-5bf17c985928 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:18.204789 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:18.271398 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:18.277855 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a626fa-502b-42c3-83a2-3ae5c4bcaddb None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:18.287620 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2308fd-247f-496f-92d7-5bf17c985928 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:18.318735 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73cad9-386b-46e3-940c-0d2629f99d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:18.319638 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73cad9-386b-46e3-940c-0d2629f99d02 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:18.320031 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73cad9-386b-46e3-940c-0d2629f99d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:18.320412 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73cad9-386b-46e3-940c-0d2629f99d02 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:18.329267 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73cad9-386b-46e3-940c-0d2629f99d02 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:18.330881 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73cad9-386b-46e3-940c-0d2629f99d02 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:18.343869 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-be73cad9-386b-46e3-940c-0d2629f99d02 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 08:27:18.343869 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:18.343869 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:18.343869 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:18.343869 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:18.343869 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:18.343869 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:18.343869 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:18.343869 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:18.343869 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:18.343869 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:18.343869 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:18.343869 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:27:18.343869 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:27:18.343869 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:27:18.343869 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:27:18.345116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:18.345116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:18.345116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:27:18.345116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:27:18.345116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:27:18.345116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:27:18.345116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:18.345116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:18.345116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:18.345116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:18.345116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:18.345116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:18.345116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:18.345116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:18.345116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:18.345116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:18.345116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:18.345116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:18.346307 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:18.346307 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:18.346307 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:27:18.346307 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:27:18.346307 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:27:18.346307 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:27:18.346307 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:27:18.346307 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:27:18.346307 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 08:27:18.346307 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:18.347020 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5839f01-7cd6-49ff-81a2-ce96e7c0f823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:18.347020 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5839f01-7cd6-49ff-81a2-ce96e7c0f823 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:18.347020 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5839f01-7cd6-49ff-81a2-ce96e7c0f823 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:18.347020 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5839f01-7cd6-49ff-81a2-ce96e7c0f823 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:18.354894 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5839f01-7cd6-49ff-81a2-ce96e7c0f823 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:18.354894 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5839f01-7cd6-49ff-81a2-ce96e7c0f823 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:18.355101 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 496/979] 10.222.0.26 () {56 vars in 1117 bytes} [Sun Sep 11 08:27:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:27:18.355190 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5839f01-7cd6-49ff-81a2-ce96e7c0f823 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:18.356491 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73cad9-386b-46e3-940c-0d2629f99d02 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:18.367591 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 484/980] 10.222.0.26 () {56 vars in 1122 bytes} [Sun Sep 11 08:27:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:18.369773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5839f01-7cd6-49ff-81a2-ce96e7c0f823 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:18.501067 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73cad9-386b-46e3-940c-0d2629f99d02 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:18.506934 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5839f01-7cd6-49ff-81a2-ce96e7c0f823 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:18.526200 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:18.545286 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317b4bb-1628-49fc-a596-69c9bbdc7be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:18.545914 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317b4bb-1628-49fc-a596-69c9bbdc7be9 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:18.546187 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317b4bb-1628-49fc-a596-69c9bbdc7be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:18.546454 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317b4bb-1628-49fc-a596-69c9bbdc7be9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:18.547338 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317b4bb-1628-49fc-a596-69c9bbdc7be9 None admin] RBAC: Adding query filter params (interface=admin, service_id=57227022f6ec4ad4a6b827db37f4e3d7, region_id=RegionOne) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:18.547650 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317b4bb-1628-49fc-a596-69c9bbdc7be9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:18.549054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317b4bb-1628-49fc-a596-69c9bbdc7be9 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:18.560988 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 485/981] 10.222.0.26 () {56 vars in 1249 bytes} [Sun Sep 11 08:27:18 2022] GET /identity/v3/endpoints?service_id=57227022f6ec4ad4a6b827db37f4e3d7&interface=admin®ion_id=RegionOne => generated 193 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:27:18.562392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317b4bb-1628-49fc-a596-69c9bbdc7be9 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:18.568836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f014fa-2e7e-4ffd-a537-aa96d6adfd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:18.569596 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f014fa-2e7e-4ffd-a537-aa96d6adfd97 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:18.570064 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f014fa-2e7e-4ffd-a537-aa96d6adfd97 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:18.570523 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f014fa-2e7e-4ffd-a537-aa96d6adfd97 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:18.571837 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f014fa-2e7e-4ffd-a537-aa96d6adfd97 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:18.572359 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f014fa-2e7e-4ffd-a537-aa96d6adfd97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:18.574860 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f014fa-2e7e-4ffd-a537-aa96d6adfd97 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:18.591600 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:18.602137 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 497/982] 10.222.0.26 () {56 vars in 1149 bytes} [Sun Sep 11 08:27:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:27:18.608514 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f014fa-2e7e-4ffd-a537-aa96d6adfd97 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:18.733322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317b4bb-1628-49fc-a596-69c9bbdc7be9 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:18.764143 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f014fa-2e7e-4ffd-a537-aa96d6adfd97 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:18.788742 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a5acc-bcb5-4cb4-95da-868c628a476c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:18.789394 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a5acc-bcb5-4cb4-95da-868c628a476c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:18.789817 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a5acc-bcb5-4cb4-95da-868c628a476c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:18.790268 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a5acc-bcb5-4cb4-95da-868c628a476c None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:18.791219 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a5acc-bcb5-4cb4-95da-868c628a476c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:18.793554 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a5acc-bcb5-4cb4-95da-868c628a476c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:18.815324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 486/983] 10.222.0.26 () {56 vars in 1087 bytes} [Sun Sep 11 08:27:18 2022] GET /identity/v3/services => generated 1727 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:27:18.817495 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e47d54-3a28-42e4-a0af-2383581d1bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:18.818309 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e47d54-3a28-42e4-a0af-2383581d1bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:18.818698 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e47d54-3a28-42e4-a0af-2383581d1bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:18.819113 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e47d54-3a28-42e4-a0af-2383581d1bc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:18.872627 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:18.908020 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e47d54-3a28-42e4-a0af-2383581d1bc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:18.911167 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e47d54-3a28-42e4-a0af-2383581d1bc9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:19.045274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 498/984] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:27:18 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 11 08:27:19.053180 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a5acc-bcb5-4cb4-95da-868c628a476c None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:19.175376 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:19.195367 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a5acc-bcb5-4cb4-95da-868c628a476c None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:19.240140 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3e1b1-2ae4-4494-8b17-b689049baab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:19.241119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3e1b1-2ae4-4494-8b17-b689049baab1 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:19.241552 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3e1b1-2ae4-4494-8b17-b689049baab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:19.241985 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3e1b1-2ae4-4494-8b17-b689049baab1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:19.259408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3e1b1-2ae4-4494-8b17-b689049baab1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:19.261791 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3e1b1-2ae4-4494-8b17-b689049baab1 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:19.287773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-02d3e1b1-2ae4-4494-8b17-b689049baab1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:27:19.287773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:19.287773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:19.287773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:19.287773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:19.287773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:19.287773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:19.287773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:19.287773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:19.287773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:19.287773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:19.287773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:19.287773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:27:19.287773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:27:19.287773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:27:19.287773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:27:19.289325 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:19.289325 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:19.289325 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:19.289325 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:19.289325 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:19.289325 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:19.289325 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:19.289325 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:19.289325 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:19.289325 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:19.289325 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:19.289325 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:19.289325 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:19.289325 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:19.289325 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:19.289325 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:19.289325 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:27:19.290259 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:27:19.290259 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:27:19.290259 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:19.290259 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 487/985] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:27:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:27:19.295601 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e47d54-3a28-42e4-a0af-2383581d1bc9 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:19.375507 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:19.413217 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e47d54-3a28-42e4-a0af-2383581d1bc9 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:19.455018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16c056-d5f9-4be0-bd24-ef9059632889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:19.455844 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16c056-d5f9-4be0-bd24-ef9059632889 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:19.456895 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16c056-d5f9-4be0-bd24-ef9059632889 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:19.457294 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16c056-d5f9-4be0-bd24-ef9059632889 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:19.458120 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c16c056-d5f9-4be0-bd24-ef9059632889 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:19.458555 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c16c056-d5f9-4be0-bd24-ef9059632889 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:19.460129 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c16c056-d5f9-4be0-bd24-ef9059632889 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:19.473018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 499/986] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:19.478554 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3e1b1-2ae4-4494-8b17-b689049baab1 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:19.597873 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3e1b1-2ae4-4494-8b17-b689049baab1 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:19.631354 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:19.637366 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adffcdb6-f96c-46ef-a8da-749e96cb0bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:19.638321 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffcdb6-f96c-46ef-a8da-749e96cb0bdb None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:19.638724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffcdb6-f96c-46ef-a8da-749e96cb0bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:19.639101 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffcdb6-f96c-46ef-a8da-749e96cb0bdb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:19.647682 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adffcdb6-f96c-46ef-a8da-749e96cb0bdb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:19.649317 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adffcdb6-f96c-46ef-a8da-749e96cb0bdb None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:19.662914 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-adffcdb6-f96c-46ef-a8da-749e96cb0bdb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:27:19.662914 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:19.662914 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:19.662914 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:19.662914 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:19.662914 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:19.662914 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:19.662914 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:19.662914 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:19.662914 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:19.662914 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:19.662914 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:19.662914 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:27:19.662914 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:27:19.662914 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:27:19.664844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:27:19.664844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:19.664844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:19.664844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:19.664844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:19.664844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:19.664844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:19.664844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:19.664844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:19.664844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:19.664844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:19.664844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:19.664844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:19.664844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:19.664844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:19.664844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:19.664844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:19.666587 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:27:19.666587 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:27:19.666587 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:27:19.666587 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:27:19.666587 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:27:19.666587 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:27:19.666587 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:27:19.666587 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:19.668944 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 488/987] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:27:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:27:19.676596 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16c056-d5f9-4be0-bd24-ef9059632889 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:19.795947 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16c056-d5f9-4be0-bd24-ef9059632889 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:19.828862 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:19.834859 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb6618-fa7b-417d-858b-efaba7f52f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:19.835837 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb6618-fa7b-417d-858b-efaba7f52f82 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:19.836236 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb6618-fa7b-417d-858b-efaba7f52f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:19.836610 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb6618-fa7b-417d-858b-efaba7f52f82 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:19.841352 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb6618-fa7b-417d-858b-efaba7f52f82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:19.841352 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb6618-fa7b-417d-858b-efaba7f52f82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:19.841352 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb6618-fa7b-417d-858b-efaba7f52f82 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:19.856536 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 500/988] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:27:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:19.859931 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adffcdb6-f96c-46ef-a8da-749e96cb0bdb None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:19.980133 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adffcdb6-f96c-46ef-a8da-749e96cb0bdb None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:20.018233 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a1845-59fc-4587-8237-4766faf69a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:20.019622 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a1845-59fc-4587-8237-4766faf69a75 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:20.020026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a1845-59fc-4587-8237-4766faf69a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:20.020440 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a1845-59fc-4587-8237-4766faf69a75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:20.021346 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a1845-59fc-4587-8237-4766faf69a75 None admin] RBAC: Adding query filter params (role.id=f316277cb750448ab2bd8bc9125fa166, scope.project.id=b6ed5f989f4248d7bab2548eb350fe17, user.id=84fcccb19a5e43ac9da5d7ca501563e4) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:20.021791 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a1845-59fc-4587-8237-4766faf69a75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:20.023509 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a1845-59fc-4587-8237-4766faf69a75 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:20.039300 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 489/989] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:27:19 2022] GET /identity/v3/role_assignments?user.id=84fcccb19a5e43ac9da5d7ca501563e4&scope.project.id=b6ed5f989f4248d7bab2548eb350fe17&role.id=f316277cb750448ab2bd8bc9125fa166 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:20.153927 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4363d-f24e-431d-a77d-55bf21ae98cd None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:20.154424 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4363d-f24e-431d-a77d-55bf21ae98cd None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:20.154917 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4363d-f24e-431d-a77d-55bf21ae98cd None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:20.157553 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 501/990] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:27:20.165703 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244b806-de16-4357-953e-9b10f06d7a1f None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:20.166137 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244b806-de16-4357-953e-9b10f06d7a1f None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:20.166335 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244b806-de16-4357-953e-9b10f06d7a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:20.187977 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-e244b806-de16-4357-953e-9b10f06d7a1f None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:20.189245 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e244b806-de16-4357-953e-9b10f06d7a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:20.262408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:20.291666 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 490/991] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:20 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 08:27:20.567884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4363d-f24e-431d-a77d-55bf21ae98cd None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:20.685809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4363d-f24e-431d-a77d-55bf21ae98cd None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:20.728658 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2de52f-c9ee-47fc-903d-66b93dfb25db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:20.729679 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2de52f-c9ee-47fc-903d-66b93dfb25db None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:20.730173 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2de52f-c9ee-47fc-903d-66b93dfb25db None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:20.730751 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2de52f-c9ee-47fc-903d-66b93dfb25db None admin] PATH_INFO: `/v3/services/compute` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:20.731622 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2de52f-c9ee-47fc-903d-66b93dfb25db None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:20.733231 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2de52f-c9ee-47fc-903d-66b93dfb25db None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:20.754088 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-4e2de52f-c9ee-47fc-903d-66b93dfb25db None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 08:27:20.754088 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:20.754088 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 08:27:20.754088 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 08:27:20.754088 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 08:27:20.754088 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 08:27:20.754088 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 08:27:20.754088 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:27:20.754088 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 08:27:20.754088 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:20.754088 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 08:27:20.754088 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:20.754088 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:20.754088 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:20.754088 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:20.754088 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:20.754088 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:20.755482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:20.755482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:20.755482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:20.755482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:20.755482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:20.755482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:20.755482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 08:27:20.755482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 08:27:20.755482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 08:27:20.755482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 08:27:20.755482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:20.755482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:20.755482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:20.755482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:20.755482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:20.755482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:20.756640 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:20.756640 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:20.756640 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:20.756640 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:20.756640 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:20.756640 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:20.756640 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:20.756640 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:20.756640 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:20.756640 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:20.756640 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 08:27:20.756640 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:27:20.756640 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 08:27:20.756640 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:20.762080 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 502/992] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:27:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:27:20.770213 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244b806-de16-4357-953e-9b10f06d7a1f None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:20.882619 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244b806-de16-4357-953e-9b10f06d7a1f None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:20.920435 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d8ad4-7b6a-4eab-9751-33176547f2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:20.921059 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d8ad4-7b6a-4eab-9751-33176547f2cb None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:20.921341 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d8ad4-7b6a-4eab-9751-33176547f2cb None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:20.921613 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d8ad4-7b6a-4eab-9751-33176547f2cb None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:20.922318 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d8ad4-7b6a-4eab-9751-33176547f2cb None admin] RBAC: Adding query filter params (name=compute) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:20.922629 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d8ad4-7b6a-4eab-9751-33176547f2cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:20.924037 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d8ad4-7b6a-4eab-9751-33176547f2cb None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:20.934963 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 491/993] 10.222.0.26 () {56 vars in 1112 bytes} [Sun Sep 11 08:27:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:20.936402 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2de52f-c9ee-47fc-903d-66b93dfb25db None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:21.011888 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:21.061411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2de52f-c9ee-47fc-903d-66b93dfb25db None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:21.094334 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e59c1-733f-48db-8233-d2b3ab542d10 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:21.094744 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e59c1-733f-48db-8233-d2b3ab542d10 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:21.095152 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e59c1-733f-48db-8233-d2b3ab542d10 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:21.096720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 492/994] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:27:21.102480 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e40db8-4aa1-400a-a55f-11d8e4428224 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:21.102778 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e40db8-4aa1-400a-a55f-11d8e4428224 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:21.103049 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e40db8-4aa1-400a-a55f-11d8e4428224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:21.109604 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53355a69-26bd-4e0d-b045-c3c7f9f3e4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:21.111022 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53355a69-26bd-4e0d-b045-c3c7f9f3e4b9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:21.111563 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53355a69-26bd-4e0d-b045-c3c7f9f3e4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:21.112065 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53355a69-26bd-4e0d-b045-c3c7f9f3e4b9 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:21.113248 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53355a69-26bd-4e0d-b045-c3c7f9f3e4b9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:21.113876 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53355a69-26bd-4e0d-b045-c3c7f9f3e4b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:21.116245 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53355a69-26bd-4e0d-b045-c3c7f9f3e4b9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:21.123562 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-b3e40db8-4aa1-400a-a55f-11d8e4428224 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:21.130785 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b3e40db8-4aa1-400a-a55f-11d8e4428224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:21.130982 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 503/995] 10.222.0.26 () {56 vars in 1112 bytes} [Sun Sep 11 08:27:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:27:21.133797 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53355a69-26bd-4e0d-b045-c3c7f9f3e4b9 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:21.209088 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:21.245961 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 493/996] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:21 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 08:27:21.262183 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53355a69-26bd-4e0d-b045-c3c7f9f3e4b9 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:21.284843 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:21.300886 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157ab96-583d-4eb6-a0e8-ff797e0609ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:21.301492 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157ab96-583d-4eb6-a0e8-ff797e0609ec None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:21.301770 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157ab96-583d-4eb6-a0e8-ff797e0609ec None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:21.302041 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157ab96-583d-4eb6-a0e8-ff797e0609ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:21.302836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c157ab96-583d-4eb6-a0e8-ff797e0609ec None admin] RBAC: Adding query filter params (interface=public, service_id=7dcd2bcab411419aa1671dd02718d612, region_id=RegionOne) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:21.303150 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c157ab96-583d-4eb6-a0e8-ff797e0609ec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:21.304570 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c157ab96-583d-4eb6-a0e8-ff797e0609ec None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:21.315810 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 504/997] 10.222.0.26 () {56 vars in 1251 bytes} [Sun Sep 11 08:27:21 2022] GET /identity/v3/endpoints?service_id=7dcd2bcab411419aa1671dd02718d612&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:21.317960 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e40db8-4aa1-400a-a55f-11d8e4428224 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:21.431598 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e40db8-4aa1-400a-a55f-11d8e4428224 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:21.473922 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64afa2-660a-46a5-af47-938942508528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:21.474575 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64afa2-660a-46a5-af47-938942508528 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:21.474855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64afa2-660a-46a5-af47-938942508528 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:21.475126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64afa2-660a-46a5-af47-938942508528 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:21.475823 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64afa2-660a-46a5-af47-938942508528 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:21.477320 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64afa2-660a-46a5-af47-938942508528 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:21.486668 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 494/998] 10.222.0.26 () {56 vars in 1087 bytes} [Sun Sep 11 08:27:21 2022] GET /identity/v3/services => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:27:21.753403 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157ab96-583d-4eb6-a0e8-ff797e0609ec None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:21.930830 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157ab96-583d-4eb6-a0e8-ff797e0609ec None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:21.985112 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2c8c9-3b5c-4e2c-b6ef-29f777ce64b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:21.985756 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2c8c9-3b5c-4e2c-b6ef-29f777ce64b3 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:21.986035 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2c8c9-3b5c-4e2c-b6ef-29f777ce64b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:21.986308 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2c8c9-3b5c-4e2c-b6ef-29f777ce64b3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:21.986999 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2c8c9-3b5c-4e2c-b6ef-29f777ce64b3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:21.988894 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2c8c9-3b5c-4e2c-b6ef-29f777ce64b3 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:21.999178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-f6f2c8c9-3b5c-4e2c-b6ef-29f777ce64b3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 08:27:21.999178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:21.999178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 08:27:21.999178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 08:27:21.999178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 08:27:21.999178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 08:27:21.999178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 08:27:21.999178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:27:21.999178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 08:27:21.999178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:21.999178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 08:27:21.999178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:21.999178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:21.999178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:21.999178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:21.999178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:21.999178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:22.000528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:22.000528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:22.000528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:22.000528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:22.000528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:22.000528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:22.000528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 08:27:22.000528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 08:27:22.000528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 08:27:22.000528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 08:27:22.000528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:22.000528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:22.000528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:22.000528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:22.000528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:22.000528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:22.001374 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:22.001374 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:22.001374 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:22.001374 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:22.001374 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:22.001374 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:22.001374 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:22.001374 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:22.001374 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:22.001374 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:22.001374 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 08:27:22.001374 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:27:22.001374 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 08:27:22.001374 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:22.003338 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 505/999] 10.222.0.26 () {56 vars in 1126 bytes} [Sun Sep 11 08:27:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:27:22.006991 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64afa2-660a-46a5-af47-938942508528 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:22.057549 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:22.122508 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64afa2-660a-46a5-af47-938942508528 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:22.168158 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e674a-4bd6-460c-8011-595ab1be2fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:22.168775 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e674a-4bd6-460c-8011-595ab1be2fba None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:22.169053 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e674a-4bd6-460c-8011-595ab1be2fba None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:22.169452 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e674a-4bd6-460c-8011-595ab1be2fba None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:22.170214 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e674a-4bd6-460c-8011-595ab1be2fba None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:22.170677 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e674a-4bd6-460c-8011-595ab1be2fba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:22.172236 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e674a-4bd6-460c-8011-595ab1be2fba None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:22.179116 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 495/1000] 10.222.0.26 () {56 vars in 1122 bytes} [Sun Sep 11 08:27:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:27:22.186262 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2c8c9-3b5c-4e2c-b6ef-29f777ce64b3 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:22.276606 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:22.360697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2c8c9-3b5c-4e2c-b6ef-29f777ce64b3 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:22.411292 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b4320-8e89-4350-ab05-cad15d720d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:22.412154 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b4320-8e89-4350-ab05-cad15d720d7b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:22.412444 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b4320-8e89-4350-ab05-cad15d720d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:22.412707 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b4320-8e89-4350-ab05-cad15d720d7b None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:22.413597 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b4320-8e89-4350-ab05-cad15d720d7b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:22.414076 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b4320-8e89-4350-ab05-cad15d720d7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:22.416050 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b4320-8e89-4350-ab05-cad15d720d7b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:22.429837 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 506/1001] 10.222.0.26 () {56 vars in 1122 bytes} [Sun Sep 11 08:27:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:27:22.436912 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e674a-4bd6-460c-8011-595ab1be2fba None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:22.600031 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e674a-4bd6-460c-8011-595ab1be2fba None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:22.613022 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:22.643875 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defbb556-6427-4cb6-9667-bd0363aa8c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:22.644659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbb556-6427-4cb6-9667-bd0363aa8c16 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:22.644942 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbb556-6427-4cb6-9667-bd0363aa8c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:22.645219 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbb556-6427-4cb6-9667-bd0363aa8c16 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:22.645960 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defbb556-6427-4cb6-9667-bd0363aa8c16 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:22.648558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defbb556-6427-4cb6-9667-bd0363aa8c16 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:22.743302 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 496/1002] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:27:22 2022] POST /identity/v3/endpoints => generated 325 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:27:22.868556 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f51d9-1668-4bfd-8054-cc5f164286b8 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:22.869076 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f51d9-1668-4bfd-8054-cc5f164286b8 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:22.869076 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f51d9-1668-4bfd-8054-cc5f164286b8 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:22.870578 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 507/1003] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:27:22.876866 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3e679-741c-46bb-936c-094160f22f2a None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:22.877315 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3e679-741c-46bb-936c-094160f22f2a None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:22.877673 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3e679-741c-46bb-936c-094160f22f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:22.897571 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-00f3e679-741c-46bb-936c-094160f22f2a None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:22.898796 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-00f3e679-741c-46bb-936c-094160f22f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:23.015550 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 497/1004] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:22 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:27:23.293732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f51d9-1668-4bfd-8054-cc5f164286b8 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:23.417183 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f51d9-1668-4bfd-8054-cc5f164286b8 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:23.440245 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:23.476230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6106b-599e-45e2-91b5-40101dbc6bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:23.477327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6106b-599e-45e2-91b5-40101dbc6bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:23.477831 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6106b-599e-45e2-91b5-40101dbc6bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:23.478341 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6106b-599e-45e2-91b5-40101dbc6bc6 None admin] PATH_INFO: `/v3/services/image` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:23.479545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6106b-599e-45e2-91b5-40101dbc6bc6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:23.482069 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6106b-599e-45e2-91b5-40101dbc6bc6 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:23.495039 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-e1e6106b-599e-45e2-91b5-40101dbc6bc6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 08:27:23.495039 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:23.495039 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 08:27:23.495039 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 08:27:23.495039 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 08:27:23.495039 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 08:27:23.495039 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 08:27:23.495039 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:27:23.495039 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 08:27:23.495039 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:23.495039 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 08:27:23.495039 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:23.495039 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:23.495039 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:23.495039 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:23.495039 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:23.495039 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:23.497008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:23.497008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:23.497008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:23.497008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:23.497008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:23.497008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:23.497008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 08:27:23.497008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 08:27:23.497008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 08:27:23.497008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 08:27:23.497008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:23.497008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:23.497008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:23.497008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:23.497008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:23.497008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:23.498681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:23.498681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:23.498681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:23.498681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:23.498681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:23.498681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:23.498681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:23.498681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:23.498681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:23.498681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:23.498681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 08:27:23.498681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:27:23.498681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 08:27:23.498681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:23.498681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 508/1005] 10.222.0.26 () {56 vars in 1105 bytes} [Sun Sep 11 08:27:23 2022] GET /identity/v3/services/image => generated 86 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:27:23.503575 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3e679-741c-46bb-936c-094160f22f2a None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:23.673602 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:23.685932 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3e679-741c-46bb-936c-094160f22f2a None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:23.754944 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0dd5cd-c607-4fd3-85ba-8423ad06548b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:23.755904 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dd5cd-c607-4fd3-85ba-8423ad06548b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:23.756332 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dd5cd-c607-4fd3-85ba-8423ad06548b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:23.756750 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dd5cd-c607-4fd3-85ba-8423ad06548b None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:23.757712 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0dd5cd-c607-4fd3-85ba-8423ad06548b None admin] RBAC: Adding query filter params (name=image) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:23.758174 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0dd5cd-c607-4fd3-85ba-8423ad06548b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:23.760719 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0dd5cd-c607-4fd3-85ba-8423ad06548b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:23.776958 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 498/1006] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:27:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:27:23.779273 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6106b-599e-45e2-91b5-40101dbc6bc6 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:23.928960 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fcf3c-c71a-442d-b6db-371f20465e04 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:23.929250 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fcf3c-c71a-442d-b6db-371f20465e04 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:23.929471 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fcf3c-c71a-442d-b6db-371f20465e04 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:23.931424 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 499/1007] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:27:23.940921 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98a02b-d074-444a-9c66-8815881b49b5 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:23.941427 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98a02b-d074-444a-9c66-8815881b49b5 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:23.941907 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98a02b-d074-444a-9c66-8815881b49b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:23.954820 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6106b-599e-45e2-91b5-40101dbc6bc6 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:23.971715 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-bb98a02b-d074-444a-9c66-8815881b49b5 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:23.973662 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-bb98a02b-d074-444a-9c66-8815881b49b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:24.018953 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7549dbb-c70f-49c5-97eb-536fb464d543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:24.018953 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7549dbb-c70f-49c5-97eb-536fb464d543 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:24.018953 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7549dbb-c70f-49c5-97eb-536fb464d543 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:24.018953 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7549dbb-c70f-49c5-97eb-536fb464d543 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:24.019560 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7549dbb-c70f-49c5-97eb-536fb464d543 None admin] RBAC: Adding query filter params (type=image) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:24.019560 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7549dbb-c70f-49c5-97eb-536fb464d543 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:24.019560 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7549dbb-c70f-49c5-97eb-536fb464d543 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:24.035288 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 509/1008] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:27:23 2022] GET /identity/v3/services?type=image => generated 122 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:24.096326 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 500/1009] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:23 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 08:27:24.371413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7549dbb-c70f-49c5-97eb-536fb464d543 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:24.420222 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:24.486025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7549dbb-c70f-49c5-97eb-536fb464d543 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:24.533158 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3198a-dda8-4955-83f9-ddaa79d58e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:24.533873 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3198a-dda8-4955-83f9-ddaa79d58e6d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:24.534161 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3198a-dda8-4955-83f9-ddaa79d58e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:24.534449 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3198a-dda8-4955-83f9-ddaa79d58e6d None admin] PATH_INFO: `/v3/services/compute` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:24.535083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde3198a-dda8-4955-83f9-ddaa79d58e6d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:24.536510 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde3198a-dda8-4955-83f9-ddaa79d58e6d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:24.547504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-cde3198a-dda8-4955-83f9-ddaa79d58e6d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 08:27:24.547504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:24.547504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 08:27:24.547504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 08:27:24.547504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 08:27:24.547504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 08:27:24.547504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 08:27:24.547504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:27:24.547504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 08:27:24.547504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:24.547504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 08:27:24.547504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:24.547504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:24.547504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:24.547504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:24.547504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:24.547504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:24.549037 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:24.549037 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:24.549037 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:24.549037 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:24.549037 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:24.549037 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:24.549037 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 08:27:24.549037 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 08:27:24.549037 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 08:27:24.549037 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 08:27:24.549037 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:24.549037 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:24.549037 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:24.549037 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:24.549037 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:24.549037 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:24.550872 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:24.550872 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:24.550872 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:24.550872 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:24.550872 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:24.550872 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:24.550872 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:24.550872 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:24.550872 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:24.550872 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:24.550872 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 08:27:24.550872 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:27:24.550872 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 08:27:24.550872 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:24.554511 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 510/1010] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:27:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:27:24.556078 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98a02b-d074-444a-9c66-8815881b49b5 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:24.706660 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:24.729998 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98a02b-d074-444a-9c66-8815881b49b5 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:24.791848 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ebd8f-24c3-41d6-82aa-efa911615cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:24.792818 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ebd8f-24c3-41d6-82aa-efa911615cb4 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:24.793276 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ebd8f-24c3-41d6-82aa-efa911615cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:24.793727 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ebd8f-24c3-41d6-82aa-efa911615cb4 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:24.794733 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717ebd8f-24c3-41d6-82aa-efa911615cb4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:24.795045 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717ebd8f-24c3-41d6-82aa-efa911615cb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:24.797143 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717ebd8f-24c3-41d6-82aa-efa911615cb4 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:24.809920 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 501/1011] 10.222.0.26 () {56 vars in 1112 bytes} [Sun Sep 11 08:27:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:24.810942 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3198a-dda8-4955-83f9-ddaa79d58e6d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:24.981873 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3198a-dda8-4955-83f9-ddaa79d58e6d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:24.986360 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:25.039850 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897aec9-5db3-4dd9-bfd6-b75ab70c7c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:25.040673 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897aec9-5db3-4dd9-bfd6-b75ab70c7c97 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:25.040956 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897aec9-5db3-4dd9-bfd6-b75ab70c7c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:25.041233 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897aec9-5db3-4dd9-bfd6-b75ab70c7c97 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:25.042269 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897aec9-5db3-4dd9-bfd6-b75ab70c7c97 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:25.042585 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897aec9-5db3-4dd9-bfd6-b75ab70c7c97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:25.044309 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897aec9-5db3-4dd9-bfd6-b75ab70c7c97 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:25.052644 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 511/1012] 10.222.0.26 () {56 vars in 1112 bytes} [Sun Sep 11 08:27:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:27:25.059901 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ebd8f-24c3-41d6-82aa-efa911615cb4 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:25.071723 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3bce9-7bca-4997-a435-5a9d603386c1 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:25.072215 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3bce9-7bca-4997-a435-5a9d603386c1 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:25.072709 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3bce9-7bca-4997-a435-5a9d603386c1 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:25.075325 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 512/1013] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:27:25.082319 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4808c-2fe8-4101-bfae-c1ffcb3ef863 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:25.082585 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4808c-2fe8-4101-bfae-c1ffcb3ef863 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:25.082856 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4808c-2fe8-4101-bfae-c1ffcb3ef863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:25.105372 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-bdb4808c-2fe8-4101-bfae-c1ffcb3ef863 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:25.106600 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-bdb4808c-2fe8-4101-bfae-c1ffcb3ef863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:25.187121 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ebd8f-24c3-41d6-82aa-efa911615cb4 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:25.209530 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 513/1014] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:25 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 08:27:25.236573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a25ca-ea63-4719-96f2-8325657afff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:25.237299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a25ca-ea63-4719-96f2-8325657afff5 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:25.237706 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a25ca-ea63-4719-96f2-8325657afff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:25.238108 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a25ca-ea63-4719-96f2-8325657afff5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:25.238940 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a25ca-ea63-4719-96f2-8325657afff5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:25.240711 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a25ca-ea63-4719-96f2-8325657afff5 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:25.329210 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 502/1015] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:27:25 2022] POST /identity/v3/endpoints => generated 334 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:27:25.485031 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4808c-2fe8-4101-bfae-c1ffcb3ef863 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:25.622923 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:25.627083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4808c-2fe8-4101-bfae-c1ffcb3ef863 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:25.678477 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b47e2-2f1f-4285-b666-dadfd2d50be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:25.678477 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b47e2-2f1f-4285-b666-dadfd2d50be2 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:25.678818 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b47e2-2f1f-4285-b666-dadfd2d50be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:25.679076 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b47e2-2f1f-4285-b666-dadfd2d50be2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:25.680540 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b47e2-2f1f-4285-b666-dadfd2d50be2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:25.682205 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b47e2-2f1f-4285-b666-dadfd2d50be2 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:25.684475 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 514/1016] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:27:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:25.695140 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a25ca-ea63-4719-96f2-8325657afff5 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:25.710108 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:25.826479 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a25ca-ea63-4719-96f2-8325657afff5 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:25.871374 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10ad74-91e7-4e92-a20a-d520b947873a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:25.871996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10ad74-91e7-4e92-a20a-d520b947873a None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:25.872281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10ad74-91e7-4e92-a20a-d520b947873a None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:25.872576 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10ad74-91e7-4e92-a20a-d520b947873a None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:25.873274 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10ad74-91e7-4e92-a20a-d520b947873a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:25.874786 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10ad74-91e7-4e92-a20a-d520b947873a None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:25.997178 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 503/1017] 10.222.0.26 () {60 vars in 1141 bytes} [Sun Sep 11 08:27:25 2022] POST /identity/v3/projects => generated 311 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:27:26.374746 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cab6ae-1d11-45fe-806b-40f6c5b2f01b None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:26.375298 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cab6ae-1d11-45fe-806b-40f6c5b2f01b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:26.375782 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cab6ae-1d11-45fe-806b-40f6c5b2f01b None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:26.378275 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 515/1018] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:27:26.384727 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f813b41-6669-4aa1-9ff7-110c5778a5ad None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:26.385108 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f813b41-6669-4aa1-9ff7-110c5778a5ad None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:26.385268 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f813b41-6669-4aa1-9ff7-110c5778a5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:26.406990 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-1f813b41-6669-4aa1-9ff7-110c5778a5ad None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:26.408475 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1f813b41-6669-4aa1-9ff7-110c5778a5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:26.488725 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:26.502744 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 504/1019] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:26 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:27:26.774317 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cab6ae-1d11-45fe-806b-40f6c5b2f01b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:26.904382 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cab6ae-1d11-45fe-806b-40f6c5b2f01b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:26.952045 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad30b1-5610-43de-8fba-9bc245673993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:26.952566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad30b1-5610-43de-8fba-9bc245673993 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:26.952864 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad30b1-5610-43de-8fba-9bc245673993 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:26.953116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad30b1-5610-43de-8fba-9bc245673993 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:26.954257 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad30b1-5610-43de-8fba-9bc245673993 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:26.956518 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad30b1-5610-43de-8fba-9bc245673993 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:27.055327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 516/1020] 10.222.0.26 () {60 vars in 1141 bytes} [Sun Sep 11 08:27:26 2022] POST /identity/v3/services => generated 242 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:27:27.950688 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae3547-2292-4e64-8083-7d65e8858b5e None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:27.951486 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae3547-2292-4e64-8083-7d65e8858b5e None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:27.951486 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae3547-2292-4e64-8083-7d65e8858b5e None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:27.952855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 505/1021] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:27:27.959669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d7b87-50df-4fdd-9684-60f88f7ce473 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:27.960231 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d7b87-50df-4fdd-9684-60f88f7ce473 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:27.960651 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d7b87-50df-4fdd-9684-60f88f7ce473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:27.992500 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-8d0d7b87-50df-4fdd-9684-60f88f7ce473 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:27.994326 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8d0d7b87-50df-4fdd-9684-60f88f7ce473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:28.025028 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:28.128907 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 517/1022] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 08:27:28.369499 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00fa73-170d-499d-a044-538812486dbf None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:28.369878 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00fa73-170d-499d-a044-538812486dbf None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:28.370063 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00fa73-170d-499d-a044-538812486dbf None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:28.371637 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 506/1023] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:27:28.377075 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183175be-90d2-439a-9c91-7cac8ddb60a2 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:28.377427 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183175be-90d2-439a-9c91-7cac8ddb60a2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:28.377705 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183175be-90d2-439a-9c91-7cac8ddb60a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:28.397170 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-183175be-90d2-439a-9c91-7cac8ddb60a2 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:28.398420 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-183175be-90d2-439a-9c91-7cac8ddb60a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:28.495008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 518/1024] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:27:28.540076 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00fa73-170d-499d-a044-538812486dbf None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:28.685982 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00fa73-170d-499d-a044-538812486dbf None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:28.747553 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf1987-4343-4201-be40-37a2356717b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:28.748833 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf1987-4343-4201-be40-37a2356717b0 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:28.749334 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf1987-4343-4201-be40-37a2356717b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:28.749864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf1987-4343-4201-be40-37a2356717b0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:28.765418 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf1987-4343-4201-be40-37a2356717b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:27:28.773932 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-38cf1987-4343-4201-be40-37a2356717b0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 08:27:28.773932 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:28.773932 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:28.773932 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:28.773932 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:28.773932 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:28.773932 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:28.773932 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:28.773932 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:28.773932 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:28.773932 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:28.773932 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:28.773932 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:27:28.773932 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:27:28.773932 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:27:28.773932 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:27:28.775668 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:27:28.775668 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:27:28.775668 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:27:28.775668 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:27:28.775668 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:28.775668 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:28.775668 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:28.775668 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:28.775668 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:28.775668 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:28.775668 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:28.775668 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:28.775668 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:28.775668 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:28.775668 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:28.775668 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:28.777206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:28.777206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:28.777206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:28.777206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:28.777206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:27:28.777206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:27:28.777206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:27:28.777206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:27:28.777206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:27:28.777206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:27:28.777206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 08:27:28.777206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:28.779473 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 507/1025] 10.222.0.26 () {56 vars in 1120 bytes} [Sun Sep 11 08:27:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:27:28.782644 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183175be-90d2-439a-9c91-7cac8ddb60a2 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:28.783378 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf1987-4343-4201-be40-37a2356717b0 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:28.866285 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:28.872808 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:28.896732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183175be-90d2-439a-9c91-7cac8ddb60a2 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:28.932911 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf1987-4343-4201-be40-37a2356717b0 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:28.955159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f0c32-2090-43e9-840e-6ac0b636b8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:28.955899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f0c32-2090-43e9-840e-6ac0b636b8ba None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:28.956242 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f0c32-2090-43e9-840e-6ac0b636b8ba None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:28.956492 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f0c32-2090-43e9-840e-6ac0b636b8ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:28.957663 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f0c32-2090-43e9-840e-6ac0b636b8ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:28.959117 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f0c32-2090-43e9-840e-6ac0b636b8ba None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:28.961004 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 519/1026] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:27:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:27:28.966781 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f0c32-2090-43e9-840e-6ac0b636b8ba None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:28.970432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873ef1a-2a23-496c-981f-1877ae852a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:28.971200 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873ef1a-2a23-496c-981f-1877ae852a72 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:28.971411 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873ef1a-2a23-496c-981f-1877ae852a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:28.971658 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873ef1a-2a23-496c-981f-1877ae852a72 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:28.972326 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8873ef1a-2a23-496c-981f-1877ae852a72 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:28.972637 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8873ef1a-2a23-496c-981f-1877ae852a72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:28.974015 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8873ef1a-2a23-496c-981f-1877ae852a72 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:28.987617 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 508/1027] 10.222.0.26 () {56 vars in 1115 bytes} [Sun Sep 11 08:27:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:27:28.989441 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873ef1a-2a23-496c-981f-1877ae852a72 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:29.116352 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873ef1a-2a23-496c-981f-1877ae852a72 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:29.117494 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f0c32-2090-43e9-840e-6ac0b636b8ba None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:29.136554 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:29.160386 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95437f-604d-4b29-a494-f728f99c3ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:29.161333 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95437f-604d-4b29-a494-f728f99c3ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:29.161623 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95437f-604d-4b29-a494-f728f99c3ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:29.161901 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95437f-604d-4b29-a494-f728f99c3ab6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:29.173083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968ec5b-316a-4f57-8f2f-8619eaa65575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:29.173329 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95437f-604d-4b29-a494-f728f99c3ab6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:29.174120 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968ec5b-316a-4f57-8f2f-8619eaa65575 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:29.174606 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968ec5b-316a-4f57-8f2f-8619eaa65575 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:29.174794 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95437f-604d-4b29-a494-f728f99c3ab6 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:29.175085 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968ec5b-316a-4f57-8f2f-8619eaa65575 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:29.176382 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e968ec5b-316a-4f57-8f2f-8619eaa65575 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:29.179218 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e968ec5b-316a-4f57-8f2f-8619eaa65575 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:29.193289 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-9f95437f-604d-4b29-a494-f728f99c3ab6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:27:29.193289 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:29.193289 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:29.193289 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:29.193289 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:29.193289 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:29.193289 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:29.193289 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:29.193289 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:29.193289 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:29.193289 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:29.193289 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:29.193289 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:27:29.193289 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:27:29.193289 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:27:29.193289 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:27:29.194375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:29.194375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:29.194375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:29.194375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:29.194375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:29.194375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:29.194375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:29.194375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:29.194375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:29.194375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:29.194375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:29.194375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:29.194375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:29.194375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:29.194375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:29.194375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:29.194375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:27:29.195350 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:27:29.195350 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:27:29.195350 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:29.199435 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 509/1028] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:27:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:27:29.200889 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95437f-604d-4b29-a494-f728f99c3ab6 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:29.299375 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 520/1029] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Sep 11 08:27:28 2022] POST /identity/v3/users => generated 285 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:27:29.336806 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95437f-604d-4b29-a494-f728f99c3ab6 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:29.381349 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fb5bc-86ad-478c-bb20-2b05a6777d7e None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:29.381629 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fb5bc-86ad-478c-bb20-2b05a6777d7e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:29.381976 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fb5bc-86ad-478c-bb20-2b05a6777d7e None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:29.383761 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 521/1030] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:27:29.389783 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca4ee3-533a-4233-b5cc-7fd9346a8adc None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:29.390078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca4ee3-533a-4233-b5cc-7fd9346a8adc None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:29.390419 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca4ee3-533a-4233-b5cc-7fd9346a8adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:29.397647 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:29.397891 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31df344-2ba6-4f2e-94fa-1d2cb5326025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:29.398737 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31df344-2ba6-4f2e-94fa-1d2cb5326025 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:29.399148 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31df344-2ba6-4f2e-94fa-1d2cb5326025 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:29.399588 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31df344-2ba6-4f2e-94fa-1d2cb5326025 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:29.400632 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31df344-2ba6-4f2e-94fa-1d2cb5326025 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:29.401120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31df344-2ba6-4f2e-94fa-1d2cb5326025 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:29.403457 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31df344-2ba6-4f2e-94fa-1d2cb5326025 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:29.411617 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-afca4ee3-533a-4233-b5cc-7fd9346a8adc None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:29.416684 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-afca4ee3-533a-4233-b5cc-7fd9346a8adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:29.424396 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 510/1031] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:29.430464 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31df344-2ba6-4f2e-94fa-1d2cb5326025 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:29.462177 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:29.527400 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 522/1032] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 08:27:29.560985 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31df344-2ba6-4f2e-94fa-1d2cb5326025 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:29.602749 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2238d8a-4bbe-48cb-bb4a-b008e618f00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:29.603499 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2238d8a-4bbe-48cb-bb4a-b008e618f00e None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:29.603835 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2238d8a-4bbe-48cb-bb4a-b008e618f00e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:29.604109 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2238d8a-4bbe-48cb-bb4a-b008e618f00e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:29.613823 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2238d8a-4bbe-48cb-bb4a-b008e618f00e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:29.615314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2238d8a-4bbe-48cb-bb4a-b008e618f00e None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:29.633239 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-c2238d8a-4bbe-48cb-bb4a-b008e618f00e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 08:27:29.633239 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:29.633239 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:29.633239 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:29.633239 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:29.633239 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:29.633239 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:29.633239 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:29.633239 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:29.633239 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:29.633239 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:29.633239 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:29.633239 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:27:29.633239 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:27:29.633239 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:27:29.633239 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:27:29.635158 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:29.635158 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:29.635158 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:27:29.635158 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:27:29.635158 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:27:29.635158 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:27:29.635158 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:29.635158 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:29.635158 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:29.635158 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:29.635158 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:29.635158 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:29.635158 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:29.635158 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:29.635158 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:29.635158 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:29.635158 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:29.635158 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:29.637164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:29.637164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:29.637164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:27:29.637164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:27:29.637164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:27:29.637164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:27:29.637164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:27:29.637164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:27:29.637164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 08:27:29.637164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:29.637164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 511/1033] 10.222.0.26 () {56 vars in 1093 bytes} [Sun Sep 11 08:27:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:27:29.641645 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca4ee3-533a-4233-b5cc-7fd9346a8adc None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:29.775075 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca4ee3-533a-4233-b5cc-7fd9346a8adc None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:29.806951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2238d8a-4bbe-48cb-bb4a-b008e618f00e None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:29.818838 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:29.828837 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05fec6c-80ac-4535-b27a-a7dba7f53d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:29.830176 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fec6c-80ac-4535-b27a-a7dba7f53d37 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:29.830993 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fec6c-80ac-4535-b27a-a7dba7f53d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:29.832205 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fec6c-80ac-4535-b27a-a7dba7f53d37 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:29.833460 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05fec6c-80ac-4535-b27a-a7dba7f53d37 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:29.834323 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05fec6c-80ac-4535-b27a-a7dba7f53d37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:29.836821 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05fec6c-80ac-4535-b27a-a7dba7f53d37 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:29.878118 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 523/1034] 10.222.0.26 () {56 vars in 1133 bytes} [Sun Sep 11 08:27:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:27:29.880681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05fec6c-80ac-4535-b27a-a7dba7f53d37 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:29.901149 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:29.920198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2238d8a-4bbe-48cb-bb4a-b008e618f00e None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:29.961461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a31d3-d3af-4f3b-852c-876966191dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:29.962504 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a31d3-d3af-4f3b-852c-876966191dea None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:29.962953 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a31d3-d3af-4f3b-852c-876966191dea None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:29.963234 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a31d3-d3af-4f3b-852c-876966191dea None admin] PATH_INFO: `/v3/services/image` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:29.963882 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a31d3-d3af-4f3b-852c-876966191dea None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:29.965293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a31d3-d3af-4f3b-852c-876966191dea None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:29.981675 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-b78a31d3-d3af-4f3b-852c-876966191dea None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 08:27:29.981675 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:29.981675 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 08:27:29.981675 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 08:27:29.981675 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 08:27:29.981675 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 08:27:29.981675 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 08:27:29.981675 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:27:29.981675 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 08:27:29.981675 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:29.981675 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 08:27:29.981675 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:29.981675 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:29.981675 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:29.981675 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:29.981675 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:29.981675 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:29.984018 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:29.984018 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:29.984018 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:29.984018 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:29.984018 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:29.984018 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:29.984018 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 08:27:29.984018 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 08:27:29.984018 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 08:27:29.984018 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 08:27:29.984018 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:29.984018 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:29.984018 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:29.984018 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:29.984018 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:29.984018 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:29.984916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:29.984916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:29.984916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:29.984916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:29.984916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:29.984916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:29.984916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:29.984916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:29.984916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:29.984916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:29.984916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 08:27:29.984916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:27:29.984916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 08:27:29.984916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:29.991617 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 512/1035] 10.222.0.26 () {56 vars in 1105 bytes} [Sun Sep 11 08:27:29 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:27:29.994896 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a31d3-d3af-4f3b-852c-876966191dea None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:30.024925 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05fec6c-80ac-4535-b27a-a7dba7f53d37 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:30.066361 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218c53a-1f7d-4c4b-8266-9f0c782d6284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:30.066867 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218c53a-1f7d-4c4b-8266-9f0c782d6284 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:30.067142 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218c53a-1f7d-4c4b-8266-9f0c782d6284 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:30.067583 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218c53a-1f7d-4c4b-8266-9f0c782d6284 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:30.140771 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a31d3-d3af-4f3b-852c-876966191dea None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:30.144301 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:30.160704 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218c53a-1f7d-4c4b-8266-9f0c782d6284 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:30.162197 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218c53a-1f7d-4c4b-8266-9f0c782d6284 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:30.185582 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65160564-e6c8-4c1e-8418-bc23415834bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:30.186524 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65160564-e6c8-4c1e-8418-bc23415834bc None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:30.186979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65160564-e6c8-4c1e-8418-bc23415834bc None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:30.187638 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65160564-e6c8-4c1e-8418-bc23415834bc None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:30.188445 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65160564-e6c8-4c1e-8418-bc23415834bc None admin] RBAC: Adding query filter params (name=image) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:30.188934 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65160564-e6c8-4c1e-8418-bc23415834bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:30.191132 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65160564-e6c8-4c1e-8418-bc23415834bc None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:30.198360 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 513/1036] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:27:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:27:30.206537 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65160564-e6c8-4c1e-8418-bc23415834bc None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:30.224183 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:30.290026 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 524/1037] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:27:29 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 08:27:30.298615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218c53a-1f7d-4c4b-8266-9f0c782d6284 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:30.363516 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65160564-e6c8-4c1e-8418-bc23415834bc None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:30.407985 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:30.411833 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633b285-1474-4789-86a7-fc80d82d1340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:30.412456 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633b285-1474-4789-86a7-fc80d82d1340 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:30.412740 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633b285-1474-4789-86a7-fc80d82d1340 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:30.413017 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633b285-1474-4789-86a7-fc80d82d1340 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:30.413657 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633b285-1474-4789-86a7-fc80d82d1340 None admin] RBAC: Adding query filter params (type=image) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:30.413961 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633b285-1474-4789-86a7-fc80d82d1340 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:30.415375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633b285-1474-4789-86a7-fc80d82d1340 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:30.420977 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 514/1038] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:27:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:27:30.421627 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218c53a-1f7d-4c4b-8266-9f0c782d6284 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:30.427521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633b285-1474-4789-86a7-fc80d82d1340 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:30.468565 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7726df-4c4d-456e-ac19-77f6cec4e8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:30.469220 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7726df-4c4d-456e-ac19-77f6cec4e8bc None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:30.469545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7726df-4c4d-456e-ac19-77f6cec4e8bc None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:30.469798 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7726df-4c4d-456e-ac19-77f6cec4e8bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:30.481694 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7726df-4c4d-456e-ac19-77f6cec4e8bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:30.483275 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7726df-4c4d-456e-ac19-77f6cec4e8bc None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:30.500676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-be7726df-4c4d-456e-ac19-77f6cec4e8bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:27:30.500676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:30.500676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:30.500676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:30.500676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:30.500676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:30.500676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:30.500676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:30.500676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:30.500676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:30.500676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:30.500676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:30.500676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:27:30.500676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:27:30.500676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:27:30.500676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:27:30.501823 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:30.501823 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:30.501823 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:30.501823 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:30.501823 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:30.501823 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:30.501823 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:30.501823 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:30.501823 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:30.501823 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:30.501823 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:30.501823 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:30.501823 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:30.501823 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:30.501823 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:30.501823 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:30.501823 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:27:30.503597 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:27:30.503597 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:27:30.503597 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:30.503597 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 525/1039] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:27:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:27:30.510698 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7726df-4c4d-456e-ac19-77f6cec4e8bc None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:30.527429 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:30.559773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633b285-1474-4789-86a7-fc80d82d1340 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:30.626125 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077479f2-345a-4e10-8c5c-a324362d70cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:30.627086 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077479f2-345a-4e10-8c5c-a324362d70cb None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:30.628180 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077479f2-345a-4e10-8c5c-a324362d70cb None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:30.628667 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077479f2-345a-4e10-8c5c-a324362d70cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:30.630009 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077479f2-345a-4e10-8c5c-a324362d70cb None admin] RBAC: Adding query filter params (interface=public, service_id=7318ed85e67b4482be1a6b29d979f8bd, region_id=RegionOne) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:30.630573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077479f2-345a-4e10-8c5c-a324362d70cb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:30.632991 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077479f2-345a-4e10-8c5c-a324362d70cb None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:30.637358 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7726df-4c4d-456e-ac19-77f6cec4e8bc None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:30.642384 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 515/1040] 10.222.0.26 () {56 vars in 1251 bytes} [Sun Sep 11 08:27:30 2022] GET /identity/v3/endpoints?service_id=7318ed85e67b4482be1a6b29d979f8bd&interface=public®ion_id=RegionOne => generated 194 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:27:30.648647 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077479f2-345a-4e10-8c5c-a324362d70cb None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:30.693427 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318d0ee-6ca3-4160-bd6f-b001863b4ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:30.694488 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318d0ee-6ca3-4160-bd6f-b001863b4ddf None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:30.694949 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318d0ee-6ca3-4160-bd6f-b001863b4ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:30.695444 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318d0ee-6ca3-4160-bd6f-b001863b4ddf None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:30.696284 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7318d0ee-6ca3-4160-bd6f-b001863b4ddf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:30.696595 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7318d0ee-6ca3-4160-bd6f-b001863b4ddf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:30.698485 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7318d0ee-6ca3-4160-bd6f-b001863b4ddf None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:30.716704 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 526/1041] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:27:30.719116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318d0ee-6ca3-4160-bd6f-b001863b4ddf None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:30.722898 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:30.835530 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077479f2-345a-4e10-8c5c-a324362d70cb None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:30.872468 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318d0ee-6ca3-4160-bd6f-b001863b4ddf None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:30.900594 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ade640-39e4-41ef-b9f0-cadf7feb89e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:30.901543 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ade640-39e4-41ef-b9f0-cadf7feb89e2 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:30.901998 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ade640-39e4-41ef-b9f0-cadf7feb89e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:30.902454 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ade640-39e4-41ef-b9f0-cadf7feb89e2 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:30.903556 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ade640-39e4-41ef-b9f0-cadf7feb89e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:30.906488 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ade640-39e4-41ef-b9f0-cadf7feb89e2 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:30.915875 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671ef16-3c5a-496e-85d9-086760d9d8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:30.916532 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671ef16-3c5a-496e-85d9-086760d9d8d3 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:30.916807 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671ef16-3c5a-496e-85d9-086760d9d8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:30.917077 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671ef16-3c5a-496e-85d9-086760d9d8d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:30.927434 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 516/1042] 10.222.0.26 () {56 vars in 1087 bytes} [Sun Sep 11 08:27:30 2022] GET /identity/v3/services => generated 1957 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:27:30.936836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671ef16-3c5a-496e-85d9-086760d9d8d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:30.938330 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671ef16-3c5a-496e-85d9-086760d9d8d3 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:30.952048 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-a671ef16-3c5a-496e-85d9-086760d9d8d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:27:30.952048 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:30.952048 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:30.952048 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:30.952048 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:30.952048 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:30.952048 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:30.952048 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:30.952048 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:30.952048 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:30.952048 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:30.952048 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:30.952048 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:27:30.952048 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:27:30.952048 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:27:30.953263 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:27:30.953263 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:30.953263 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:30.953263 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:30.953263 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:30.953263 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:30.953263 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:30.953263 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:30.953263 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:30.953263 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:30.953263 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:30.953263 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:30.953263 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:30.953263 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:30.953263 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:30.953263 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:30.953263 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:30.954862 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:27:30.954862 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:27:30.954862 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:27:30.954862 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:27:30.954862 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:27:30.954862 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:27:30.954862 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:27:30.954862 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:30.954862 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 527/1043] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:27:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:27:30.961971 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ade640-39e4-41ef-b9f0-cadf7feb89e2 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:30.966799 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:31.141976 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ade640-39e4-41ef-b9f0-cadf7feb89e2 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:31.200952 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9fc00-164b-4559-9396-23b4fad3ab9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:31.201755 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9fc00-164b-4559-9396-23b4fad3ab9b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:31.202187 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9fc00-164b-4559-9396-23b4fad3ab9b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:31.202596 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9fc00-164b-4559-9396-23b4fad3ab9b None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:31.203990 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee9fc00-164b-4559-9396-23b4fad3ab9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:31.204471 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee9fc00-164b-4559-9396-23b4fad3ab9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:31.207386 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee9fc00-164b-4559-9396-23b4fad3ab9b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:31.227496 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 517/1044] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:27:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:27:31.234162 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671ef16-3c5a-496e-85d9-086760d9d8d3 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:31.307354 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:31.363881 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671ef16-3c5a-496e-85d9-086760d9d8d3 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:31.425813 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca4be7-5fa2-4b77-919a-2fbeb9bfaa1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:31.427138 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca4be7-5fa2-4b77-919a-2fbeb9bfaa1b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:31.427899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca4be7-5fa2-4b77-919a-2fbeb9bfaa1b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:31.428624 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca4be7-5fa2-4b77-919a-2fbeb9bfaa1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:31.430065 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca4be7-5fa2-4b77-919a-2fbeb9bfaa1b None admin] RBAC: Adding query filter params (role.id=f316277cb750448ab2bd8bc9125fa166, scope.project.id=b6ed5f989f4248d7bab2548eb350fe17, user.id=e62bb9d2e13649b5af239bb56001ce16) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:31.430908 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca4be7-5fa2-4b77-919a-2fbeb9bfaa1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:31.433804 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca4be7-5fa2-4b77-919a-2fbeb9bfaa1b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:31.445454 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 528/1045] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:27:31 2022] GET /identity/v3/role_assignments?user.id=e62bb9d2e13649b5af239bb56001ce16&scope.project.id=b6ed5f989f4248d7bab2548eb350fe17&role.id=f316277cb750448ab2bd8bc9125fa166 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:27:31.804233 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87023c-738c-46a3-9e36-e4f55641d565 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:31.804700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87023c-738c-46a3-9e36-e4f55641d565 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:31.804853 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87023c-738c-46a3-9e36-e4f55641d565 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:31.806274 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 518/1046] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:27:31.811989 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f064ba-e2d9-47a6-8b43-0cb5bf253474 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:31.812285 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f064ba-e2d9-47a6-8b43-0cb5bf253474 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:31.812540 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f064ba-e2d9-47a6-8b43-0cb5bf253474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:31.834735 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-56f064ba-e2d9-47a6-8b43-0cb5bf253474 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:31.835995 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-56f064ba-e2d9-47a6-8b43-0cb5bf253474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:31.930703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 529/1047] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:27:32.204369 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87023c-738c-46a3-9e36-e4f55641d565 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:32.277346 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:32.322930 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87023c-738c-46a3-9e36-e4f55641d565 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:32.365409 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a367e12-e749-402a-ae6f-db1ac931fdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:32.366078 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a367e12-e749-402a-ae6f-db1ac931fdef None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:32.366357 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a367e12-e749-402a-ae6f-db1ac931fdef None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:32.366633 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a367e12-e749-402a-ae6f-db1ac931fdef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:32.379026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a367e12-e749-402a-ae6f-db1ac931fdef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:27:32.384016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-6a367e12-e749-402a-ae6f-db1ac931fdef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:27:32.384016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:32.384016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:32.384016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:32.384016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:32.384016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:32.384016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:32.384016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:32.384016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:32.384016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:32.384016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:32.384016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:32.384016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:27:32.384016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:27:32.384016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:27:32.384016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:27:32.388230 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:27:32.388230 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:27:32.388230 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:27:32.388230 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:27:32.388230 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:32.388230 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:32.388230 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:32.388230 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:32.388230 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:32.388230 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:32.388230 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:32.388230 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:32.388230 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:32.388230 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:32.388230 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:32.388230 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:32.389089 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:32.389089 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:32.389089 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:32.389089 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:32.389089 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:27:32.389089 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:27:32.389089 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:27:32.389089 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:27:32.389089 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:27:32.389089 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:27:32.389089 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:27:32.389089 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:32.389089 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 519/1048] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:27:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:27:32.392941 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f064ba-e2d9-47a6-8b43-0cb5bf253474 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:32.465415 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:32.527679 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f064ba-e2d9-47a6-8b43-0cb5bf253474 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:32.569733 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2572f-5b9b-400f-9d74-7020441dd77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:32.570350 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2572f-5b9b-400f-9d74-7020441dd77e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:32.570627 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2572f-5b9b-400f-9d74-7020441dd77e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:32.570899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2572f-5b9b-400f-9d74-7020441dd77e None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:32.571614 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b2572f-5b9b-400f-9d74-7020441dd77e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:32.571913 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b2572f-5b9b-400f-9d74-7020441dd77e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:32.573305 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b2572f-5b9b-400f-9d74-7020441dd77e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:32.588488 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 530/1049] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:27:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:32.590452 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a367e12-e749-402a-ae6f-db1ac931fdef None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:32.729304 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a367e12-e749-402a-ae6f-db1ac931fdef None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:32.760780 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:32.775781 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fbe89-fc08-4d54-8e58-90283a4d97a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:32.776641 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fbe89-fc08-4d54-8e58-90283a4d97a7 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:32.777186 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fbe89-fc08-4d54-8e58-90283a4d97a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:32.777490 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fbe89-fc08-4d54-8e58-90283a4d97a7 None admin] PATH_INFO: `/v3/users/f257df1a6d4c40b29684e36ae1f614f4` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:32.804237 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fbe89-fc08-4d54-8e58-90283a4d97a7 None admin] RBAC: Authorizing `identity:get_user(user_id=f257df1a6d4c40b29684e36ae1f614f4)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:32.807030 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fbe89-fc08-4d54-8e58-90283a4d97a7 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:32.810322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 520/1050] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:27:32 2022] GET /identity/v3/users/f257df1a6d4c40b29684e36ae1f614f4 => generated 285 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:27:32.819272 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2572f-5b9b-400f-9d74-7020441dd77e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:32.984274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2572f-5b9b-400f-9d74-7020441dd77e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:33.005984 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:33.033678 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d3b17-44ea-41bb-baea-338119776d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:33.034807 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d3b17-44ea-41bb-baea-338119776d3c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:33.035312 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d3b17-44ea-41bb-baea-338119776d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:33.035785 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d3b17-44ea-41bb-baea-338119776d3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:33.123402 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d3b17-44ea-41bb-baea-338119776d3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:33.125484 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d3b17-44ea-41bb-baea-338119776d3c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:33.272576 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd411a7f-9505-4b59-bb7c-c482202c1ba3 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:33.273978 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd411a7f-9505-4b59-bb7c-c482202c1ba3 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:33.274921 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd411a7f-9505-4b59-bb7c-c482202c1ba3 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:33.277257 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 531/1051] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:27:32 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 08:27:33.279865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 521/1052] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:27:33.285195 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c39cf-0bba-4fe1-b67e-26e4cd1ffae9 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:33.285495 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c39cf-0bba-4fe1-b67e-26e4cd1ffae9 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:33.285780 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c39cf-0bba-4fe1-b67e-26e4cd1ffae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:33.287054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd411a7f-9505-4b59-bb7c-c482202c1ba3 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:33.304491 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2b6c39cf-0bba-4fe1-b67e-26e4cd1ffae9 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:33.305709 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2b6c39cf-0bba-4fe1-b67e-26e4cd1ffae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:33.320571 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:33.392144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 532/1053] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:27:33.458424 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd411a7f-9505-4b59-bb7c-c482202c1ba3 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:33.517317 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9783a-b545-4d1c-a36e-da8a80534bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:33.518742 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9783a-b545-4d1c-a36e-da8a80534bec None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:33.519479 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9783a-b545-4d1c-a36e-da8a80534bec None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:33.520161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9783a-b545-4d1c-a36e-da8a80534bec None admin] PATH_INFO: `/v3/projects/82ec8788616345ab8e227e06fc7d9a71` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:33.522193 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9783a-b545-4d1c-a36e-da8a80534bec None admin] RBAC: Authorizing `identity:get_project(project_id=82ec8788616345ab8e227e06fc7d9a71)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:33.525141 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9783a-b545-4d1c-a36e-da8a80534bec None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:33.528675 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 522/1054] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:27:33 2022] GET /identity/v3/projects/82ec8788616345ab8e227e06fc7d9a71 => generated 311 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:33.535070 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c39cf-0bba-4fe1-b67e-26e4cd1ffae9 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:33.660040 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9783a-b545-4d1c-a36e-da8a80534bec None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:33.666601 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c39cf-0bba-4fe1-b67e-26e4cd1ffae9 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:33.711140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7b020-5174-4090-b0e3-afa6dc471110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:33.711836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7b020-5174-4090-b0e3-afa6dc471110 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:33.712110 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7b020-5174-4090-b0e3-afa6dc471110 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:33.712379 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7b020-5174-4090-b0e3-afa6dc471110 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:33.713113 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e7b020-5174-4090-b0e3-afa6dc471110 None admin] RBAC: Adding query filter params (role.id=d12af9f1dfb344cd8a6a493e165030ba, scope.project.id=82ec8788616345ab8e227e06fc7d9a71, user.id=f257df1a6d4c40b29684e36ae1f614f4) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:33.713420 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e7b020-5174-4090-b0e3-afa6dc471110 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:33.714868 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e7b020-5174-4090-b0e3-afa6dc471110 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:33.719473 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:33.722544 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 533/1055] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:27:33 2022] GET /identity/v3/role_assignments?user.id=f257df1a6d4c40b29684e36ae1f614f4&scope.project.id=82ec8788616345ab8e227e06fc7d9a71&role.id=d12af9f1dfb344cd8a6a493e165030ba => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:33.725077 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d2714-98d0-47d4-90f2-35bd66ad43c8 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:33.737250 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d2714-98d0-47d4-90f2-35bd66ad43c8 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:33.737250 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d2714-98d0-47d4-90f2-35bd66ad43c8 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:33.737250 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 534/1056] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:27:33.737250 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a874bab-2ade-40be-b5ad-ee4f287603a1 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:33.737250 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a874bab-2ade-40be-b5ad-ee4f287603a1 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:33.737250 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a874bab-2ade-40be-b5ad-ee4f287603a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:33.759160 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-5a874bab-2ade-40be-b5ad-ee4f287603a1 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:33.760725 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5a874bab-2ade-40be-b5ad-ee4f287603a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:33.771276 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:33.787900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9783a-b545-4d1c-a36e-da8a80534bec None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:33.836636 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fc9b4-0879-4db4-94e4-1ddc29937ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:33.837338 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fc9b4-0879-4db4-94e4-1ddc29937ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:33.837626 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fc9b4-0879-4db4-94e4-1ddc29937ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:33.837902 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fc9b4-0879-4db4-94e4-1ddc29937ae8 None admin] PATH_INFO: `/v3/services/image` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:33.838501 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17fc9b4-0879-4db4-94e4-1ddc29937ae8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:33.840189 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17fc9b4-0879-4db4-94e4-1ddc29937ae8 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:33.852296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-c17fc9b4-0879-4db4-94e4-1ddc29937ae8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 08:27:33.852296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:33.852296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 08:27:33.852296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 08:27:33.852296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 08:27:33.852296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 08:27:33.852296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 08:27:33.852296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:27:33.852296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 08:27:33.852296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:33.852296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 08:27:33.852296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:33.852296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:33.852296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:33.852296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:33.852296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:33.852296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:33.853384 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:33.853384 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:33.853384 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:33.853384 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:33.853384 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:33.853384 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:33.853384 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 08:27:33.853384 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 08:27:33.853384 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 08:27:33.853384 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 08:27:33.853384 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:33.853384 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:33.853384 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:33.853384 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:33.853384 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:33.853384 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:33.854305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:33.854305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:33.854305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:33.854305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:33.854305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:33.854305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:33.854305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:33.854305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:33.854305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:33.854305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:33.854305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 08:27:33.854305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:27:33.854305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 08:27:33.854305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:33.854305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 523/1057] 10.222.0.26 () {56 vars in 1105 bytes} [Sun Sep 11 08:27:33 2022] GET /identity/v3/services/image => generated 86 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:27:33.863228 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 535/1058] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 08:27:33.863480 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fc9b4-0879-4db4-94e4-1ddc29937ae8 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:34.040331 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fc9b4-0879-4db4-94e4-1ddc29937ae8 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:34.065033 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:34.100035 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2a2c4-ec66-4870-ad19-b0e0a9e5341e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:34.101039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2a2c4-ec66-4870-ad19-b0e0a9e5341e None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:34.101495 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2a2c4-ec66-4870-ad19-b0e0a9e5341e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:34.101939 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2a2c4-ec66-4870-ad19-b0e0a9e5341e None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:34.103017 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b2a2c4-ec66-4870-ad19-b0e0a9e5341e None admin] RBAC: Adding query filter params (name=image) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:34.103570 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b2a2c4-ec66-4870-ad19-b0e0a9e5341e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:34.105993 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b2a2c4-ec66-4870-ad19-b0e0a9e5341e None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:34.120022 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 524/1059] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:27:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:34.121682 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a874bab-2ade-40be-b5ad-ee4f287603a1 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:34.286854 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a874bab-2ade-40be-b5ad-ee4f287603a1 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:34.346839 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2f5da-da4e-453c-a98a-5d218ce10806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:34.347827 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2f5da-da4e-453c-a98a-5d218ce10806 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:34.348326 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2f5da-da4e-453c-a98a-5d218ce10806 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:34.348804 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2f5da-da4e-453c-a98a-5d218ce10806 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:34.349931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2f5da-da4e-453c-a98a-5d218ce10806 None admin] RBAC: Adding query filter params (type=image) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:34.350471 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2f5da-da4e-453c-a98a-5d218ce10806 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:34.353039 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2f5da-da4e-453c-a98a-5d218ce10806 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:34.357572 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2a2c4-ec66-4870-ad19-b0e0a9e5341e None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:34.361666 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 536/1060] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:27:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:34.367653 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2f5da-da4e-453c-a98a-5d218ce10806 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:34.380820 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:34.498372 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2f5da-da4e-453c-a98a-5d218ce10806 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:34.511409 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2a2c4-ec66-4870-ad19-b0e0a9e5341e None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:34.547498 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d0021-a605-45ce-b42f-8e41d73dad19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:34.548123 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d0021-a605-45ce-b42f-8e41d73dad19 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:34.548405 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d0021-a605-45ce-b42f-8e41d73dad19 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:34.548688 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d0021-a605-45ce-b42f-8e41d73dad19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:34.549419 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d0021-a605-45ce-b42f-8e41d73dad19 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:34.551049 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d0021-a605-45ce-b42f-8e41d73dad19 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:34.559903 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29d8fa-8359-4be5-a047-5511e2ecd724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:34.560562 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29d8fa-8359-4be5-a047-5511e2ecd724 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:34.560855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29d8fa-8359-4be5-a047-5511e2ecd724 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:34.561128 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29d8fa-8359-4be5-a047-5511e2ecd724 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:34.576197 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29d8fa-8359-4be5-a047-5511e2ecd724 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:27:34.582362 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-7d29d8fa-8359-4be5-a047-5511e2ecd724 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 08:27:34.582362 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:34.582362 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:34.582362 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:34.582362 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:34.582362 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:34.582362 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:34.582362 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:34.582362 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:34.582362 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:34.582362 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:34.582362 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:34.582362 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:27:34.582362 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:27:34.582362 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:27:34.582362 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:27:34.584306 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:27:34.584306 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:27:34.584306 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:27:34.584306 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:27:34.584306 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:34.584306 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:34.584306 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:34.584306 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:34.584306 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:34.584306 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:34.584306 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:34.584306 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:34.584306 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:34.584306 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:34.584306 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:34.584306 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:34.586929 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:34.586929 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:34.586929 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:34.586929 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:34.586929 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:27:34.586929 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:27:34.586929 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:27:34.586929 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:27:34.586929 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:27:34.586929 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:27:34.586929 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 08:27:34.586929 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:34.586929 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 525/1061] 10.222.0.26 () {56 vars in 1120 bytes} [Sun Sep 11 08:27:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:27:34.590342 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29d8fa-8359-4be5-a047-5511e2ecd724 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:34.640154 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:34.647797 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 537/1062] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:27:34 2022] POST /identity/v3/endpoints => generated 327 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:27:34.733597 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29d8fa-8359-4be5-a047-5511e2ecd724 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:34.804611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411cc1d-771f-44c7-a46f-10c949e33300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:34.805539 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411cc1d-771f-44c7-a46f-10c949e33300 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:34.805991 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411cc1d-771f-44c7-a46f-10c949e33300 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:34.806423 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411cc1d-771f-44c7-a46f-10c949e33300 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:34.807560 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411cc1d-771f-44c7-a46f-10c949e33300 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:34.808053 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411cc1d-771f-44c7-a46f-10c949e33300 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:34.810379 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411cc1d-771f-44c7-a46f-10c949e33300 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:34.830360 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 526/1063] 10.222.0.26 () {56 vars in 1115 bytes} [Sun Sep 11 08:27:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:34.832267 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d0021-a605-45ce-b42f-8e41d73dad19 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:34.951818 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:35.019412 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d0021-a605-45ce-b42f-8e41d73dad19 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:35.082616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2ad23-91d7-453e-a4d5-0678a2df7f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:35.083730 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2ad23-91d7-453e-a4d5-0678a2df7f02 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:35.084234 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2ad23-91d7-453e-a4d5-0678a2df7f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:35.084746 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2ad23-91d7-453e-a4d5-0678a2df7f02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:35.100921 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2ad23-91d7-453e-a4d5-0678a2df7f02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:35.102682 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2ad23-91d7-453e-a4d5-0678a2df7f02 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:35.124106 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-0de2ad23-91d7-453e-a4d5-0678a2df7f02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:27:35.124106 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:35.124106 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:35.124106 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:35.124106 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:35.124106 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:35.124106 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:35.124106 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:35.124106 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:35.124106 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:35.124106 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:35.124106 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:35.124106 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:27:35.124106 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:27:35.124106 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:27:35.124106 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:27:35.131801 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:35.131801 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:35.131801 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:35.131801 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:35.131801 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:35.131801 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:35.131801 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:35.131801 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:35.131801 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:35.131801 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:35.131801 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:35.131801 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:35.131801 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:35.131801 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:35.131801 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:35.131801 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:35.131801 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:27:35.133879 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:27:35.133879 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:27:35.133879 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:35.133879 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 538/1064] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:27:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:27:35.139546 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411cc1d-771f-44c7-a46f-10c949e33300 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:35.280315 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:35.287031 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411cc1d-771f-44c7-a46f-10c949e33300 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:35.326707 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4a7a9-4c7b-4415-91bb-db32afe07aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:35.327683 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4a7a9-4c7b-4415-91bb-db32afe07aee None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:35.328035 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4a7a9-4c7b-4415-91bb-db32afe07aee None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:35.328699 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4a7a9-4c7b-4415-91bb-db32afe07aee None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:35.329516 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4a7a9-4c7b-4415-91bb-db32afe07aee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:35.329820 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4a7a9-4c7b-4415-91bb-db32afe07aee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:35.332901 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4a7a9-4c7b-4415-91bb-db32afe07aee None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:35.354714 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 527/1065] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:35.363379 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2ad23-91d7-453e-a4d5-0678a2df7f02 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:35.491352 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2ad23-91d7-453e-a4d5-0678a2df7f02 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:35.507345 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:35.530506 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907aba8-6271-47b0-afb3-c61143680551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:35.531167 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907aba8-6271-47b0-afb3-c61143680551 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:35.531525 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907aba8-6271-47b0-afb3-c61143680551 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:35.531776 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907aba8-6271-47b0-afb3-c61143680551 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:35.540738 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907aba8-6271-47b0-afb3-c61143680551 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:35.542250 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907aba8-6271-47b0-afb3-c61143680551 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:35.556107 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-5907aba8-6271-47b0-afb3-c61143680551 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 08:27:35.556107 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:35.556107 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:35.556107 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:35.556107 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:35.556107 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:35.556107 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:35.556107 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:35.556107 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:35.556107 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:35.556107 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:35.556107 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:35.556107 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:27:35.556107 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:27:35.556107 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:27:35.556107 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:27:35.563737 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:35.563737 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:35.563737 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:27:35.563737 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:27:35.563737 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:27:35.563737 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:27:35.563737 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:35.563737 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:35.563737 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:35.563737 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:35.563737 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:35.563737 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:35.563737 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:35.563737 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:35.563737 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:35.563737 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:35.563737 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:35.563737 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:35.565568 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:35.565568 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:35.565568 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:27:35.565568 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:27:35.565568 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:27:35.565568 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:27:35.565568 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:27:35.565568 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:27:35.565568 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 08:27:35.565568 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:35.565568 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 539/1066] 10.222.0.26 () {56 vars in 1093 bytes} [Sun Sep 11 08:27:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:27:35.568255 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4a7a9-4c7b-4415-91bb-db32afe07aee None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:35.748937 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4a7a9-4c7b-4415-91bb-db32afe07aee None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:35.813241 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a625c-bc4b-48e7-a670-4dd97a6b9ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:35.815181 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a625c-bc4b-48e7-a670-4dd97a6b9ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:35.815916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a625c-bc4b-48e7-a670-4dd97a6b9ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:35.816403 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a625c-bc4b-48e7-a670-4dd97a6b9ea9 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:35.817949 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a625c-bc4b-48e7-a670-4dd97a6b9ea9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:35.818729 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a625c-bc4b-48e7-a670-4dd97a6b9ea9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:35.821560 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a625c-bc4b-48e7-a670-4dd97a6b9ea9 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:35.853241 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 528/1067] 10.222.0.26 () {56 vars in 1133 bytes} [Sun Sep 11 08:27:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:35.863029 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907aba8-6271-47b0-afb3-c61143680551 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:35.972426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2a51b-b2e9-4cad-b9a4-fe7bfa2041ba None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:35.972732 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2a51b-b2e9-4cad-b9a4-fe7bfa2041ba None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:35.972978 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2a51b-b2e9-4cad-b9a4-fe7bfa2041ba None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:35.974353 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 529/1068] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:27:35.981470 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d854b53-41f0-478b-9a12-a18c87fc8a89 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:35.981768 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d854b53-41f0-478b-9a12-a18c87fc8a89 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:35.982051 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d854b53-41f0-478b-9a12-a18c87fc8a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:36.002672 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907aba8-6271-47b0-afb3-c61143680551 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:36.004375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-4d854b53-41f0-478b-9a12-a18c87fc8a89 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:36.006264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4d854b53-41f0-478b-9a12-a18c87fc8a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:36.018290 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:36.052477 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0de27-0976-4805-a5cf-98e91bc7fe2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:36.053458 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0de27-0976-4805-a5cf-98e91bc7fe2a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:36.053901 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0de27-0976-4805-a5cf-98e91bc7fe2a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:36.054326 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0de27-0976-4805-a5cf-98e91bc7fe2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:36.074256 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0de27-0976-4805-a5cf-98e91bc7fe2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:36.076662 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0de27-0976-4805-a5cf-98e91bc7fe2a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:36.100755 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 530/1069] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:27:36.102202 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-fea0de27-0976-4805-a5cf-98e91bc7fe2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:27:36.102202 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:36.102202 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:36.102202 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:36.102202 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:36.102202 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:36.102202 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:36.102202 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:36.102202 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:36.102202 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:36.102202 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:36.102202 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:36.102202 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:27:36.102202 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:27:36.102202 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:27:36.102202 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:27:36.103899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:36.103899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:36.103899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:36.103899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:36.103899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:36.103899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:36.103899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:36.103899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:36.103899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:36.103899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:36.103899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:36.103899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:36.103899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:36.103899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:36.103899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:36.103899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:36.103899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:27:36.104969 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:27:36.104969 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:27:36.104969 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:36.104969 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 540/1070] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:27:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:27:36.110143 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d854b53-41f0-478b-9a12-a18c87fc8a89 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:36.280648 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d854b53-41f0-478b-9a12-a18c87fc8a89 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:36.338619 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d1d4e-6ec1-48e6-a6d8-882d693885e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:36.339701 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d1d4e-6ec1-48e6-a6d8-882d693885e5 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:36.340137 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d1d4e-6ec1-48e6-a6d8-882d693885e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:36.340591 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d1d4e-6ec1-48e6-a6d8-882d693885e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:36.341402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d1d4e-6ec1-48e6-a6d8-882d693885e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:36.341840 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d1d4e-6ec1-48e6-a6d8-882d693885e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:36.343413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d1d4e-6ec1-48e6-a6d8-882d693885e5 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:36.364848 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 531/1071] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:36.367976 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0de27-0976-4805-a5cf-98e91bc7fe2a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:36.380528 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d1d4e-6ec1-48e6-a6d8-882d693885e5 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:36.384805 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:36.401837 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:36.507382 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0de27-0976-4805-a5cf-98e91bc7fe2a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:36.512466 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d1d4e-6ec1-48e6-a6d8-882d693885e5 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:36.550885 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e201f74-9af5-422f-b82c-f9de30d58039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:36.551576 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e201f74-9af5-422f-b82c-f9de30d58039 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:36.551853 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e201f74-9af5-422f-b82c-f9de30d58039 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:36.552124 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e201f74-9af5-422f-b82c-f9de30d58039 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:36.554686 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b4ae6-88e2-418e-965d-179a5d25da2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:36.555556 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b4ae6-88e2-418e-965d-179a5d25da2f None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:36.555837 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b4ae6-88e2-418e-965d-179a5d25da2f None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:36.555992 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b4ae6-88e2-418e-965d-179a5d25da2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:36.561459 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e201f74-9af5-422f-b82c-f9de30d58039 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:36.562960 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e201f74-9af5-422f-b82c-f9de30d58039 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:36.569958 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b4ae6-88e2-418e-965d-179a5d25da2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:27:36.575324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-2f6b4ae6-88e2-418e-965d-179a5d25da2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:27:36.575324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:36.575324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:36.575324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:36.575324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:36.575324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:36.575324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:36.575324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:36.575324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:36.575324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:36.575324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:36.575324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:36.575324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:27:36.575324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:27:36.575324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:27:36.575324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:27:36.576356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:27:36.576356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:27:36.576356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:27:36.576356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:27:36.576356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:36.576356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:36.576356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:36.576356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:36.576356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:36.576356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:36.576356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:36.576356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:36.576356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:36.576356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:36.576356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:36.576356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:36.577313 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:36.577313 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:36.577313 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:36.577313 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:36.577313 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:27:36.577313 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:27:36.577313 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:27:36.577313 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:27:36.577313 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:27:36.577313 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:27:36.577313 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:27:36.577313 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:36.578008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-0e201f74-9af5-422f-b82c-f9de30d58039 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:27:36.578008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:36.578008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:36.578008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:36.578008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:36.578008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:36.578008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:36.578008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:36.578008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:36.578008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:36.578008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:36.578008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:36.578008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:27:36.578008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:27:36.578008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:27:36.579208 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:27:36.579208 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:36.579208 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:36.579208 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:36.579208 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:36.579208 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:36.579208 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:36.579208 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:36.579208 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:36.579208 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:36.579208 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:36.579208 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:36.579208 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:36.579208 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:36.579208 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:36.579208 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:36.579208 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:36.582673 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:27:36.582673 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:27:36.582673 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:27:36.582673 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:27:36.582673 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:27:36.582673 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:27:36.582673 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:27:36.582673 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:36.584383 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 532/1072] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:27:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:27:36.584383 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b4ae6-88e2-418e-965d-179a5d25da2f None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:36.584681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 541/1073] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:27:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:27:36.585344 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e201f74-9af5-422f-b82c-f9de30d58039 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:36.666627 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:36.700592 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:36.718338 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e201f74-9af5-422f-b82c-f9de30d58039 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:36.719639 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b4ae6-88e2-418e-965d-179a5d25da2f None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:36.757893 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908765f-54b6-4cd5-bf2c-07fd70bfc1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:36.758631 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908765f-54b6-4cd5-bf2c-07fd70bfc1b9 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:36.758914 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908765f-54b6-4cd5-bf2c-07fd70bfc1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:36.759030 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94c171-bd9e-474b-9d6b-81d2a9ba97a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:36.759271 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908765f-54b6-4cd5-bf2c-07fd70bfc1b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:36.759571 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94c171-bd9e-474b-9d6b-81d2a9ba97a8 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:36.759852 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94c171-bd9e-474b-9d6b-81d2a9ba97a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:36.760087 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c908765f-54b6-4cd5-bf2c-07fd70bfc1b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:36.760216 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94c171-bd9e-474b-9d6b-81d2a9ba97a8 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:36.760421 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c908765f-54b6-4cd5-bf2c-07fd70bfc1b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:36.760819 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a94c171-bd9e-474b-9d6b-81d2a9ba97a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:36.761125 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a94c171-bd9e-474b-9d6b-81d2a9ba97a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:36.762315 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c908765f-54b6-4cd5-bf2c-07fd70bfc1b9 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:36.762551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a94c171-bd9e-474b-9d6b-81d2a9ba97a8 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:36.772296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 533/1074] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:27:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:27:36.781774 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 542/1075] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:27:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:36.781973 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908765f-54b6-4cd5-bf2c-07fd70bfc1b9 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:36.782904 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94c171-bd9e-474b-9d6b-81d2a9ba97a8 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:36.910906 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94c171-bd9e-474b-9d6b-81d2a9ba97a8 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:36.938296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908765f-54b6-4cd5-bf2c-07fd70bfc1b9 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:36.956494 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101c050-be74-4c09-8e7e-186c255c1691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:36.957173 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101c050-be74-4c09-8e7e-186c255c1691 None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:36.957452 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101c050-be74-4c09-8e7e-186c255c1691 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:36.957729 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101c050-be74-4c09-8e7e-186c255c1691 None admin] PATH_INFO: `/v3/projects/b6ed5f989f4248d7bab2548eb350fe17/users/e62bb9d2e13649b5af239bb56001ce16/roles/f316277cb750448ab2bd8bc9125fa166` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:36.959985 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101c050-be74-4c09-8e7e-186c255c1691 None admin] RBAC: Authorizing `identity:create_grant(project_id=b6ed5f989f4248d7bab2548eb350fe17, user_id=e62bb9d2e13649b5af239bb56001ce16, role_id=f316277cb750448ab2bd8bc9125fa166)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:36.961483 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101c050-be74-4c09-8e7e-186c255c1691 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:36.976294 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:36.985544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247e6c7-9679-4b08-b108-930655557f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:36.986214 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247e6c7-9679-4b08-b108-930655557f47 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:36.986502 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247e6c7-9679-4b08-b108-930655557f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:36.986773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247e6c7-9679-4b08-b108-930655557f47 None admin] PATH_INFO: `/v3/users/f257df1a6d4c40b29684e36ae1f614f4` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:36.987951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247e6c7-9679-4b08-b108-930655557f47 None admin] RBAC: Authorizing `identity:get_user(user_id=f257df1a6d4c40b29684e36ae1f614f4)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:36.989396 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247e6c7-9679-4b08-b108-930655557f47 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:36.990983 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 534/1076] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:27:36 2022] GET /identity/v3/users/f257df1a6d4c40b29684e36ae1f614f4 => generated 285 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:36.992191 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34e203-3058-4035-a796-8fdfe531bcef None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:36.992475 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34e203-3058-4035-a796-8fdfe531bcef None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:36.992745 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34e203-3058-4035-a796-8fdfe531bcef None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:36.993959 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 535/1077] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:27:36.997920 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34e203-3058-4035-a796-8fdfe531bcef None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:37.048050 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 543/1078] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Sep 11 08:27:36 2022] PUT /identity/v3/projects/b6ed5f989f4248d7bab2548eb350fe17/users/e62bb9d2e13649b5af239bb56001ce16/roles/f316277cb750448ab2bd8bc9125fa166 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:27:37.049999 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84046772-ecdd-4ba2-afae-15634451ad88 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:37.050339 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84046772-ecdd-4ba2-afae-15634451ad88 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:37.050630 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84046772-ecdd-4ba2-afae-15634451ad88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:37.071796 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:37.078892 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-84046772-ecdd-4ba2-afae-15634451ad88 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:37.080274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-84046772-ecdd-4ba2-afae-15634451ad88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:37.119464 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34e203-3058-4035-a796-8fdfe531bcef None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:37.161691 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28853c68-234f-48ba-95c9-4547a247a493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:37.162383 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28853c68-234f-48ba-95c9-4547a247a493 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:37.162645 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28853c68-234f-48ba-95c9-4547a247a493 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:37.162919 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28853c68-234f-48ba-95c9-4547a247a493 None admin] PATH_INFO: `/v3/projects/82ec8788616345ab8e227e06fc7d9a71` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:37.164302 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28853c68-234f-48ba-95c9-4547a247a493 None admin] RBAC: Authorizing `identity:get_project(project_id=82ec8788616345ab8e227e06fc7d9a71)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:37.165792 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28853c68-234f-48ba-95c9-4547a247a493 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:37.167724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 536/1079] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:27:36 2022] GET /identity/v3/projects/82ec8788616345ab8e227e06fc7d9a71 => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:27:37.171664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 544/1080] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:27:37.174453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28853c68-234f-48ba-95c9-4547a247a493 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:37.273855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:37.317602 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28853c68-234f-48ba-95c9-4547a247a493 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:37.358096 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92027511-f0bd-4a61-8176-4643c2cabeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:37.358768 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92027511-f0bd-4a61-8176-4643c2cabeb1 None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:37.359042 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92027511-f0bd-4a61-8176-4643c2cabeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:37.359353 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92027511-f0bd-4a61-8176-4643c2cabeb1 None admin] PATH_INFO: `/v3/projects/82ec8788616345ab8e227e06fc7d9a71/users/f257df1a6d4c40b29684e36ae1f614f4/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:37.361390 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92027511-f0bd-4a61-8176-4643c2cabeb1 None admin] RBAC: Authorizing `identity:create_grant(project_id=82ec8788616345ab8e227e06fc7d9a71, user_id=f257df1a6d4c40b29684e36ae1f614f4, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:37.362828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92027511-f0bd-4a61-8176-4643c2cabeb1 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:37.428794 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 537/1081] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Sep 11 08:27:37 2022] PUT /identity/v3/projects/82ec8788616345ab8e227e06fc7d9a71/users/f257df1a6d4c40b29684e36ae1f614f4/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:27:37.436746 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84046772-ecdd-4ba2-afae-15634451ad88 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:37.569474 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84046772-ecdd-4ba2-afae-15634451ad88 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:37.613111 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2b3c5-f2ef-4e8e-9fe6-908f13103e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:37.613739 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2b3c5-f2ef-4e8e-9fe6-908f13103e6d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:37.614018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2b3c5-f2ef-4e8e-9fe6-908f13103e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:37.614294 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2b3c5-f2ef-4e8e-9fe6-908f13103e6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:37.618655 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:37.705833 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2b3c5-f2ef-4e8e-9fe6-908f13103e6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:37.707411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2b3c5-f2ef-4e8e-9fe6-908f13103e6d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:37.843391 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 545/1082] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:27:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 08:27:37.848466 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92027511-f0bd-4a61-8176-4643c2cabeb1 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:38.007511 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92027511-f0bd-4a61-8176-4643c2cabeb1 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:38.044895 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:38.068431 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2d8ac-3405-4169-b2e7-be8522e96f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:38.069228 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2d8ac-3405-4169-b2e7-be8522e96f0d None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:38.069614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2d8ac-3405-4169-b2e7-be8522e96f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:38.069991 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2d8ac-3405-4169-b2e7-be8522e96f0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:38.082960 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d2d8ac-3405-4169-b2e7-be8522e96f0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:38.084594 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d2d8ac-3405-4169-b2e7-be8522e96f0d None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:38.100613 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-f5d2d8ac-3405-4169-b2e7-be8522e96f0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:27:38.100613 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:38.100613 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:38.100613 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:38.100613 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:38.100613 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:38.100613 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:38.100613 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:38.100613 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:38.100613 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:38.100613 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:38.100613 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:38.100613 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:27:38.100613 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:27:38.100613 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:27:38.100613 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:27:38.101902 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:38.101902 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:38.101902 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:38.101902 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:38.101902 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:38.101902 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:38.101902 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:38.101902 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:38.101902 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:38.101902 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:38.101902 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:38.101902 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:38.101902 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:38.101902 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:38.101902 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:38.101902 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:38.101902 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:27:38.103160 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:27:38.103160 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:27:38.103160 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:38.107594 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 538/1083] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:27:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:27:38.109071 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2b3c5-f2ef-4e8e-9fe6-908f13103e6d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:38.147830 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:38.225151 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2b3c5-f2ef-4e8e-9fe6-908f13103e6d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:38.260237 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ad291-265a-4f93-8c99-cdc6dd41b58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:38.260850 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ad291-265a-4f93-8c99-cdc6dd41b58a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:38.261128 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ad291-265a-4f93-8c99-cdc6dd41b58a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:38.261400 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ad291-265a-4f93-8c99-cdc6dd41b58a None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:38.262042 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ad291-265a-4f93-8c99-cdc6dd41b58a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:38.262342 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ad291-265a-4f93-8c99-cdc6dd41b58a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:38.263811 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ad291-265a-4f93-8c99-cdc6dd41b58a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:38.283542 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 546/1084] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:39.290178 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4b6e7-6a1b-49c2-a706-8b6eda059b0b None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:39.290733 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4b6e7-6a1b-49c2-a706-8b6eda059b0b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:39.290733 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4b6e7-6a1b-49c2-a706-8b6eda059b0b None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:39.292168 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 539/1085] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:27:39.297863 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21a1df-4a9b-4b5f-acb8-2c0c4ee30f1d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:39.298370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21a1df-4a9b-4b5f-acb8-2c0c4ee30f1d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:39.298458 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21a1df-4a9b-4b5f-acb8-2c0c4ee30f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:39.318120 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-6f21a1df-4a9b-4b5f-acb8-2c0c4ee30f1d None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:39.319349 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6f21a1df-4a9b-4b5f-acb8-2c0c4ee30f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:39.389863 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 547/1086] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:27:39.658561 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4b6e7-6a1b-49c2-a706-8b6eda059b0b None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:39.668674 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d04705-5519-46a1-8abb-064893ab05fe None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:39.668971 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d04705-5519-46a1-8abb-064893ab05fe None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:39.669249 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d04705-5519-46a1-8abb-064893ab05fe None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:39.670863 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 548/1087] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:27:39.677729 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44753456-feee-4a2b-b99c-64a5055b1d81 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:39.678084 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44753456-feee-4a2b-b99c-64a5055b1d81 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:39.678507 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44753456-feee-4a2b-b99c-64a5055b1d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:39.698347 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-44753456-feee-4a2b-b99c-64a5055b1d81 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:39.699557 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-44753456-feee-4a2b-b99c-64a5055b1d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:39.721125 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:39.773364 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4b6e7-6a1b-49c2-a706-8b6eda059b0b None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:39.775317 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 549/1088] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 08:27:39.809583 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d06cd-ed2f-4b29-84b9-3b0856c9ccfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:39.810219 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d06cd-ed2f-4b29-84b9-3b0856c9ccfc None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:39.810496 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d06cd-ed2f-4b29-84b9-3b0856c9ccfc None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:39.810769 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d06cd-ed2f-4b29-84b9-3b0856c9ccfc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:39.821872 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d06cd-ed2f-4b29-84b9-3b0856c9ccfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:27:39.826795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-9b0d06cd-ed2f-4b29-84b9-3b0856c9ccfc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 08:27:39.826795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:39.826795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:39.826795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:39.826795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:39.826795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:39.826795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:39.826795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:39.826795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:39.826795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:39.826795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:39.826795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:39.826795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:27:39.826795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:27:39.826795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:27:39.826795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:27:39.828782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:27:39.828782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:27:39.828782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:27:39.828782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:27:39.828782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:39.828782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:39.828782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:39.828782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:39.828782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:39.828782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:39.828782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:39.828782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:39.828782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:39.828782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:39.828782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:39.828782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:39.829802 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:39.829802 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:39.829802 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:39.829802 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:39.829802 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:27:39.829802 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:27:39.829802 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:27:39.829802 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:27:39.829802 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:27:39.829802 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:27:39.829802 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 08:27:39.829802 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:39.829802 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 540/1089] 10.222.0.26 () {56 vars in 1120 bytes} [Sun Sep 11 08:27:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:27:39.834228 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44753456-feee-4a2b-b99c-64a5055b1d81 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:39.939923 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44753456-feee-4a2b-b99c-64a5055b1d81 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:39.978813 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d6ae8-818b-4feb-8ac4-723863f561c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:39.979483 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d6ae8-818b-4feb-8ac4-723863f561c6 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:39.979764 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d6ae8-818b-4feb-8ac4-723863f561c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:39.980037 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d6ae8-818b-4feb-8ac4-723863f561c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:39.980735 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d6ae8-818b-4feb-8ac4-723863f561c6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:39.981042 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d6ae8-818b-4feb-8ac4-723863f561c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:39.982466 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d6ae8-818b-4feb-8ac4-723863f561c6 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:39.992825 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 550/1090] 10.222.0.26 () {56 vars in 1115 bytes} [Sun Sep 11 08:27:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:39.998767 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d06cd-ed2f-4b29-84b9-3b0856c9ccfc None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:40.036173 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:40.045772 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d6ae8-818b-4feb-8ac4-723863f561c6 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:40.067412 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:40.111494 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d06cd-ed2f-4b29-84b9-3b0856c9ccfc None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:40.146696 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689b066-7933-48ef-987f-ec01c7683812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:40.147369 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689b066-7933-48ef-987f-ec01c7683812 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:40.147650 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689b066-7933-48ef-987f-ec01c7683812 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:40.147922 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689b066-7933-48ef-987f-ec01c7683812 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:40.159470 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689b066-7933-48ef-987f-ec01c7683812 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:40.160911 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689b066-7933-48ef-987f-ec01c7683812 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:40.169038 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d6ae8-818b-4feb-8ac4-723863f561c6 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:40.175601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-3689b066-7933-48ef-987f-ec01c7683812 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:27:40.175601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:40.175601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:40.175601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:40.175601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:40.175601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:40.175601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:40.175601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:40.175601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:40.175601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:40.175601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:40.175601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:40.175601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:27:40.175601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:27:40.175601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:27:40.175601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:27:40.176659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:40.176659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:40.176659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:40.176659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:40.176659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:40.176659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:40.176659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:40.176659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:40.176659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:40.176659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:40.176659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:40.176659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:40.176659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:40.176659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:40.176659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:40.176659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:40.176659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:27:40.178041 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:27:40.178041 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:27:40.178041 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:40.178041 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 541/1091] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:27:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:27:40.182439 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689b066-7933-48ef-987f-ec01c7683812 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:40.207666 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c9410-08ce-46ca-b80d-a3f367c1c42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:40.208216 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c9410-08ce-46ca-b80d-a3f367c1c42e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:40.208491 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c9410-08ce-46ca-b80d-a3f367c1c42e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:40.208770 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c9410-08ce-46ca-b80d-a3f367c1c42e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:40.219635 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c9410-08ce-46ca-b80d-a3f367c1c42e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:27:40.225058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-792c9410-08ce-46ca-b80d-a3f367c1c42e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:27:40.225058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:40.225058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:40.225058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:40.225058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:40.225058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:40.225058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:40.225058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:40.225058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:40.225058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:40.225058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:40.225058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:40.225058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:27:40.225058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:27:40.225058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:27:40.225058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:27:40.226064 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:27:40.226064 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:27:40.226064 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:27:40.226064 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:27:40.226064 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:40.226064 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:40.226064 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:40.226064 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:40.226064 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:40.226064 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:40.226064 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:40.226064 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:40.226064 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:40.226064 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:40.226064 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:40.226064 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:40.227357 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:40.227357 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:40.227357 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:40.227357 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:40.227357 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:27:40.227357 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:27:40.227357 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:27:40.227357 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:27:40.227357 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:27:40.227357 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:27:40.227357 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:27:40.227357 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:27:40.227357 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 551/1092] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:27:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:27:40.232319 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c9410-08ce-46ca-b80d-a3f367c1c42e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:40.268885 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:40.284334 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689b066-7933-48ef-987f-ec01c7683812 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:40.310485 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:40.319819 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749a9e4-35e7-4e9e-8dd8-fdc366f41fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:40.320442 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749a9e4-35e7-4e9e-8dd8-fdc366f41fdb None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:40.320719 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749a9e4-35e7-4e9e-8dd8-fdc366f41fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:40.320989 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749a9e4-35e7-4e9e-8dd8-fdc366f41fdb None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:40.321635 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749a9e4-35e7-4e9e-8dd8-fdc366f41fdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:40.321937 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749a9e4-35e7-4e9e-8dd8-fdc366f41fdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:40.323330 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749a9e4-35e7-4e9e-8dd8-fdc366f41fdb None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:40.332297 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c9410-08ce-46ca-b80d-a3f367c1c42e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:40.336045 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 542/1093] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:27:40.341869 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749a9e4-35e7-4e9e-8dd8-fdc366f41fdb None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:40.366660 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bde69e-a20e-474b-9fb4-b8d819818be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:40.367298 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bde69e-a20e-474b-9fb4-b8d819818be9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:40.367581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bde69e-a20e-474b-9fb4-b8d819818be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:40.367859 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bde69e-a20e-474b-9fb4-b8d819818be9 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:40.368530 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bde69e-a20e-474b-9fb4-b8d819818be9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:40.368834 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bde69e-a20e-474b-9fb4-b8d819818be9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:40.370210 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bde69e-a20e-474b-9fb4-b8d819818be9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:40.379702 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 552/1094] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:27:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:27:40.386112 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bde69e-a20e-474b-9fb4-b8d819818be9 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:40.445780 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749a9e4-35e7-4e9e-8dd8-fdc366f41fdb None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:40.480715 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ecd3a-1a0d-411a-811d-2ee6bac506e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:40.481354 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ecd3a-1a0d-411a-811d-2ee6bac506e9 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:40.481677 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ecd3a-1a0d-411a-811d-2ee6bac506e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:40.481904 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ecd3a-1a0d-411a-811d-2ee6bac506e9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:40.488670 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bde69e-a20e-474b-9fb4-b8d819818be9 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:40.489523 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ecd3a-1a0d-411a-811d-2ee6bac506e9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:40.490969 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ecd3a-1a0d-411a-811d-2ee6bac506e9 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:40.503430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-348ecd3a-1a0d-411a-811d-2ee6bac506e9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 08:27:40.503430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:40.503430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:40.503430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:40.503430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:40.503430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:40.503430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:40.503430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:40.503430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:40.503430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:40.503430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:40.503430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:40.503430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:27:40.503430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:27:40.503430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:27:40.503430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:27:40.504514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:40.504514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:40.504514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:27:40.504514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:27:40.504514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:27:40.504514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:27:40.504514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:40.504514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:40.504514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:40.504514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:40.504514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:40.504514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:40.504514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:40.504514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:40.504514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:40.504514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:40.504514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:40.504514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:40.505621 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:40.505621 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:40.505621 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:27:40.505621 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:27:40.505621 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:27:40.505621 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:27:40.505621 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:27:40.505621 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:27:40.505621 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 08:27:40.505621 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:40.505621 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 543/1095] 10.222.0.26 () {56 vars in 1093 bytes} [Sun Sep 11 08:27:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:27:40.510561 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ecd3a-1a0d-411a-811d-2ee6bac506e9 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:40.520354 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:40.526518 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d0cea-dbb0-4b39-860b-d4a278ce9842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:40.527169 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d0cea-dbb0-4b39-860b-d4a278ce9842 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:40.527514 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d0cea-dbb0-4b39-860b-d4a278ce9842 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:40.528534 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d0cea-dbb0-4b39-860b-d4a278ce9842 None admin] PATH_INFO: `/v3/users/f257df1a6d4c40b29684e36ae1f614f4` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:40.529012 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d0cea-dbb0-4b39-860b-d4a278ce9842 None admin] RBAC: Authorizing `identity:get_user(user_id=f257df1a6d4c40b29684e36ae1f614f4)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:40.530462 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d0cea-dbb0-4b39-860b-d4a278ce9842 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:40.532081 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 553/1096] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:27:40 2022] GET /identity/v3/users/f257df1a6d4c40b29684e36ae1f614f4 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:40.537915 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d0cea-dbb0-4b39-860b-d4a278ce9842 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:40.550134 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:40.616060 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ecd3a-1a0d-411a-811d-2ee6bac506e9 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:40.653664 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee942a1-4182-494d-abba-e62a1661dda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:40.653664 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee942a1-4182-494d-abba-e62a1661dda8 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:40.653664 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee942a1-4182-494d-abba-e62a1661dda8 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:40.654087 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee942a1-4182-494d-abba-e62a1661dda8 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:40.654577 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee942a1-4182-494d-abba-e62a1661dda8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:40.654884 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee942a1-4182-494d-abba-e62a1661dda8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:40.656355 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee942a1-4182-494d-abba-e62a1661dda8 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:40.674186 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d0cea-dbb0-4b39-860b-d4a278ce9842 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:40.675862 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 544/1097] 10.222.0.26 () {56 vars in 1133 bytes} [Sun Sep 11 08:27:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:27:40.681794 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee942a1-4182-494d-abba-e62a1661dda8 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:40.715688 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914d1e8-2a10-426d-bfd2-66450d96d6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:40.716293 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914d1e8-2a10-426d-bfd2-66450d96d6f3 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:40.716569 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914d1e8-2a10-426d-bfd2-66450d96d6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:40.716841 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914d1e8-2a10-426d-bfd2-66450d96d6f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:40.744032 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:40.783066 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914d1e8-2a10-426d-bfd2-66450d96d6f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:40.784563 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914d1e8-2a10-426d-bfd2-66450d96d6f3 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:40.784787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee942a1-4182-494d-abba-e62a1661dda8 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:40.795038 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:40.821700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6059b-faf6-4820-ac62-40e3a61f0e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:40.822305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6059b-faf6-4820-ac62-40e3a61f0e19 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:40.822583 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6059b-faf6-4820-ac62-40e3a61f0e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:40.822856 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6059b-faf6-4820-ac62-40e3a61f0e19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:40.889937 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 554/1098] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:27:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 11 08:27:40.895846 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914d1e8-2a10-426d-bfd2-66450d96d6f3 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:40.896260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6059b-faf6-4820-ac62-40e3a61f0e19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:40.897714 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6059b-faf6-4820-ac62-40e3a61f0e19 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:40.979686 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:40.999365 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914d1e8-2a10-426d-bfd2-66450d96d6f3 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:41.009407 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:41.033980 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936fd9c7-2a6e-4405-bb18-cfea9f1dbfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:41.034786 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fd9c7-2a6e-4405-bb18-cfea9f1dbfe8 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:41.035126 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fd9c7-2a6e-4405-bb18-cfea9f1dbfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:41.035517 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fd9c7-2a6e-4405-bb18-cfea9f1dbfe8 None admin] PATH_INFO: `/v3/projects/82ec8788616345ab8e227e06fc7d9a71` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:41.036752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936fd9c7-2a6e-4405-bb18-cfea9f1dbfe8 None admin] RBAC: Authorizing `identity:get_project(project_id=82ec8788616345ab8e227e06fc7d9a71)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:41.038582 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936fd9c7-2a6e-4405-bb18-cfea9f1dbfe8 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:41.040418 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 555/1099] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:27:40 2022] GET /identity/v3/projects/82ec8788616345ab8e227e06fc7d9a71 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:41.043801 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 545/1100] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:27:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 11 08:27:41.046934 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936fd9c7-2a6e-4405-bb18-cfea9f1dbfe8 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:41.050657 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6059b-faf6-4820-ac62-40e3a61f0e19 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:41.152451 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936fd9c7-2a6e-4405-bb18-cfea9f1dbfe8 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:41.171467 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6059b-faf6-4820-ac62-40e3a61f0e19 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:41.188552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce6898-bcf9-4e32-9446-71d4562a7a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:41.189928 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce6898-bcf9-4e32-9446-71d4562a7a89 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:41.190212 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce6898-bcf9-4e32-9446-71d4562a7a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:41.190489 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce6898-bcf9-4e32-9446-71d4562a7a89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:41.191372 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce6898-bcf9-4e32-9446-71d4562a7a89 None admin] RBAC: Adding query filter params (role.id=d12af9f1dfb344cd8a6a493e165030ba, scope.project.id=82ec8788616345ab8e227e06fc7d9a71, user.id=f257df1a6d4c40b29684e36ae1f614f4) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:41.191804 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce6898-bcf9-4e32-9446-71d4562a7a89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:41.193510 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce6898-bcf9-4e32-9446-71d4562a7a89 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:41.200771 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 556/1101] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:27:41 2022] GET /identity/v3/role_assignments?user.id=f257df1a6d4c40b29684e36ae1f614f4&scope.project.id=82ec8788616345ab8e227e06fc7d9a71&role.id=d12af9f1dfb344cd8a6a493e165030ba => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:27:41.209874 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a6855-c043-4b3e-a305-a51f884d1b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:41.210540 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a6855-c043-4b3e-a305-a51f884d1b1a None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:41.210820 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a6855-c043-4b3e-a305-a51f884d1b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:41.211092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a6855-c043-4b3e-a305-a51f884d1b1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:41.223886 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a6855-c043-4b3e-a305-a51f884d1b1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:41.225394 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a6855-c043-4b3e-a305-a51f884d1b1a None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:41.247057 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-477a6855-c043-4b3e-a305-a51f884d1b1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:27:41.247057 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:41.247057 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:41.247057 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:41.247057 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:41.247057 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:41.247057 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:41.247057 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:41.247057 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:41.247057 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:41.247057 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:41.247057 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:41.247057 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:27:41.247057 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:27:41.247057 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:27:41.247057 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:27:41.248614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:41.248614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:41.248614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:41.248614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:41.248614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:41.248614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:41.248614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:41.248614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:41.248614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:41.248614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:41.248614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:41.248614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:41.248614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:41.248614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:41.248614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:41.248614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:41.248614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:27:41.249579 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:27:41.249579 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:27:41.249579 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:41.249579 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 546/1102] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:27:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:27:41.254357 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce6898-bcf9-4e32-9446-71d4562a7a89 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:41.304661 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:41.370607 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce6898-bcf9-4e32-9446-71d4562a7a89 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:41.410798 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effe991-5c55-4cf6-9d9d-664dd3ee5e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:41.411448 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effe991-5c55-4cf6-9d9d-664dd3ee5e25 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:41.411722 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effe991-5c55-4cf6-9d9d-664dd3ee5e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:41.412038 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effe991-5c55-4cf6-9d9d-664dd3ee5e25 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:41.412641 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effe991-5c55-4cf6-9d9d-664dd3ee5e25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:41.412951 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effe991-5c55-4cf6-9d9d-664dd3ee5e25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:41.414325 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effe991-5c55-4cf6-9d9d-664dd3ee5e25 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:41.427744 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 557/1103] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:41.433049 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a6855-c043-4b3e-a305-a51f884d1b1a None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:41.452439 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:41.540636 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a6855-c043-4b3e-a305-a51f884d1b1a None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:41.574902 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87cfe3-9096-4507-bab7-2e21255bf636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:41.575571 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87cfe3-9096-4507-bab7-2e21255bf636 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:41.575853 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87cfe3-9096-4507-bab7-2e21255bf636 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:41.576129 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87cfe3-9096-4507-bab7-2e21255bf636 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:41.584124 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87cfe3-9096-4507-bab7-2e21255bf636 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:41.585585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87cfe3-9096-4507-bab7-2e21255bf636 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:41.597962 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-6b87cfe3-9096-4507-bab7-2e21255bf636 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:27:41.597962 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:27:41.597962 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:27:41.597962 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:27:41.597962 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:27:41.597962 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:27:41.597962 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:27:41.597962 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:27:41.597962 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:27:41.597962 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:27:41.597962 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:27:41.597962 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:27:41.597962 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:27:41.597962 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:27:41.597962 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:27:41.599642 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:27:41.599642 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:27:41.599642 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:27:41.599642 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:27:41.599642 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:27:41.599642 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:27:41.599642 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:27:41.599642 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:27:41.599642 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:27:41.599642 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:27:41.599642 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:27:41.599642 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:27:41.599642 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:27:41.599642 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:27:41.599642 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:27:41.599642 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:27:41.599642 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:27:41.601059 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:27:41.601059 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:27:41.601059 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:27:41.601059 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:27:41.601059 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:27:41.601059 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:27:41.601059 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:27:41.601059 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:27:41.601059 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 547/1104] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:27:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:27:41.605078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effe991-5c55-4cf6-9d9d-664dd3ee5e25 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:41.708692 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:41.711781 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effe991-5c55-4cf6-9d9d-664dd3ee5e25 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:41.747891 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9295987-7bf5-4de9-a3b5-1e254e8c02ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:41.748502 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9295987-7bf5-4de9-a3b5-1e254e8c02ac None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:41.748779 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9295987-7bf5-4de9-a3b5-1e254e8c02ac None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:41.749089 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9295987-7bf5-4de9-a3b5-1e254e8c02ac None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:41.749793 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9295987-7bf5-4de9-a3b5-1e254e8c02ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:41.750097 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9295987-7bf5-4de9-a3b5-1e254e8c02ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:41.751604 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9295987-7bf5-4de9-a3b5-1e254e8c02ac None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:41.764269 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 558/1105] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:27:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:41.771052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87cfe3-9096-4507-bab7-2e21255bf636 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:41.863795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:41.888585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87cfe3-9096-4507-bab7-2e21255bf636 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:41.926227 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05206b50-4156-4f37-8d12-07fd09cd9b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:41.926839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05206b50-4156-4f37-8d12-07fd09cd9b44 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:41.927125 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05206b50-4156-4f37-8d12-07fd09cd9b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:41.927430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05206b50-4156-4f37-8d12-07fd09cd9b44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:41.928158 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05206b50-4156-4f37-8d12-07fd09cd9b44 None admin] RBAC: Adding query filter params (role.id=f316277cb750448ab2bd8bc9125fa166, scope.project.id=b6ed5f989f4248d7bab2548eb350fe17, user.id=e62bb9d2e13649b5af239bb56001ce16) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:41.928467 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05206b50-4156-4f37-8d12-07fd09cd9b44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:41.929904 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05206b50-4156-4f37-8d12-07fd09cd9b44 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:41.947285 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 548/1106] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:27:41 2022] GET /identity/v3/role_assignments?user.id=e62bb9d2e13649b5af239bb56001ce16&scope.project.id=b6ed5f989f4248d7bab2548eb350fe17&role.id=f316277cb750448ab2bd8bc9125fa166 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:43.440325 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901c49d-6819-4d2c-9040-416b7704ad8e None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:43.440882 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901c49d-6819-4d2c-9040-416b7704ad8e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:43.440882 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901c49d-6819-4d2c-9040-416b7704ad8e None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:43.442209 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 559/1107] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:27:43.448372 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9dc92a-d8da-4f98-b10a-7a482aad00db None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:43.448914 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9dc92a-d8da-4f98-b10a-7a482aad00db None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:43.448914 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9dc92a-d8da-4f98-b10a-7a482aad00db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:43.469849 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-1c9dc92a-d8da-4f98-b10a-7a482aad00db None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:43.471094 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1c9dc92a-d8da-4f98-b10a-7a482aad00db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:43.541398 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 549/1108] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:27:43.810994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901c49d-6819-4d2c-9040-416b7704ad8e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:43.927723 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901c49d-6819-4d2c-9040-416b7704ad8e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:43.965473 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930fdf28-541f-4b76-80e2-56cc77783258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:43.966110 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fdf28-541f-4b76-80e2-56cc77783258 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:43.966390 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fdf28-541f-4b76-80e2-56cc77783258 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:43.966664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fdf28-541f-4b76-80e2-56cc77783258 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:43.967821 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930fdf28-541f-4b76-80e2-56cc77783258 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:43.969266 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930fdf28-541f-4b76-80e2-56cc77783258 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:43.970886 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 560/1109] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:27:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:43.976743 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9dc92a-d8da-4f98-b10a-7a482aad00db None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:44.051429 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:44.082363 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9dc92a-d8da-4f98-b10a-7a482aad00db None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:44.116988 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a44d7-9fd8-42a8-abe8-56183e6bd049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:44.117598 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a44d7-9fd8-42a8-abe8-56183e6bd049 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:44.117874 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a44d7-9fd8-42a8-abe8-56183e6bd049 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:44.118141 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a44d7-9fd8-42a8-abe8-56183e6bd049 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:44.118797 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a44d7-9fd8-42a8-abe8-56183e6bd049 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:44.120248 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a44d7-9fd8-42a8-abe8-56183e6bd049 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:44.330658 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 550/1110] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Sep 11 08:27:43 2022] POST /identity/v3/users => generated 286 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:27:46.562708 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1582a98-af07-48bd-8aa7-6371e542f6c7 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:46.563240 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1582a98-af07-48bd-8aa7-6371e542f6c7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:46.563240 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1582a98-af07-48bd-8aa7-6371e542f6c7 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:46.564648 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 561/1111] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:27:46.570133 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4ceda-a8b9-4183-8965-2363304aa579 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:46.570535 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4ceda-a8b9-4183-8965-2363304aa579 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:46.570680 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4ceda-a8b9-4183-8965-2363304aa579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:46.589068 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-81f4ceda-a8b9-4183-8965-2363304aa579 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:46.590262 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-81f4ceda-a8b9-4183-8965-2363304aa579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:46.656452 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 551/1112] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:27:46.931942 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1582a98-af07-48bd-8aa7-6371e542f6c7 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:46.960537 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:47.031562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1582a98-af07-48bd-8aa7-6371e542f6c7 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:47.064293 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aecae4-9c79-4b70-a4c3-1c25bd788ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:47.064920 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aecae4-9c79-4b70-a4c3-1c25bd788ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:47.065205 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aecae4-9c79-4b70-a4c3-1c25bd788ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:47.065559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aecae4-9c79-4b70-a4c3-1c25bd788ef0 None admin] PATH_INFO: `/v3/roles/897bff7604d1492993a708763e54e6d8` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:47.066966 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aecae4-9c79-4b70-a4c3-1c25bd788ef0 None admin] RBAC: Authorizing `identity:get_role(role_id=897bff7604d1492993a708763e54e6d8)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:47.068375 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aecae4-9c79-4b70-a4c3-1c25bd788ef0 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:47.069690 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 562/1113] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:27:46 2022] GET /identity/v3/roles/897bff7604d1492993a708763e54e6d8 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:47.075664 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4ceda-a8b9-4183-8965-2363304aa579 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:47.135463 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:47.182849 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4ceda-a8b9-4183-8965-2363304aa579 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:47.220194 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48abef3-9122-4dfc-90f1-d5373132fc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:47.220844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48abef3-9122-4dfc-90f1-d5373132fc75 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:47.221134 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48abef3-9122-4dfc-90f1-d5373132fc75 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:47.221408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48abef3-9122-4dfc-90f1-d5373132fc75 None admin] PATH_INFO: `/v3/users/44927c9e37a14841b0ed7b5609b8dff5` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:47.236114 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48abef3-9122-4dfc-90f1-d5373132fc75 None admin] RBAC: Authorizing `identity:get_user(user_id=44927c9e37a14841b0ed7b5609b8dff5)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:47.237588 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48abef3-9122-4dfc-90f1-d5373132fc75 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:47.239438 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 552/1114] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:27:47 2022] GET /identity/v3/users/44927c9e37a14841b0ed7b5609b8dff5 => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:47.245565 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aecae4-9c79-4b70-a4c3-1c25bd788ef0 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:47.427204 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:47.432982 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aecae4-9c79-4b70-a4c3-1c25bd788ef0 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:47.466989 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1670930-3394-4b0c-a392-16cefe1ae30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:47.467626 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1670930-3394-4b0c-a392-16cefe1ae30e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:47.467909 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1670930-3394-4b0c-a392-16cefe1ae30e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:47.468184 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1670930-3394-4b0c-a392-16cefe1ae30e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:47.533431 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1670930-3394-4b0c-a392-16cefe1ae30e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:47.534895 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1670930-3394-4b0c-a392-16cefe1ae30e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:47.623430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:47.630205 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 563/1115] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:27:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 08:27:47.636342 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48abef3-9122-4dfc-90f1-d5373132fc75 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:47.733407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48abef3-9122-4dfc-90f1-d5373132fc75 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:47.747399 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:47.766983 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21dba56-3d1f-40db-8bc5-4ad4ee9364a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:47.767630 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21dba56-3d1f-40db-8bc5-4ad4ee9364a9 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:47.767913 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21dba56-3d1f-40db-8bc5-4ad4ee9364a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:47.768184 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21dba56-3d1f-40db-8bc5-4ad4ee9364a9 None admin] PATH_INFO: `/v3/projects/82ec8788616345ab8e227e06fc7d9a71` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:47.769287 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21dba56-3d1f-40db-8bc5-4ad4ee9364a9 None admin] RBAC: Authorizing `identity:get_project(project_id=82ec8788616345ab8e227e06fc7d9a71)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:47.770701 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21dba56-3d1f-40db-8bc5-4ad4ee9364a9 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:47.772356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 553/1116] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:27:47 2022] GET /identity/v3/projects/82ec8788616345ab8e227e06fc7d9a71 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:27:47.778545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1670930-3394-4b0c-a392-16cefe1ae30e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:47.874751 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1670930-3394-4b0c-a392-16cefe1ae30e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:47.908482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494bef66-015f-4c0c-b121-1aeeebd51720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:47.909079 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bef66-015f-4c0c-b121-1aeeebd51720 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:47.909353 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bef66-015f-4c0c-b121-1aeeebd51720 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:47.909622 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bef66-015f-4c0c-b121-1aeeebd51720 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:47.910342 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494bef66-015f-4c0c-b121-1aeeebd51720 None admin] RBAC: Adding query filter params (role.id=897bff7604d1492993a708763e54e6d8, scope.project.id=82ec8788616345ab8e227e06fc7d9a71, user.id=44927c9e37a14841b0ed7b5609b8dff5) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:47.910650 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494bef66-015f-4c0c-b121-1aeeebd51720 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:47.912101 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494bef66-015f-4c0c-b121-1aeeebd51720 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:47.917294 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 564/1117] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:27:47 2022] GET /identity/v3/role_assignments?user.id=44927c9e37a14841b0ed7b5609b8dff5&scope.project.id=82ec8788616345ab8e227e06fc7d9a71&role.id=897bff7604d1492993a708763e54e6d8 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:50.041939 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c74b0b-1203-4a78-919e-a73303bffff0 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:50.042477 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c74b0b-1203-4a78-919e-a73303bffff0 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:50.042477 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c74b0b-1203-4a78-919e-a73303bffff0 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:50.043842 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 554/1118] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:27:50.049613 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d70440-2af4-4375-beda-57d163a59778 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:50.050071 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d70440-2af4-4375-beda-57d163a59778 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:50.050166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d70440-2af4-4375-beda-57d163a59778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:50.068693 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-40d70440-2af4-4375-beda-57d163a59778 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:50.069898 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-40d70440-2af4-4375-beda-57d163a59778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:50.125367 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:50.136399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 565/1119] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 08:27:50.404752 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c74b0b-1203-4a78-919e-a73303bffff0 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:50.509900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c74b0b-1203-4a78-919e-a73303bffff0 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:50.544980 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed1005-1432-40e0-a5e2-8efd913f0207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:50.545613 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed1005-1432-40e0-a5e2-8efd913f0207 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:50.545918 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed1005-1432-40e0-a5e2-8efd913f0207 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:50.546188 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed1005-1432-40e0-a5e2-8efd913f0207 None admin] PATH_INFO: `/v3/roles/897bff7604d1492993a708763e54e6d8` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:50.547620 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed1005-1432-40e0-a5e2-8efd913f0207 None admin] RBAC: Authorizing `identity:get_role(role_id=897bff7604d1492993a708763e54e6d8)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:50.549535 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed1005-1432-40e0-a5e2-8efd913f0207 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:50.550858 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 555/1120] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:27:50 2022] GET /identity/v3/roles/897bff7604d1492993a708763e54e6d8 => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:50.556776 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d70440-2af4-4375-beda-57d163a59778 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:50.661944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d70440-2af4-4375-beda-57d163a59778 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:50.698155 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf5045-46df-4028-b914-754bf14754d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:50.698802 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf5045-46df-4028-b914-754bf14754d8 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:50.699081 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf5045-46df-4028-b914-754bf14754d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:50.699389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf5045-46df-4028-b914-754bf14754d8 None admin] PATH_INFO: `/v3/users/44927c9e37a14841b0ed7b5609b8dff5` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:50.700558 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf5045-46df-4028-b914-754bf14754d8 None admin] RBAC: Authorizing `identity:get_user(user_id=44927c9e37a14841b0ed7b5609b8dff5)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:50.702047 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf5045-46df-4028-b914-754bf14754d8 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:50.703982 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 566/1121] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:27:50 2022] GET /identity/v3/users/44927c9e37a14841b0ed7b5609b8dff5 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:50.710098 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed1005-1432-40e0-a5e2-8efd913f0207 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:50.760152 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:50.810514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed1005-1432-40e0-a5e2-8efd913f0207 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:50.857244 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fb566-2cc7-4a6b-940f-61ea11d12501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:50.857896 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fb566-2cc7-4a6b-940f-61ea11d12501 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:50.858177 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fb566-2cc7-4a6b-940f-61ea11d12501 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:50.858449 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fb566-2cc7-4a6b-940f-61ea11d12501 None admin] PATH_INFO: `/v3/projects/82ec8788616345ab8e227e06fc7d9a71` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:50.862430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fb566-2cc7-4a6b-940f-61ea11d12501 None admin] RBAC: Authorizing `identity:get_project(project_id=82ec8788616345ab8e227e06fc7d9a71)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:50.862746 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fb566-2cc7-4a6b-940f-61ea11d12501 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:50.864485 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 556/1122] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:27:50 2022] GET /identity/v3/projects/82ec8788616345ab8e227e06fc7d9a71 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:50.873188 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf5045-46df-4028-b914-754bf14754d8 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:50.930449 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:50.971640 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf5045-46df-4028-b914-754bf14754d8 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:51.004138 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1f7a5-cc20-4eb1-8a4c-cdbed859440c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:51.004789 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1f7a5-cc20-4eb1-8a4c-cdbed859440c None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:51.005065 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1f7a5-cc20-4eb1-8a4c-cdbed859440c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:51.005334 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1f7a5-cc20-4eb1-8a4c-cdbed859440c None admin] PATH_INFO: `/v3/projects/82ec8788616345ab8e227e06fc7d9a71/users/44927c9e37a14841b0ed7b5609b8dff5/roles/897bff7604d1492993a708763e54e6d8` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:51.007465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1f7a5-cc20-4eb1-8a4c-cdbed859440c None admin] RBAC: Authorizing `identity:create_grant(project_id=82ec8788616345ab8e227e06fc7d9a71, user_id=44927c9e37a14841b0ed7b5609b8dff5, role_id=897bff7604d1492993a708763e54e6d8)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:51.008890 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1f7a5-cc20-4eb1-8a4c-cdbed859440c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:51.084372 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 567/1123] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Sep 11 08:27:50 2022] PUT /identity/v3/projects/82ec8788616345ab8e227e06fc7d9a71/users/44927c9e37a14841b0ed7b5609b8dff5/roles/897bff7604d1492993a708763e54e6d8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:27:53.243080 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3017a-f353-498f-98a1-f54318da35d9 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:53.243634 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3017a-f353-498f-98a1-f54318da35d9 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:53.243634 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3017a-f353-498f-98a1-f54318da35d9 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:53.244984 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 557/1124] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:27:53.250452 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86579b15-9657-44bb-9acb-225582bda707 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:53.250889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86579b15-9657-44bb-9acb-225582bda707 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:53.251037 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86579b15-9657-44bb-9acb-225582bda707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:53.268784 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-86579b15-9657-44bb-9acb-225582bda707 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:53.269967 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-86579b15-9657-44bb-9acb-225582bda707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:53.337389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 568/1125] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 08:27:53.614210 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3017a-f353-498f-98a1-f54318da35d9 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:53.716600 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3017a-f353-498f-98a1-f54318da35d9 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:53.737036 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:53.755205 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc5c30-a8ef-4b21-98e7-a134b4caba54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:53.760729 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc5c30-a8ef-4b21-98e7-a134b4caba54 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:53.760729 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc5c30-a8ef-4b21-98e7-a134b4caba54 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:53.760729 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc5c30-a8ef-4b21-98e7-a134b4caba54 None admin] PATH_INFO: `/v3/roles/897bff7604d1492993a708763e54e6d8` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:53.760729 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc5c30-a8ef-4b21-98e7-a134b4caba54 None admin] RBAC: Authorizing `identity:get_role(role_id=897bff7604d1492993a708763e54e6d8)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:53.760729 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc5c30-a8ef-4b21-98e7-a134b4caba54 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:53.760729 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 558/1126] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:27:53 2022] GET /identity/v3/roles/897bff7604d1492993a708763e54e6d8 => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:53.766886 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86579b15-9657-44bb-9acb-225582bda707 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:53.826340 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:53.880476 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86579b15-9657-44bb-9acb-225582bda707 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:53.914000 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f428cec-8519-498d-937a-ec6135e11eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:53.914634 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f428cec-8519-498d-937a-ec6135e11eed None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:53.914915 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f428cec-8519-498d-937a-ec6135e11eed None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:53.915191 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f428cec-8519-498d-937a-ec6135e11eed None admin] PATH_INFO: `/v3/users/44927c9e37a14841b0ed7b5609b8dff5` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:53.916353 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f428cec-8519-498d-937a-ec6135e11eed None admin] RBAC: Authorizing `identity:get_user(user_id=44927c9e37a14841b0ed7b5609b8dff5)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:53.917791 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f428cec-8519-498d-937a-ec6135e11eed None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:53.919398 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 569/1127] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:27:53 2022] GET /identity/v3/users/44927c9e37a14841b0ed7b5609b8dff5 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:53.925768 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc5c30-a8ef-4b21-98e7-a134b4caba54 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:54.021262 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc5c30-a8ef-4b21-98e7-a134b4caba54 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:54.056025 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657db4ce-a678-4e93-b18a-d62e035141f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:54.056629 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657db4ce-a678-4e93-b18a-d62e035141f1 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:54.056910 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657db4ce-a678-4e93-b18a-d62e035141f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:54.057181 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657db4ce-a678-4e93-b18a-d62e035141f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:54.109257 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:54.122614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657db4ce-a678-4e93-b18a-d62e035141f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:54.124101 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657db4ce-a678-4e93-b18a-d62e035141f1 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:54.224946 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 559/1128] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:27:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 08:27:54.231027 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f428cec-8519-498d-937a-ec6135e11eed None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:54.328032 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f428cec-8519-498d-937a-ec6135e11eed None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:54.346024 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:54.363113 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d2b66-0724-44f8-b49b-a91d419dae70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:54.363785 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d2b66-0724-44f8-b49b-a91d419dae70 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:54.364068 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d2b66-0724-44f8-b49b-a91d419dae70 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:54.364341 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d2b66-0724-44f8-b49b-a91d419dae70 None admin] PATH_INFO: `/v3/projects/82ec8788616345ab8e227e06fc7d9a71` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:54.365452 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d2b66-0724-44f8-b49b-a91d419dae70 None admin] RBAC: Authorizing `identity:get_project(project_id=82ec8788616345ab8e227e06fc7d9a71)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:54.366927 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d2b66-0724-44f8-b49b-a91d419dae70 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:54.368600 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 570/1129] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:27:54 2022] GET /identity/v3/projects/82ec8788616345ab8e227e06fc7d9a71 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:54.374841 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657db4ce-a678-4e93-b18a-d62e035141f1 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:54.459023 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:54.473890 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657db4ce-a678-4e93-b18a-d62e035141f1 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:54.507002 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebd23a-7f9b-46da-b02b-bd043878616d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:54.507558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebd23a-7f9b-46da-b02b-bd043878616d None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:54.507836 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebd23a-7f9b-46da-b02b-bd043878616d None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:54.508104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebd23a-7f9b-46da-b02b-bd043878616d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:54.508816 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ebd23a-7f9b-46da-b02b-bd043878616d None admin] RBAC: Adding query filter params (role.id=897bff7604d1492993a708763e54e6d8, scope.project.id=82ec8788616345ab8e227e06fc7d9a71, user.id=44927c9e37a14841b0ed7b5609b8dff5) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:27:54.509120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ebd23a-7f9b-46da-b02b-bd043878616d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:54.510533 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ebd23a-7f9b-46da-b02b-bd043878616d None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:54.516177 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 560/1130] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:27:54 2022] GET /identity/v3/role_assignments?user.id=44927c9e37a14841b0ed7b5609b8dff5&scope.project.id=82ec8788616345ab8e227e06fc7d9a71&role.id=897bff7604d1492993a708763e54e6d8 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:56.691227 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c681ca9-4d38-4cf8-b8b5-84775ed4e2f4 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:56.691835 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c681ca9-4d38-4cf8-b8b5-84775ed4e2f4 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:56.691835 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c681ca9-4d38-4cf8-b8b5-84775ed4e2f4 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:56.693286 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 571/1131] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:27:56.699782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d0a1c-1b52-4d89-ab9a-a952bbd834ac None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:56.700290 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d0a1c-1b52-4d89-ab9a-a952bbd834ac None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:56.700385 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d0a1c-1b52-4d89-ab9a-a952bbd834ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:56.723102 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-3a7d0a1c-1b52-4d89-ab9a-a952bbd834ac None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:56.724344 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3a7d0a1c-1b52-4d89-ab9a-a952bbd834ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:56.791883 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 561/1132] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:27:57.080025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c681ca9-4d38-4cf8-b8b5-84775ed4e2f4 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:57.212888 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c681ca9-4d38-4cf8-b8b5-84775ed4e2f4 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:57.249653 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb15f0b-41bb-4da9-9b79-cd364f11455b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:57.250299 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb15f0b-41bb-4da9-9b79-cd364f11455b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:57.250578 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb15f0b-41bb-4da9-9b79-cd364f11455b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:57.251395 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb15f0b-41bb-4da9-9b79-cd364f11455b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:57.252584 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb15f0b-41bb-4da9-9b79-cd364f11455b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:57.254068 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb15f0b-41bb-4da9-9b79-cd364f11455b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:57.255839 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 572/1133] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:27:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:27:57.261961 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d0a1c-1b52-4d89-ab9a-a952bbd834ac None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:27:57.347337 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:27:57.368119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d0a1c-1b52-4d89-ab9a-a952bbd834ac None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:27:57.406289 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce51929-6d42-4abf-ab25-7045eadc4995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:27:57.407293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce51929-6d42-4abf-ab25-7045eadc4995 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:57.407797 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce51929-6d42-4abf-ab25-7045eadc4995 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:57.408092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce51929-6d42-4abf-ab25-7045eadc4995 None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:57.408771 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce51929-6d42-4abf-ab25-7045eadc4995 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:27:57.410212 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce51929-6d42-4abf-ab25-7045eadc4995 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:27:57.508980 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 562/1134] 10.222.0.26 () {60 vars in 1141 bytes} [Sun Sep 11 08:27:57 2022] POST /identity/v3/projects => generated 311 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:27:59.786053 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29769e-1f64-416f-94af-e1736d4f2683 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:59.786629 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29769e-1f64-416f-94af-e1736d4f2683 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:59.786629 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29769e-1f64-416f-94af-e1736d4f2683 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:59.787967 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 573/1135] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:27:59.793638 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4c6ec-a591-418a-a4af-6c37381d6f4f None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:27:59.794090 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4c6ec-a591-418a-a4af-6c37381d6f4f None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:27:59.794201 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4c6ec-a591-418a-a4af-6c37381d6f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:27:59.812516 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-d7e4c6ec-a591-418a-a4af-6c37381d6f4f None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:27:59.813786 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d7e4c6ec-a591-418a-a4af-6c37381d6f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:27:59.883929 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 563/1136] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:27:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:28:00.156625 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29769e-1f64-416f-94af-e1736d4f2683 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:00.213334 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:00.259858 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29769e-1f64-416f-94af-e1736d4f2683 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:00.296581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28db94b-458a-4aae-927c-727f59c799ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:00.297198 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28db94b-458a-4aae-927c-727f59c799ba None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:00.298011 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28db94b-458a-4aae-927c-727f59c799ba None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:00.298282 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28db94b-458a-4aae-927c-727f59c799ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:00.299411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28db94b-458a-4aae-927c-727f59c799ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:00.300841 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28db94b-458a-4aae-927c-727f59c799ba None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:00.302401 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 574/1137] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:28:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:28:00.308262 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4c6ec-a591-418a-a4af-6c37381d6f4f None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:00.367451 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:00.404575 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4c6ec-a591-418a-a4af-6c37381d6f4f None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:00.438734 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78bb1d-1f4f-4c9a-bab7-0fd8659c82ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:00.439297 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78bb1d-1f4f-4c9a-bab7-0fd8659c82ec None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:00.439582 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78bb1d-1f4f-4c9a-bab7-0fd8659c82ec None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:00.439856 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78bb1d-1f4f-4c9a-bab7-0fd8659c82ec None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:00.440498 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c78bb1d-1f4f-4c9a-bab7-0fd8659c82ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:00.441916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c78bb1d-1f4f-4c9a-bab7-0fd8659c82ec None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:00.553371 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 564/1138] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Sep 11 08:28:00 2022] POST /identity/v3/users => generated 286 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:28:02.741763 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b36b50-dc51-4b91-b2ec-7a9fd451a1b5 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:02.742315 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b36b50-dc51-4b91-b2ec-7a9fd451a1b5 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:02.742315 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b36b50-dc51-4b91-b2ec-7a9fd451a1b5 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:02.743672 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 575/1139] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:28:02.749349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bee701-7e93-4be5-be0b-ee8a7056f69b None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:02.749796 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bee701-7e93-4be5-be0b-ee8a7056f69b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:02.749893 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bee701-7e93-4be5-be0b-ee8a7056f69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:02.768475 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-55bee701-7e93-4be5-be0b-ee8a7056f69b None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:28:02.769688 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-55bee701-7e93-4be5-be0b-ee8a7056f69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:28:02.837112 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 565/1140] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:28:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:28:03.113653 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b36b50-dc51-4b91-b2ec-7a9fd451a1b5 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:03.217400 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b36b50-dc51-4b91-b2ec-7a9fd451a1b5 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:03.237833 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:03.251178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f804d1f-937d-40cf-bcfb-5f4966b04d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:03.251854 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f804d1f-937d-40cf-bcfb-5f4966b04d16 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:03.252133 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f804d1f-937d-40cf-bcfb-5f4966b04d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:03.252407 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f804d1f-937d-40cf-bcfb-5f4966b04d16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:03.262239 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f804d1f-937d-40cf-bcfb-5f4966b04d16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:28:03.267170 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-3f804d1f-937d-40cf-bcfb-5f4966b04d16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:28:03.267170 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:28:03.267170 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:28:03.267170 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:28:03.267170 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:28:03.267170 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:28:03.267170 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:28:03.267170 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:28:03.267170 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:28:03.267170 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:28:03.267170 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:28:03.267170 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:28:03.267170 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:28:03.267170 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:28:03.267170 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:28:03.267170 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:28:03.268351 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:28:03.268351 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:28:03.268351 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:28:03.268351 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:28:03.268351 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:28:03.268351 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:28:03.268351 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:28:03.268351 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:28:03.268351 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:28:03.268351 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:28:03.268351 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:28:03.268351 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:28:03.268351 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:28:03.268351 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:28:03.268351 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:28:03.268351 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:28:03.269281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:28:03.269281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:28:03.269281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:28:03.269281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:28:03.269281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:28:03.269281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:28:03.269281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:28:03.269281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:28:03.269281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:28:03.269281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:28:03.269281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:28:03.269281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:28:03.269281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 576/1141] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:28:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:28:03.274482 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bee701-7e93-4be5-be0b-ee8a7056f69b None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:03.321835 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:03.371506 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bee701-7e93-4be5-be0b-ee8a7056f69b None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:03.405089 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898e30a-9b4c-492c-9f84-7d4113205323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:03.405694 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898e30a-9b4c-492c-9f84-7d4113205323 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:03.405978 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898e30a-9b4c-492c-9f84-7d4113205323 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:03.406254 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898e30a-9b4c-492c-9f84-7d4113205323 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:03.407515 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a898e30a-9b4c-492c-9f84-7d4113205323 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:28:03.407823 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a898e30a-9b4c-492c-9f84-7d4113205323 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:03.409191 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a898e30a-9b4c-492c-9f84-7d4113205323 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:03.417123 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 566/1142] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:28:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:28:03.423116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f804d1f-937d-40cf-bcfb-5f4966b04d16 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:03.520586 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f804d1f-937d-40cf-bcfb-5f4966b04d16 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:03.553672 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a5adb-ce15-4852-a908-0e231551a307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:03.554288 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a5adb-ce15-4852-a908-0e231551a307 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:03.554571 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a5adb-ce15-4852-a908-0e231551a307 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:03.554843 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a5adb-ce15-4852-a908-0e231551a307 None admin] PATH_INFO: `/v3/users/1ca97d48538e46c583050861264324ce` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:03.567399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a5adb-ce15-4852-a908-0e231551a307 None admin] RBAC: Authorizing `identity:get_user(user_id=1ca97d48538e46c583050861264324ce)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:03.568834 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a5adb-ce15-4852-a908-0e231551a307 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:03.570424 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 577/1143] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:28:03 2022] GET /identity/v3/users/1ca97d48538e46c583050861264324ce => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:28:03.576240 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898e30a-9b4c-492c-9f84-7d4113205323 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:03.674012 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898e30a-9b4c-492c-9f84-7d4113205323 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:03.684209 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:03.707775 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb77d71-9750-4289-9319-06bb86a5cbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:03.708381 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb77d71-9750-4289-9319-06bb86a5cbd1 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:03.708657 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb77d71-9750-4289-9319-06bb86a5cbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:03.708923 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb77d71-9750-4289-9319-06bb86a5cbd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:03.773963 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb77d71-9750-4289-9319-06bb86a5cbd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:03.775437 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb77d71-9750-4289-9319-06bb86a5cbd1 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:03.870379 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 567/1144] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:28:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 08:28:03.876948 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a5adb-ce15-4852-a908-0e231551a307 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:03.915228 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:03.971883 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a5adb-ce15-4852-a908-0e231551a307 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:04.004669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c992ba-56b5-4a12-8180-70d55ff51321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:04.005278 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c992ba-56b5-4a12-8180-70d55ff51321 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:04.005554 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c992ba-56b5-4a12-8180-70d55ff51321 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:04.005821 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c992ba-56b5-4a12-8180-70d55ff51321 None admin] PATH_INFO: `/v3/projects/5b8f03c08a6846b0bdd1022653a32fc9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:04.006912 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c992ba-56b5-4a12-8180-70d55ff51321 None admin] RBAC: Authorizing `identity:get_project(project_id=5b8f03c08a6846b0bdd1022653a32fc9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:04.008357 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c992ba-56b5-4a12-8180-70d55ff51321 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:04.009938 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 578/1145] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:28:03 2022] GET /identity/v3/projects/5b8f03c08a6846b0bdd1022653a32fc9 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:28:04.016696 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb77d71-9750-4289-9319-06bb86a5cbd1 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:04.028169 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:04.112089 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb77d71-9750-4289-9319-06bb86a5cbd1 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:04.144419 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadbe7f9-ec14-4c86-943f-4b21bd62a89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:04.145017 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbe7f9-ec14-4c86-943f-4b21bd62a89f None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:04.145293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbe7f9-ec14-4c86-943f-4b21bd62a89f None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:04.145564 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbe7f9-ec14-4c86-943f-4b21bd62a89f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:04.146281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadbe7f9-ec14-4c86-943f-4b21bd62a89f None admin] RBAC: Adding query filter params (role.id=d12af9f1dfb344cd8a6a493e165030ba, scope.project.id=5b8f03c08a6846b0bdd1022653a32fc9, user.id=1ca97d48538e46c583050861264324ce) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:28:04.146583 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadbe7f9-ec14-4c86-943f-4b21bd62a89f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:04.148140 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadbe7f9-ec14-4c86-943f-4b21bd62a89f None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:04.153256 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 568/1146] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:28:04 2022] GET /identity/v3/role_assignments?user.id=1ca97d48538e46c583050861264324ce&scope.project.id=5b8f03c08a6846b0bdd1022653a32fc9&role.id=d12af9f1dfb344cd8a6a493e165030ba => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:28:06.279350 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5315ef-bbc4-4a40-a104-135e9993cba2 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:06.279914 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5315ef-bbc4-4a40-a104-135e9993cba2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:06.279914 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5315ef-bbc4-4a40-a104-135e9993cba2 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:06.281234 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 579/1147] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:28:06.287574 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d26e30-3f4c-4816-9fcd-647bd5fed7e8 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:06.287986 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d26e30-3f4c-4816-9fcd-647bd5fed7e8 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:06.288128 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d26e30-3f4c-4816-9fcd-647bd5fed7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:06.306796 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-e6d26e30-3f4c-4816-9fcd-647bd5fed7e8 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:28:06.308035 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e6d26e30-3f4c-4816-9fcd-647bd5fed7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:28:06.381844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 569/1148] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:28:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:28:06.648018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5315ef-bbc4-4a40-a104-135e9993cba2 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:06.758318 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5315ef-bbc4-4a40-a104-135e9993cba2 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:06.766916 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:06.794213 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f49f1-8cff-4a74-a9b7-183a01169f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:06.794854 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f49f1-8cff-4a74-a9b7-183a01169f5f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:06.795136 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f49f1-8cff-4a74-a9b7-183a01169f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:06.795441 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f49f1-8cff-4a74-a9b7-183a01169f5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:06.806517 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f49f1-8cff-4a74-a9b7-183a01169f5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:28:06.811871 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-345f49f1-8cff-4a74-a9b7-183a01169f5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:28:06.811871 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:28:06.811871 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:28:06.811871 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:28:06.811871 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:28:06.811871 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:28:06.811871 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:28:06.811871 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:28:06.811871 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:28:06.811871 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:28:06.811871 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:28:06.811871 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:28:06.811871 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:28:06.811871 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:28:06.811871 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:28:06.811871 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:28:06.813487 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:28:06.813487 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:28:06.813487 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:28:06.813487 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:28:06.813487 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:28:06.813487 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:28:06.813487 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:28:06.813487 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:28:06.813487 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:28:06.813487 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:28:06.813487 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:28:06.813487 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:28:06.813487 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:28:06.813487 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:28:06.813487 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:28:06.813487 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:28:06.814486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:28:06.814486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:28:06.814486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:28:06.814486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:28:06.814486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:28:06.814486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:28:06.814486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:28:06.814486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:28:06.814486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:28:06.814486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:28:06.814486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:28:06.814486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:28:06.814486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 580/1149] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:28:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:28:06.820117 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d26e30-3f4c-4816-9fcd-647bd5fed7e8 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:06.823238 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:06.916157 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d26e30-3f4c-4816-9fcd-647bd5fed7e8 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:06.948643 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8931a-6aad-4b59-b393-f98fa96acbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:06.949244 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8931a-6aad-4b59-b393-f98fa96acbb9 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:06.949519 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8931a-6aad-4b59-b393-f98fa96acbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:06.949787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8931a-6aad-4b59-b393-f98fa96acbb9 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:06.950441 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8931a-6aad-4b59-b393-f98fa96acbb9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:28:06.950738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8931a-6aad-4b59-b393-f98fa96acbb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:06.952126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8931a-6aad-4b59-b393-f98fa96acbb9 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:06.960805 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 570/1150] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:28:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:28:06.966840 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f49f1-8cff-4a74-a9b7-183a01169f5f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:07.064386 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f49f1-8cff-4a74-a9b7-183a01169f5f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:07.096434 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edf305-7c48-4d76-9083-1ac5bf07754d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:07.097061 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edf305-7c48-4d76-9083-1ac5bf07754d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:07.097340 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edf305-7c48-4d76-9083-1ac5bf07754d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:07.097615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edf305-7c48-4d76-9083-1ac5bf07754d None admin] PATH_INFO: `/v3/users/1ca97d48538e46c583050861264324ce` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:07.098737 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edf305-7c48-4d76-9083-1ac5bf07754d None admin] RBAC: Authorizing `identity:get_user(user_id=1ca97d48538e46c583050861264324ce)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:07.100203 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edf305-7c48-4d76-9083-1ac5bf07754d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:07.101769 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 581/1151] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:28:06 2022] GET /identity/v3/users/1ca97d48538e46c583050861264324ce => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:28:07.107678 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8931a-6aad-4b59-b393-f98fa96acbb9 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:07.170826 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:07.206870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8931a-6aad-4b59-b393-f98fa96acbb9 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:07.239590 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d8378-96a8-4885-97a1-a633fb955ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:07.240212 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d8378-96a8-4885-97a1-a633fb955ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:07.240489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d8378-96a8-4885-97a1-a633fb955ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:07.240761 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d8378-96a8-4885-97a1-a633fb955ac5 None admin] PATH_INFO: `/v3/projects/5b8f03c08a6846b0bdd1022653a32fc9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:07.241866 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d8378-96a8-4885-97a1-a633fb955ac5 None admin] RBAC: Authorizing `identity:get_project(project_id=5b8f03c08a6846b0bdd1022653a32fc9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:07.243311 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d8378-96a8-4885-97a1-a633fb955ac5 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:07.244974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 571/1152] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:28:07 2022] GET /identity/v3/projects/5b8f03c08a6846b0bdd1022653a32fc9 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:28:07.251080 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edf305-7c48-4d76-9083-1ac5bf07754d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:07.284872 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:07.348858 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edf305-7c48-4d76-9083-1ac5bf07754d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:07.382082 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4affa-c34a-42b1-b4fb-d50551f19361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:07.382734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4affa-c34a-42b1-b4fb-d50551f19361 None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:07.383011 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4affa-c34a-42b1-b4fb-d50551f19361 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:07.383308 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4affa-c34a-42b1-b4fb-d50551f19361 None admin] PATH_INFO: `/v3/projects/5b8f03c08a6846b0bdd1022653a32fc9/users/1ca97d48538e46c583050861264324ce/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:07.385197 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4affa-c34a-42b1-b4fb-d50551f19361 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b8f03c08a6846b0bdd1022653a32fc9, user_id=1ca97d48538e46c583050861264324ce, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:07.386628 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4affa-c34a-42b1-b4fb-d50551f19361 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:07.468769 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 582/1153] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Sep 11 08:28:07 2022] PUT /identity/v3/projects/5b8f03c08a6846b0bdd1022653a32fc9/users/1ca97d48538e46c583050861264324ce/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:28:09.599512 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160518b-e1ba-4b08-b2e8-68efbd7e4a7b None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:09.600080 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160518b-e1ba-4b08-b2e8-68efbd7e4a7b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:09.600080 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160518b-e1ba-4b08-b2e8-68efbd7e4a7b None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:09.602011 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 572/1154] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:28:09.607113 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605912ec-a086-419f-962e-8f1d71b2868f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:09.607626 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605912ec-a086-419f-962e-8f1d71b2868f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:09.607779 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605912ec-a086-419f-962e-8f1d71b2868f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:09.626204 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-605912ec-a086-419f-962e-8f1d71b2868f None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:28:09.627450 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-605912ec-a086-419f-962e-8f1d71b2868f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:28:09.694211 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 583/1155] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:28:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:28:09.960877 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160518b-e1ba-4b08-b2e8-68efbd7e4a7b None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:10.067192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160518b-e1ba-4b08-b2e8-68efbd7e4a7b None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:10.102293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459567f-af65-4d59-ac9e-1d9f34c0144f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:10.102942 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459567f-af65-4d59-ac9e-1d9f34c0144f None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:10.103228 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459567f-af65-4d59-ac9e-1d9f34c0144f None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:10.103541 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459567f-af65-4d59-ac9e-1d9f34c0144f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:10.105595 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:10.115891 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459567f-af65-4d59-ac9e-1d9f34c0144f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:28:10.121052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-5459567f-af65-4d59-ac9e-1d9f34c0144f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:28:10.121052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:28:10.121052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:28:10.121052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:28:10.121052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:28:10.121052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:28:10.121052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:28:10.121052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:28:10.121052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:28:10.121052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:28:10.121052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:28:10.121052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:28:10.121052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:28:10.121052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:28:10.121052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:28:10.121052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:28:10.129855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:28:10.129855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:28:10.129855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:28:10.129855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:28:10.129855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:28:10.129855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:28:10.129855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:28:10.129855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:28:10.129855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:28:10.129855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:28:10.129855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:28:10.129855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:28:10.129855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:28:10.129855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:28:10.129855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:28:10.129855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:28:10.130895 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:28:10.130895 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:28:10.130895 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:28:10.130895 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:28:10.130895 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:28:10.130895 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:28:10.130895 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:28:10.130895 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:28:10.130895 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:28:10.130895 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:28:10.130895 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:28:10.130895 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:28:10.130895 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 573/1156] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:28:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:28:10.132080 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605912ec-a086-419f-962e-8f1d71b2868f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:10.154812 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:10.231231 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605912ec-a086-419f-962e-8f1d71b2868f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:10.265178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc5f66-5101-4251-ab36-61d814901f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:10.265875 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc5f66-5101-4251-ab36-61d814901f5f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:10.266158 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc5f66-5101-4251-ab36-61d814901f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:10.266429 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc5f66-5101-4251-ab36-61d814901f5f None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:10.267099 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc5f66-5101-4251-ab36-61d814901f5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:28:10.267436 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc5f66-5101-4251-ab36-61d814901f5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:10.268803 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc5f66-5101-4251-ab36-61d814901f5f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:10.276775 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 584/1157] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:28:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:28:10.282816 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459567f-af65-4d59-ac9e-1d9f34c0144f None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:10.381544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459567f-af65-4d59-ac9e-1d9f34c0144f None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:10.413809 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2592d40-e598-47cd-b499-4a8c264e6ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:10.414439 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2592d40-e598-47cd-b499-4a8c264e6ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:10.414719 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2592d40-e598-47cd-b499-4a8c264e6ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:10.414989 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2592d40-e598-47cd-b499-4a8c264e6ba8 None admin] PATH_INFO: `/v3/users/1ca97d48538e46c583050861264324ce` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:10.416127 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2592d40-e598-47cd-b499-4a8c264e6ba8 None admin] RBAC: Authorizing `identity:get_user(user_id=1ca97d48538e46c583050861264324ce)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:10.417545 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2592d40-e598-47cd-b499-4a8c264e6ba8 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:10.419116 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 574/1158] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:28:10 2022] GET /identity/v3/users/1ca97d48538e46c583050861264324ce => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:28:10.425460 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc5f66-5101-4251-ab36-61d814901f5f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:10.509037 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:10.523101 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc5f66-5101-4251-ab36-61d814901f5f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:10.555407 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c587e2-4899-461d-bf5f-05ebf3362a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:10.556011 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c587e2-4899-461d-bf5f-05ebf3362a3c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:10.556290 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c587e2-4899-461d-bf5f-05ebf3362a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:10.556563 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c587e2-4899-461d-bf5f-05ebf3362a3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:10.621746 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c587e2-4899-461d-bf5f-05ebf3362a3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:10.623194 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c587e2-4899-461d-bf5f-05ebf3362a3c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:10.705824 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:10.721302 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 585/1159] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:28:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 08:28:10.727453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2592d40-e598-47cd-b499-4a8c264e6ba8 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:10.788628 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:10.826023 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2592d40-e598-47cd-b499-4a8c264e6ba8 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:10.859472 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbd930-3be4-4977-a069-b7c2f7abe795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:10.860115 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbd930-3be4-4977-a069-b7c2f7abe795 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:10.860398 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbd930-3be4-4977-a069-b7c2f7abe795 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:10.860671 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbd930-3be4-4977-a069-b7c2f7abe795 None admin] PATH_INFO: `/v3/projects/5b8f03c08a6846b0bdd1022653a32fc9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:10.861801 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbd930-3be4-4977-a069-b7c2f7abe795 None admin] RBAC: Authorizing `identity:get_project(project_id=5b8f03c08a6846b0bdd1022653a32fc9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:10.863230 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbd930-3be4-4977-a069-b7c2f7abe795 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:10.864940 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 575/1160] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:28:10 2022] GET /identity/v3/projects/5b8f03c08a6846b0bdd1022653a32fc9 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:28:10.871365 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c587e2-4899-461d-bf5f-05ebf3362a3c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:10.967913 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c587e2-4899-461d-bf5f-05ebf3362a3c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:11.001010 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830dd78-9b6a-4866-89c1-7015b4a91468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:11.001599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830dd78-9b6a-4866-89c1-7015b4a91468 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:11.001873 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830dd78-9b6a-4866-89c1-7015b4a91468 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:11.002143 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830dd78-9b6a-4866-89c1-7015b4a91468 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:11.002861 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830dd78-9b6a-4866-89c1-7015b4a91468 None admin] RBAC: Adding query filter params (role.id=d12af9f1dfb344cd8a6a493e165030ba, scope.project.id=5b8f03c08a6846b0bdd1022653a32fc9, user.id=1ca97d48538e46c583050861264324ce) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:28:11.003166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830dd78-9b6a-4866-89c1-7015b4a91468 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:11.004618 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830dd78-9b6a-4866-89c1-7015b4a91468 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:11.010108 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 586/1161] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:28:10 2022] GET /identity/v3/role_assignments?user.id=1ca97d48538e46c583050861264324ce&scope.project.id=5b8f03c08a6846b0bdd1022653a32fc9&role.id=d12af9f1dfb344cd8a6a493e165030ba => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:28:13.184084 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506e972-9143-4df0-8425-c3e934628fe2 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:13.184651 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506e972-9143-4df0-8425-c3e934628fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:13.184651 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506e972-9143-4df0-8425-c3e934628fe2 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:13.186026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 576/1162] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:28:13.191364 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6400f76-c517-46e2-94c4-c38bcab4c98a None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:13.191781 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6400f76-c517-46e2-94c4-c38bcab4c98a None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:13.191916 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6400f76-c517-46e2-94c4-c38bcab4c98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:13.211241 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f6400f76-c517-46e2-94c4-c38bcab4c98a None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:28:13.212497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f6400f76-c517-46e2-94c4-c38bcab4c98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:28:13.258146 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:13.278636 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 587/1163] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:28:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:28:13.552557 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506e972-9143-4df0-8425-c3e934628fe2 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:13.695233 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506e972-9143-4df0-8425-c3e934628fe2 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:13.725526 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:13.731391 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91d694-1a7f-466b-8274-8e20a655b2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:13.732018 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91d694-1a7f-466b-8274-8e20a655b2a4 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:13.732299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91d694-1a7f-466b-8274-8e20a655b2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:13.732573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91d694-1a7f-466b-8274-8e20a655b2a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:13.807521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91d694-1a7f-466b-8274-8e20a655b2a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:13.808881 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91d694-1a7f-466b-8274-8e20a655b2a4 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:13.906251 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 577/1164] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:28:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 08:28:13.912305 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6400f76-c517-46e2-94c4-c38bcab4c98a None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:14.010443 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6400f76-c517-46e2-94c4-c38bcab4c98a None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:14.043410 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3de2c4-5f2b-4ea1-801e-872174f80b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:14.044040 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3de2c4-5f2b-4ea1-801e-872174f80b3d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:14.044319 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3de2c4-5f2b-4ea1-801e-872174f80b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:14.044591 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3de2c4-5f2b-4ea1-801e-872174f80b3d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:14.051616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3de2c4-5f2b-4ea1-801e-872174f80b3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:14.053156 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3de2c4-5f2b-4ea1-801e-872174f80b3d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:14.064950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-db3de2c4-5f2b-4ea1-801e-872174f80b3d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 11 08:28:14.064950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:28:14.064950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 11 08:28:14.064950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 11 08:28:14.064950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:28:14.064950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:28:14.064950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:28:14.064950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:28:14.064950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 11 08:28:14.064950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:28:14.064950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 08:28:14.064950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:28:14.064950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:28:14.064950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:28:14.064950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:28:14.064950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:28:14.064950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:28:14.066008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:28:14.066008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:28:14.066008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:28:14.066008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:28:14.066008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:28:14.066008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:28:14.066008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:28:14.066008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:28:14.066008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:28:14.066008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:28:14.066008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:28:14.066008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:28:14.066008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:28:14.066008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:28:14.066008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:28:14.066008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:28:14.066949 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:28:14.066949 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:28:14.066949 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:28:14.066949 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:28:14.066949 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:28:14.066949 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:28:14.066949 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:28:14.066949 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:28:14.066949 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:28:14.066949 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:28:14.066949 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 11 08:28:14.066949 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:28:14.066949 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 11 08:28:14.066949 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:28:14.066949 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 588/1165] 10.222.0.26 () {56 vars in 1117 bytes} [Sun Sep 11 08:28:13 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:28:14.072068 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91d694-1a7f-466b-8274-8e20a655b2a4 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:14.100883 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:14.168919 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91d694-1a7f-466b-8274-8e20a655b2a4 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:14.201857 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04527a77-32b0-48fd-b3ac-e7edfbeb07a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:14.202481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04527a77-32b0-48fd-b3ac-e7edfbeb07a7 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:14.202688 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04527a77-32b0-48fd-b3ac-e7edfbeb07a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:14.202978 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04527a77-32b0-48fd-b3ac-e7edfbeb07a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:14.203893 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04527a77-32b0-48fd-b3ac-e7edfbeb07a7 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:28:14.204191 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04527a77-32b0-48fd-b3ac-e7edfbeb07a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:14.205534 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04527a77-32b0-48fd-b3ac-e7edfbeb07a7 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:14.212503 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 578/1166] 10.222.0.26 () {56 vars in 1115 bytes} [Sun Sep 11 08:28:14 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:28:16.393115 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e7d92-97fc-4a8b-9da0-b60e49cacec7 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:16.393686 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e7d92-97fc-4a8b-9da0-b60e49cacec7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:16.393686 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e7d92-97fc-4a8b-9da0-b60e49cacec7 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:16.394999 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 589/1167] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:28:16.400270 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6785d-db6e-4f85-87a2-a1a639c428ae None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:16.400680 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6785d-db6e-4f85-87a2-a1a639c428ae None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:16.400827 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6785d-db6e-4f85-87a2-a1a639c428ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:16.419180 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-60f6785d-db6e-4f85-87a2-a1a639c428ae None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:28:16.420412 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-60f6785d-db6e-4f85-87a2-a1a639c428ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:28:16.488139 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 579/1168] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:28:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:28:16.753381 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e7d92-97fc-4a8b-9da0-b60e49cacec7 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:16.799867 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:16.863060 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e7d92-97fc-4a8b-9da0-b60e49cacec7 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:16.897931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdb514-2f0f-4754-a736-4d3ce267fd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:16.898544 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdb514-2f0f-4754-a736-4d3ce267fd63 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:16.898821 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdb514-2f0f-4754-a736-4d3ce267fd63 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:16.899090 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdb514-2f0f-4754-a736-4d3ce267fd63 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:16.899811 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cdb514-2f0f-4754-a736-4d3ce267fd63 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:16.901199 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cdb514-2f0f-4754-a736-4d3ce267fd63 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:17.002025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 590/1169] 10.222.0.26 () {60 vars in 1138 bytes} [Sun Sep 11 08:28:16 2022] POST /identity/v3/domains => generated 267 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:28:19.200236 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ae248-177c-4a2c-8353-23c90c1c1d03 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:19.200792 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ae248-177c-4a2c-8353-23c90c1c1d03 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:19.200792 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ae248-177c-4a2c-8353-23c90c1c1d03 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:19.202115 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 580/1170] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:28:19.208072 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afade5d9-f0fe-4ec5-9a41-2edd121c05c3 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:19.208492 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afade5d9-f0fe-4ec5-9a41-2edd121c05c3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:19.208605 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afade5d9-f0fe-4ec5-9a41-2edd121c05c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:19.227055 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-afade5d9-f0fe-4ec5-9a41-2edd121c05c3 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:28:19.228294 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-afade5d9-f0fe-4ec5-9a41-2edd121c05c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:28:19.293204 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 591/1171] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:28:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:28:19.563269 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ae248-177c-4a2c-8353-23c90c1c1d03 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:19.590852 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:19.678547 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ae248-177c-4a2c-8353-23c90c1c1d03 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:19.713270 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0b7c1-32c3-403d-bcc7-2c394cdf8888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:19.713889 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0b7c1-32c3-403d-bcc7-2c394cdf8888 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:19.714166 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0b7c1-32c3-403d-bcc7-2c394cdf8888 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:19.714439 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0b7c1-32c3-403d-bcc7-2c394cdf8888 None admin] PATH_INFO: `/v3/domains/5f564ce13c8e441a9bba9a35c5239380` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:19.725217 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0b7c1-32c3-403d-bcc7-2c394cdf8888 None admin] RBAC: Authorizing `identity:get_domain(domain_id=5f564ce13c8e441a9bba9a35c5239380)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:19.726642 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0b7c1-32c3-403d-bcc7-2c394cdf8888 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:19.728264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 581/1172] 10.222.0.26 () {56 vars in 1183 bytes} [Sun Sep 11 08:28:19 2022] GET /identity/v3/domains/5f564ce13c8e441a9bba9a35c5239380 => generated 267 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:28:19.734295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afade5d9-f0fe-4ec5-9a41-2edd121c05c3 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:19.762637 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:19.832790 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afade5d9-f0fe-4ec5-9a41-2edd121c05c3 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:19.865233 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b9503-404d-404a-a7ea-fe74808a14ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:19.865844 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b9503-404d-404a-a7ea-fe74808a14ca None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:19.866120 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b9503-404d-404a-a7ea-fe74808a14ca None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:19.866392 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b9503-404d-404a-a7ea-fe74808a14ca None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:19.867052 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b9503-404d-404a-a7ea-fe74808a14ca None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:19.868523 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b9503-404d-404a-a7ea-fe74808a14ca None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:19.984391 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 592/1173] 10.222.0.26 () {60 vars in 1141 bytes} [Sun Sep 11 08:28:19 2022] POST /identity/v3/projects => generated 361 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:28:22.215019 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a7565-a946-4aae-b9fa-64da5730cb1c None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:22.215585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a7565-a946-4aae-b9fa-64da5730cb1c None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:22.215585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a7565-a946-4aae-b9fa-64da5730cb1c None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:22.216946 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 582/1174] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:28:22.224063 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85181b1-e915-47d2-b966-b50c0727e293 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:22.224609 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85181b1-e915-47d2-b966-b50c0727e293 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:22.224609 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85181b1-e915-47d2-b966-b50c0727e293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:22.243206 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-a85181b1-e915-47d2-b966-b50c0727e293 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:28:22.244472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a85181b1-e915-47d2-b966-b50c0727e293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:28:22.310203 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 593/1175] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:28:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:28:22.583240 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a7565-a946-4aae-b9fa-64da5730cb1c None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:22.669852 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:22.687547 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a7565-a946-4aae-b9fa-64da5730cb1c None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:22.721205 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62cce1-f728-4a88-b6e2-6f69ecc89058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:22.721837 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62cce1-f728-4a88-b6e2-6f69ecc89058 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:22.722118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62cce1-f728-4a88-b6e2-6f69ecc89058 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:22.722392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62cce1-f728-4a88-b6e2-6f69ecc89058 None admin] PATH_INFO: `/v3/domains/5f564ce13c8e441a9bba9a35c5239380` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:22.723528 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b62cce1-f728-4a88-b6e2-6f69ecc89058 None admin] RBAC: Authorizing `identity:get_domain(domain_id=5f564ce13c8e441a9bba9a35c5239380)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:22.724950 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b62cce1-f728-4a88-b6e2-6f69ecc89058 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:22.726513 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 583/1176] 10.222.0.26 () {56 vars in 1183 bytes} [Sun Sep 11 08:28:22 2022] GET /identity/v3/domains/5f564ce13c8e441a9bba9a35c5239380 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:28:22.732390 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85181b1-e915-47d2-b966-b50c0727e293 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:22.746485 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:22.828472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85181b1-e915-47d2-b966-b50c0727e293 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:22.865177 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591534d1-5f4e-4174-9d85-98b215721c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:22.865700 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591534d1-5f4e-4174-9d85-98b215721c75 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:22.865977 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591534d1-5f4e-4174-9d85-98b215721c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:22.866247 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591534d1-5f4e-4174-9d85-98b215721c75 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:22.866904 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591534d1-5f4e-4174-9d85-98b215721c75 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:22.868359 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591534d1-5f4e-4174-9d85-98b215721c75 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:22.965961 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 594/1177] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Sep 11 08:28:22 2022] POST /identity/v3/users => generated 311 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:28:25.149580 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c19df8-ef5a-4df2-832c-a97fcf5578d6 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:25.150166 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c19df8-ef5a-4df2-832c-a97fcf5578d6 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:25.150166 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c19df8-ef5a-4df2-832c-a97fcf5578d6 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:25.151526 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 584/1178] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:28:25.157105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bab229-7990-4c4c-9d72-a3698f1f9e0b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:25.157517 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bab229-7990-4c4c-9d72-a3698f1f9e0b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:25.157652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bab229-7990-4c4c-9d72-a3698f1f9e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:25.175907 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-25bab229-7990-4c4c-9d72-a3698f1f9e0b None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:28:25.177108 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-25bab229-7990-4c4c-9d72-a3698f1f9e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:28:25.237778 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:25.243505 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 595/1179] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:28:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:28:25.521634 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c19df8-ef5a-4df2-832c-a97fcf5578d6 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:25.627866 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c19df8-ef5a-4df2-832c-a97fcf5578d6 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:25.660909 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd4ada-bab2-44af-9592-bffc6acaa906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:25.661536 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd4ada-bab2-44af-9592-bffc6acaa906 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:25.661819 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd4ada-bab2-44af-9592-bffc6acaa906 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:25.662094 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd4ada-bab2-44af-9592-bffc6acaa906 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:25.674344 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd4ada-bab2-44af-9592-bffc6acaa906 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:28:25.679270 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-54fd4ada-bab2-44af-9592-bffc6acaa906 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:28:25.679270 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:28:25.679270 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:28:25.679270 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:28:25.679270 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:28:25.679270 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:28:25.679270 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:28:25.679270 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:28:25.679270 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:28:25.679270 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:28:25.679270 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:28:25.679270 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:28:25.679270 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:28:25.679270 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:28:25.679270 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:28:25.679270 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:28:25.680481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:28:25.680481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:28:25.680481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:28:25.680481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:28:25.680481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:28:25.680481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:28:25.680481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:28:25.680481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:28:25.680481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:28:25.680481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:28:25.680481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:28:25.680481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:28:25.680481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:28:25.680481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:28:25.680481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:28:25.680481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:28:25.681614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:28:25.681614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:28:25.681614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:28:25.681614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:28:25.681614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:28:25.681614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:28:25.681614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:28:25.681614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:28:25.681614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:28:25.681614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:28:25.681614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:28:25.681614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:28:25.681614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 585/1180] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:28:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:28:25.686447 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bab229-7990-4c4c-9d72-a3698f1f9e0b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:25.793351 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bab229-7990-4c4c-9d72-a3698f1f9e0b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:25.827129 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeda044-ee44-475f-8546-ae19a383ddaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:25.827801 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeda044-ee44-475f-8546-ae19a383ddaa None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:25.828336 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeda044-ee44-475f-8546-ae19a383ddaa None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:25.828620 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeda044-ee44-475f-8546-ae19a383ddaa None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:25.829285 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeda044-ee44-475f-8546-ae19a383ddaa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:28:25.829589 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeda044-ee44-475f-8546-ae19a383ddaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:25.830955 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeda044-ee44-475f-8546-ae19a383ddaa None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:25.838872 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 596/1181] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:28:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:28:25.845490 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd4ada-bab2-44af-9592-bffc6acaa906 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:25.862096 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:25.944404 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd4ada-bab2-44af-9592-bffc6acaa906 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:25.977505 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f364b-16b4-4022-b55e-edeb97e72cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:25.978130 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f364b-16b4-4022-b55e-edeb97e72cfd None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:25.978410 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f364b-16b4-4022-b55e-edeb97e72cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:25.978684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f364b-16b4-4022-b55e-edeb97e72cfd None admin] PATH_INFO: `/v3/users/2986a9a2297846408e47cf7f3eba99e4` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:25.991846 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f364b-16b4-4022-b55e-edeb97e72cfd None admin] RBAC: Authorizing `identity:get_user(user_id=2986a9a2297846408e47cf7f3eba99e4)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:25.993274 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f364b-16b4-4022-b55e-edeb97e72cfd None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:25.994857 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 586/1182] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:28:25 2022] GET /identity/v3/users/2986a9a2297846408e47cf7f3eba99e4 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:28:26.000857 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeda044-ee44-475f-8546-ae19a383ddaa None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:26.058170 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:26.097313 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeda044-ee44-475f-8546-ae19a383ddaa None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:26.129868 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda452e-4395-41e2-a71e-bc6e3fabb2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:26.130469 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda452e-4395-41e2-a71e-bc6e3fabb2dd None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:26.130746 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda452e-4395-41e2-a71e-bc6e3fabb2dd None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:26.131017 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda452e-4395-41e2-a71e-bc6e3fabb2dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:26.194984 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda452e-4395-41e2-a71e-bc6e3fabb2dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:26.196489 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda452e-4395-41e2-a71e-bc6e3fabb2dd None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:26.251167 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:26.294131 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 597/1183] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:28:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 08:28:26.300176 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f364b-16b4-4022-b55e-edeb97e72cfd None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:26.367513 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:26.397029 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f364b-16b4-4022-b55e-edeb97e72cfd None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:26.430147 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc793f5-81d2-4a72-aa8c-32d5a03e229f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:26.430770 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc793f5-81d2-4a72-aa8c-32d5a03e229f None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:26.431051 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc793f5-81d2-4a72-aa8c-32d5a03e229f None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:26.431350 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc793f5-81d2-4a72-aa8c-32d5a03e229f None admin] PATH_INFO: `/v3/projects/3a6971a4684f4c979ab2454b8e2cb50a` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:26.432453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc793f5-81d2-4a72-aa8c-32d5a03e229f None admin] RBAC: Authorizing `identity:get_project(project_id=3a6971a4684f4c979ab2454b8e2cb50a)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:26.433870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc793f5-81d2-4a72-aa8c-32d5a03e229f None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:26.435510 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 587/1184] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:28:26 2022] GET /identity/v3/projects/3a6971a4684f4c979ab2454b8e2cb50a => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:28:26.441643 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda452e-4395-41e2-a71e-bc6e3fabb2dd None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:26.536447 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda452e-4395-41e2-a71e-bc6e3fabb2dd None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:26.568891 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f14ba3-99e9-458b-a555-ead51042dc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:26.569485 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f14ba3-99e9-458b-a555-ead51042dc3a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:26.569764 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f14ba3-99e9-458b-a555-ead51042dc3a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:26.570037 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f14ba3-99e9-458b-a555-ead51042dc3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:26.570759 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f14ba3-99e9-458b-a555-ead51042dc3a None admin] RBAC: Adding query filter params (role.id=d12af9f1dfb344cd8a6a493e165030ba, scope.project.id=3a6971a4684f4c979ab2454b8e2cb50a, user.id=2986a9a2297846408e47cf7f3eba99e4) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:28:26.571068 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f14ba3-99e9-458b-a555-ead51042dc3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:26.572528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f14ba3-99e9-458b-a555-ead51042dc3a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:26.578516 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 598/1185] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:28:26 2022] GET /identity/v3/role_assignments?user.id=2986a9a2297846408e47cf7f3eba99e4&scope.project.id=3a6971a4684f4c979ab2454b8e2cb50a&role.id=d12af9f1dfb344cd8a6a493e165030ba => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:28:28.706257 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295beb6d-d918-4702-94f7-58e0bbdb149a None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:28.706918 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295beb6d-d918-4702-94f7-58e0bbdb149a None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:28.706918 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295beb6d-d918-4702-94f7-58e0bbdb149a None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:28.708204 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 588/1186] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:28:28.713721 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366137d2-0c1f-45f0-9fb6-6b2f1e7f358f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:28.714323 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366137d2-0c1f-45f0-9fb6-6b2f1e7f358f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:28.714323 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366137d2-0c1f-45f0-9fb6-6b2f1e7f358f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:28.732693 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-366137d2-0c1f-45f0-9fb6-6b2f1e7f358f None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:28:28.733936 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-366137d2-0c1f-45f0-9fb6-6b2f1e7f358f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:28:28.751143 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:28.799511 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 599/1187] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:28:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:28:29.104759 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295beb6d-d918-4702-94f7-58e0bbdb149a None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:29.219803 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295beb6d-d918-4702-94f7-58e0bbdb149a None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:29.256770 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc810a5f-c54d-45de-b51a-04594b9612f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:29.257407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc810a5f-c54d-45de-b51a-04594b9612f2 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:29.257688 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc810a5f-c54d-45de-b51a-04594b9612f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:29.257962 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc810a5f-c54d-45de-b51a-04594b9612f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:29.264902 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:29.268721 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc810a5f-c54d-45de-b51a-04594b9612f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:28:29.273602 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-dc810a5f-c54d-45de-b51a-04594b9612f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:28:29.273602 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:28:29.273602 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:28:29.273602 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:28:29.273602 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:28:29.273602 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:28:29.273602 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:28:29.273602 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:28:29.273602 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:28:29.273602 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:28:29.273602 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:28:29.273602 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:28:29.273602 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:28:29.273602 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:28:29.273602 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:28:29.273602 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:28:29.274700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:28:29.274700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:28:29.274700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:28:29.274700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:28:29.274700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:28:29.274700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:28:29.274700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:28:29.274700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:28:29.274700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:28:29.274700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:28:29.274700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:28:29.274700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:28:29.274700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:28:29.274700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:28:29.274700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:28:29.274700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:28:29.278564 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:28:29.278564 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:28:29.278564 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:28:29.278564 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:28:29.278564 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:28:29.278564 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:28:29.278564 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:28:29.278564 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:28:29.278564 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:28:29.278564 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:28:29.278564 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:28:29.278564 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:28:29.278564 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 589/1188] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:28:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:28:29.281180 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366137d2-0c1f-45f0-9fb6-6b2f1e7f358f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:29.377104 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366137d2-0c1f-45f0-9fb6-6b2f1e7f358f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:29.409580 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad005a1-bb3f-49c7-abd0-d6cdd039bd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:29.410188 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad005a1-bb3f-49c7-abd0-d6cdd039bd26 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:29.410468 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad005a1-bb3f-49c7-abd0-d6cdd039bd26 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:29.410741 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad005a1-bb3f-49c7-abd0-d6cdd039bd26 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:29.411439 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad005a1-bb3f-49c7-abd0-d6cdd039bd26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:28:29.411747 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad005a1-bb3f-49c7-abd0-d6cdd039bd26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:29.413115 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad005a1-bb3f-49c7-abd0-d6cdd039bd26 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:29.421610 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 600/1189] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:28:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:28:29.430312 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc810a5f-c54d-45de-b51a-04594b9612f2 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:29.533758 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc810a5f-c54d-45de-b51a-04594b9612f2 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:29.568187 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4e35e-e8d6-48dc-bb74-e2d3fe8e6707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:29.568806 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4e35e-e8d6-48dc-bb74-e2d3fe8e6707 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:29.569080 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4e35e-e8d6-48dc-bb74-e2d3fe8e6707 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:29.569347 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4e35e-e8d6-48dc-bb74-e2d3fe8e6707 None admin] PATH_INFO: `/v3/users/2986a9a2297846408e47cf7f3eba99e4` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:29.570440 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4e35e-e8d6-48dc-bb74-e2d3fe8e6707 None admin] RBAC: Authorizing `identity:get_user(user_id=2986a9a2297846408e47cf7f3eba99e4)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:29.571886 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4e35e-e8d6-48dc-bb74-e2d3fe8e6707 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:29.573454 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 590/1190] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:28:29 2022] GET /identity/v3/users/2986a9a2297846408e47cf7f3eba99e4 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:28:29.579708 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad005a1-bb3f-49c7-abd0-d6cdd039bd26 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:29.599197 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:29.679796 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad005a1-bb3f-49c7-abd0-d6cdd039bd26 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:29.712602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb470ba-46a9-4c6d-bef8-1670471aba08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:29.713229 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb470ba-46a9-4c6d-bef8-1670471aba08 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:29.713511 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb470ba-46a9-4c6d-bef8-1670471aba08 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:29.713788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb470ba-46a9-4c6d-bef8-1670471aba08 None admin] PATH_INFO: `/v3/projects/3a6971a4684f4c979ab2454b8e2cb50a` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:29.714962 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb470ba-46a9-4c6d-bef8-1670471aba08 None admin] RBAC: Authorizing `identity:get_project(project_id=3a6971a4684f4c979ab2454b8e2cb50a)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:29.716434 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb470ba-46a9-4c6d-bef8-1670471aba08 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:29.718569 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 601/1191] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:28:29 2022] GET /identity/v3/projects/3a6971a4684f4c979ab2454b8e2cb50a => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:28:29.724615 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4e35e-e8d6-48dc-bb74-e2d3fe8e6707 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:29.789918 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:29.833194 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4e35e-e8d6-48dc-bb74-e2d3fe8e6707 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:29.869337 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1782a6-7269-4b9d-91bb-2ac2034af44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:29.869999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1782a6-7269-4b9d-91bb-2ac2034af44a None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:29.870281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1782a6-7269-4b9d-91bb-2ac2034af44a None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:29.870559 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1782a6-7269-4b9d-91bb-2ac2034af44a None admin] PATH_INFO: `/v3/projects/3a6971a4684f4c979ab2454b8e2cb50a/users/2986a9a2297846408e47cf7f3eba99e4/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:29.872425 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1782a6-7269-4b9d-91bb-2ac2034af44a None admin] RBAC: Authorizing `identity:create_grant(project_id=3a6971a4684f4c979ab2454b8e2cb50a, user_id=2986a9a2297846408e47cf7f3eba99e4, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:29.873877 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1782a6-7269-4b9d-91bb-2ac2034af44a None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:29.941820 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 591/1192] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Sep 11 08:28:29 2022] PUT /identity/v3/projects/3a6971a4684f4c979ab2454b8e2cb50a/users/2986a9a2297846408e47cf7f3eba99e4/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:28:32.089342 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34675a3-cfe1-4796-9a4a-c08c1a25b6ab None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:32.089905 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34675a3-cfe1-4796-9a4a-c08c1a25b6ab None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:32.089905 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34675a3-cfe1-4796-9a4a-c08c1a25b6ab None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:32.091220 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 602/1193] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:28:32.096688 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36005c-9c29-4fe4-a15d-d9d071941186 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:32.097093 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36005c-9c29-4fe4-a15d-d9d071941186 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:32.097240 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36005c-9c29-4fe4-a15d-d9d071941186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:32.115000 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-ca36005c-9c29-4fe4-a15d-d9d071941186 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:28:32.116240 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ca36005c-9c29-4fe4-a15d-d9d071941186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:28:32.183262 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 592/1194] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:28:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:28:32.457331 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34675a3-cfe1-4796-9a4a-c08c1a25b6ab None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:32.542684 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:32.559159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34675a3-cfe1-4796-9a4a-c08c1a25b6ab None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:32.592315 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf059a-e9ee-41b1-bb2f-67a785734bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:32.593519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf059a-e9ee-41b1-bb2f-67a785734bac None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:32.593798 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf059a-e9ee-41b1-bb2f-67a785734bac None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:32.594071 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf059a-e9ee-41b1-bb2f-67a785734bac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:32.603970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf059a-e9ee-41b1-bb2f-67a785734bac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:28:32.609413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-62cf059a-e9ee-41b1-bb2f-67a785734bac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:28:32.609413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:28:32.609413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:28:32.609413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:28:32.609413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:28:32.609413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:28:32.609413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:28:32.609413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:28:32.609413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:28:32.609413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:28:32.609413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:28:32.609413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:28:32.609413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:28:32.609413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:28:32.609413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:28:32.609413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:28:32.610566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:28:32.610566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:28:32.610566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:28:32.610566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:28:32.610566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:28:32.610566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:28:32.610566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:28:32.610566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:28:32.610566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:28:32.610566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:28:32.610566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:28:32.610566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:28:32.610566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:28:32.610566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:28:32.610566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:28:32.610566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:28:32.611867 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:28:32.611867 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:28:32.611867 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:28:32.611867 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:28:32.611867 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:28:32.611867 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:28:32.611867 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:28:32.611867 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:28:32.611867 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:28:32.611867 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:28:32.611867 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:28:32.611867 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:28:32.611867 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 603/1195] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:28:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:28:32.616543 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36005c-9c29-4fe4-a15d-d9d071941186 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:32.670511 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:32.713618 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36005c-9c29-4fe4-a15d-d9d071941186 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:32.747942 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a917688-0ce2-40d9-9c94-5930e30b8513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:32.748552 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a917688-0ce2-40d9-9c94-5930e30b8513 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:32.748834 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a917688-0ce2-40d9-9c94-5930e30b8513 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:32.749108 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a917688-0ce2-40d9-9c94-5930e30b8513 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:32.749773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a917688-0ce2-40d9-9c94-5930e30b8513 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:28:32.750076 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a917688-0ce2-40d9-9c94-5930e30b8513 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:32.751468 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a917688-0ce2-40d9-9c94-5930e30b8513 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:32.759348 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 593/1196] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:28:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:28:32.765335 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf059a-e9ee-41b1-bb2f-67a785734bac None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:32.862943 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf059a-e9ee-41b1-bb2f-67a785734bac None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:32.896359 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7cec14-ea04-464d-b253-c1dc625f0840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:32.896988 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cec14-ea04-464d-b253-c1dc625f0840 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:32.897268 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cec14-ea04-464d-b253-c1dc625f0840 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:32.897539 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cec14-ea04-464d-b253-c1dc625f0840 None admin] PATH_INFO: `/v3/users/2986a9a2297846408e47cf7f3eba99e4` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:32.898658 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7cec14-ea04-464d-b253-c1dc625f0840 None admin] RBAC: Authorizing `identity:get_user(user_id=2986a9a2297846408e47cf7f3eba99e4)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:32.900125 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7cec14-ea04-464d-b253-c1dc625f0840 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:32.901702 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 604/1197] 10.222.0.26 () {56 vars in 1177 bytes} [Sun Sep 11 08:28:32 2022] GET /identity/v3/users/2986a9a2297846408e47cf7f3eba99e4 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:28:32.908101 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a917688-0ce2-40d9-9c94-5930e30b8513 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:33.006718 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a917688-0ce2-40d9-9c94-5930e30b8513 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:33.023664 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:33.040535 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9b08d-2fdd-4f63-9069-5eb454bd76da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:33.041146 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9b08d-2fdd-4f63-9069-5eb454bd76da None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:33.041432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9b08d-2fdd-4f63-9069-5eb454bd76da None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:33.041711 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9b08d-2fdd-4f63-9069-5eb454bd76da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:33.107142 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9b08d-2fdd-4f63-9069-5eb454bd76da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:33.108669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9b08d-2fdd-4f63-9069-5eb454bd76da None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:33.205917 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 594/1198] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:28:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 08:28:33.212044 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7cec14-ea04-464d-b253-c1dc625f0840 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:33.238598 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:33.319282 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7cec14-ea04-464d-b253-c1dc625f0840 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:33.351140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed919e-4415-481b-8449-db17c9685af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:33.351781 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed919e-4415-481b-8449-db17c9685af3 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:33.352056 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed919e-4415-481b-8449-db17c9685af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:33.352325 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed919e-4415-481b-8449-db17c9685af3 None admin] PATH_INFO: `/v3/projects/3a6971a4684f4c979ab2454b8e2cb50a` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:33.353427 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed919e-4415-481b-8449-db17c9685af3 None admin] RBAC: Authorizing `identity:get_project(project_id=3a6971a4684f4c979ab2454b8e2cb50a)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:33.354850 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed919e-4415-481b-8449-db17c9685af3 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:33.356542 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 605/1199] 10.222.0.26 () {56 vars in 1186 bytes} [Sun Sep 11 08:28:33 2022] GET /identity/v3/projects/3a6971a4684f4c979ab2454b8e2cb50a => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:28:33.362743 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9b08d-2fdd-4f63-9069-5eb454bd76da None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:28:33.381056 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:33.459493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9b08d-2fdd-4f63-9069-5eb454bd76da None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:28:33.503979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e8101-da94-4388-92b5-c17f6084f8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:28:33.504581 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e8101-da94-4388-92b5-c17f6084f8e0 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:28:33.504859 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e8101-da94-4388-92b5-c17f6084f8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:28:33.505132 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e8101-da94-4388-92b5-c17f6084f8e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:28:33.505851 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e8101-da94-4388-92b5-c17f6084f8e0 None admin] RBAC: Adding query filter params (role.id=d12af9f1dfb344cd8a6a493e165030ba, scope.project.id=3a6971a4684f4c979ab2454b8e2cb50a, user.id=2986a9a2297846408e47cf7f3eba99e4) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:28:33.506160 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e8101-da94-4388-92b5-c17f6084f8e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:28:33.507620 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e8101-da94-4388-92b5-c17f6084f8e0 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:28:33.513260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 595/1200] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:28:33 2022] GET /identity/v3/role_assignments?user.id=2986a9a2297846408e47cf7f3eba99e4&scope.project.id=3a6971a4684f4c979ab2454b8e2cb50a&role.id=d12af9f1dfb344cd8a6a493e165030ba => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:28:43.347042 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=60 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:28:43.510637 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=59 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:29:53.905115 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051441b-15f0-44e1-9e72-e6cb66ffe67c None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:29:53.905686 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051441b-15f0-44e1-9e72-e6cb66ffe67c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:29:53.905686 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051441b-15f0-44e1-9e72-e6cb66ffe67c None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:29:53.906997 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 606/1201] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:29:53.912427 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d07129-b067-4440-92b4-31f75ef0c776 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:29:53.912848 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d07129-b067-4440-92b4-31f75ef0c776 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:29:53.912985 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d07129-b067-4440-92b4-31f75ef0c776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:29:53.932601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-94d07129-b067-4440-92b4-31f75ef0c776 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:29:53.933768 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-94d07129-b067-4440-92b4-31f75ef0c776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:29:54.001938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 596/1202] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:29:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:29:54.281830 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051441b-15f0-44e1-9e72-e6cb66ffe67c None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:29:54.383219 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051441b-15f0-44e1-9e72-e6cb66ffe67c None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:29:54.416581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905a551-6676-449b-a66c-ae7c72057ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:29:54.417206 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905a551-6676-449b-a66c-ae7c72057ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:29:54.417487 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905a551-6676-449b-a66c-ae7c72057ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:29:54.417761 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905a551-6676-449b-a66c-ae7c72057ec5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:29:54.428441 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905a551-6676-449b-a66c-ae7c72057ec5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:29:54.432394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905a551-6676-449b-a66c-ae7c72057ec5 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:29:54.448007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-8905a551-6676-449b-a66c-ae7c72057ec5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:29:54.448007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:29:54.448007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:29:54.448007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:29:54.448007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:29:54.448007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:29:54.448007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:29:54.448007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:29:54.448007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:29:54.448007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:29:54.448007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:29:54.448007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:29:54.448007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:29:54.448007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:29:54.448007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:29:54.448007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:29:54.449347 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:29:54.449347 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:29:54.449347 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:29:54.449347 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:29:54.449347 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:29:54.449347 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:29:54.449347 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:29:54.449347 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:29:54.449347 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:29:54.449347 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:29:54.449347 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:29:54.449347 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:29:54.449347 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:29:54.449347 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:29:54.449347 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:29:54.449347 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:29:54.449347 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:29:54.450410 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:29:54.450410 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:29:54.450410 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:29:54.450410 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 607/1203] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:29:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:29:54.456925 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d07129-b067-4440-92b4-31f75ef0c776 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:29:54.555921 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d07129-b067-4440-92b4-31f75ef0c776 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:29:54.585473 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:29:54.591577 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3e9ff-ee65-4616-8103-dd19ba4a5bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:29:54.593126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3e9ff-ee65-4616-8103-dd19ba4a5bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:29:54.593126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3e9ff-ee65-4616-8103-dd19ba4a5bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:29:54.593126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3e9ff-ee65-4616-8103-dd19ba4a5bc9 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:29:54.593406 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3e9ff-ee65-4616-8103-dd19ba4a5bc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:29:54.593603 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3e9ff-ee65-4616-8103-dd19ba4a5bc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:29:54.594949 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3e9ff-ee65-4616-8103-dd19ba4a5bc9 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:29:54.606112 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 597/1204] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:29:54.612523 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905a551-6676-449b-a66c-ae7c72057ec5 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:29:54.665876 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:29:54.714311 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905a551-6676-449b-a66c-ae7c72057ec5 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:29:54.747662 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e884981-40f9-4f41-91a7-28c48cb994e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:29:54.748267 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e884981-40f9-4f41-91a7-28c48cb994e3 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:29:54.748549 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e884981-40f9-4f41-91a7-28c48cb994e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:29:54.749372 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e884981-40f9-4f41-91a7-28c48cb994e3 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:29:54.750020 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e884981-40f9-4f41-91a7-28c48cb994e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:29:54.751476 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e884981-40f9-4f41-91a7-28c48cb994e3 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:29:54.844204 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 608/1205] 10.222.0.26 () {60 vars in 1132 bytes} [Sun Sep 11 08:29:54 2022] POST /identity/v3/users => generated 251 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:29:57.060713 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b0002-44fe-4f58-aa60-c62b174f060c None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:29:57.061320 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b0002-44fe-4f58-aa60-c62b174f060c None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:29:57.061320 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b0002-44fe-4f58-aa60-c62b174f060c None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:29:57.062662 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 598/1206] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:29:57.068014 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9133b7a-cd38-4bb0-87ed-07e1678640f7 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:29:57.068468 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9133b7a-cd38-4bb0-87ed-07e1678640f7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:29:57.068561 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9133b7a-cd38-4bb0-87ed-07e1678640f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:29:57.087542 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f9133b7a-cd38-4bb0-87ed-07e1678640f7 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:29:57.088735 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f9133b7a-cd38-4bb0-87ed-07e1678640f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:29:57.154716 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 609/1207] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:29:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:29:57.446637 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b0002-44fe-4f58-aa60-c62b174f060c None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:29:57.552693 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b0002-44fe-4f58-aa60-c62b174f060c None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:29:57.586628 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede4077-8c53-4ce3-b7d0-bcb3f0b220bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:29:57.587268 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede4077-8c53-4ce3-b7d0-bcb3f0b220bd None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:29:57.587553 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede4077-8c53-4ce3-b7d0-bcb3f0b220bd None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:29:57.587830 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede4077-8c53-4ce3-b7d0-bcb3f0b220bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:29:57.598272 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede4077-8c53-4ce3-b7d0-bcb3f0b220bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:29:57.603040 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-fede4077-8c53-4ce3-b7d0-bcb3f0b220bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:29:57.603040 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:29:57.603040 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:29:57.603040 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:29:57.603040 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:29:57.603040 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:29:57.603040 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:29:57.603040 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:29:57.603040 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:29:57.603040 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:29:57.603040 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:29:57.603040 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:29:57.603040 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:29:57.603040 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:29:57.603040 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:29:57.603040 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:29:57.604324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:29:57.604324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:29:57.604324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:29:57.604324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:29:57.604324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:29:57.604324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:29:57.604324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:29:57.604324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:29:57.604324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:29:57.604324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:29:57.604324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:29:57.604324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:29:57.604324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:29:57.604324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:29:57.604324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:29:57.604324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:29:57.605320 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:29:57.605320 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:29:57.605320 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:29:57.605320 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:29:57.605320 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:29:57.605320 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:29:57.605320 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:29:57.605320 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:29:57.605320 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:29:57.605320 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:29:57.605320 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:29:57.605320 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:29:57.605320 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 599/1208] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Sep 11 08:29:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:29:57.610745 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9133b7a-cd38-4bb0-87ed-07e1678640f7 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:29:57.651782 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:29:57.720072 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9133b7a-cd38-4bb0-87ed-07e1678640f7 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:29:57.746567 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5a4a0-69ef-42df-a736-ea51fd081028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:29:57.747174 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5a4a0-69ef-42df-a736-ea51fd081028 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:29:57.747488 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5a4a0-69ef-42df-a736-ea51fd081028 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:29:57.747763 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5a4a0-69ef-42df-a736-ea51fd081028 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:29:57.748435 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5a4a0-69ef-42df-a736-ea51fd081028 None admin] RBAC: Adding query filter params (name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:29:57.749299 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5a4a0-69ef-42df-a736-ea51fd081028 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:29:57.750672 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5a4a0-69ef-42df-a736-ea51fd081028 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:29:57.758614 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 610/1209] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Sep 11 08:29:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:29:57.764646 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede4077-8c53-4ce3-b7d0-bcb3f0b220bd None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:29:57.824244 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:29:57.882068 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede4077-8c53-4ce3-b7d0-bcb3f0b220bd None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:29:57.914508 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7662a0-f8b5-4f51-a940-fbd883cb3995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:29:57.915196 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7662a0-f8b5-4f51-a940-fbd883cb3995 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:29:57.915505 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7662a0-f8b5-4f51-a940-fbd883cb3995 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:29:57.915780 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7662a0-f8b5-4f51-a940-fbd883cb3995 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:29:57.926942 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7662a0-f8b5-4f51-a940-fbd883cb3995 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:29:57.928877 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7662a0-f8b5-4f51-a940-fbd883cb3995 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:29:57.943800 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-6d7662a0-f8b5-4f51-a940-fbd883cb3995 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:29:57.943800 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:29:57.943800 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:29:57.943800 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:29:57.943800 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:29:57.943800 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:29:57.943800 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:29:57.943800 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:29:57.943800 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:29:57.943800 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:29:57.943800 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:29:57.943800 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:29:57.943800 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:29:57.943800 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:29:57.943800 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:29:57.943800 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:29:57.948889 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:29:57.948889 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:29:57.948889 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:29:57.948889 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:29:57.948889 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:29:57.948889 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:29:57.948889 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:29:57.948889 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:29:57.948889 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:29:57.948889 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:29:57.948889 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:29:57.948889 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:29:57.948889 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:29:57.948889 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:29:57.948889 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:29:57.948889 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:29:57.948889 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:29:57.950190 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:29:57.950190 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:29:57.950190 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:29:57.950190 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 600/1210] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:29:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:29:57.950718 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5a4a0-69ef-42df-a736-ea51fd081028 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:29:58.046154 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:29:58.048923 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5a4a0-69ef-42df-a736-ea51fd081028 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:29:58.080639 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3e5f1-eab4-41ab-bf1a-b243b00763a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:29:58.083533 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3e5f1-eab4-41ab-bf1a-b243b00763a4 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:29:58.083533 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3e5f1-eab4-41ab-bf1a-b243b00763a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:29:58.083533 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3e5f1-eab4-41ab-bf1a-b243b00763a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:29:58.083533 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3e5f1-eab4-41ab-bf1a-b243b00763a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:29:58.083533 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3e5f1-eab4-41ab-bf1a-b243b00763a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:29:58.084057 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3e5f1-eab4-41ab-bf1a-b243b00763a4 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:29:58.096909 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 611/1211] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:29:58.103007 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7662a0-f8b5-4f51-a940-fbd883cb3995 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:29:58.211763 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7662a0-f8b5-4f51-a940-fbd883cb3995 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:29:58.213299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:29:58.247107 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f334685-5c29-48b6-bb09-d302e45181df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:29:58.247766 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f334685-5c29-48b6-bb09-d302e45181df None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:29:58.248048 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f334685-5c29-48b6-bb09-d302e45181df None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:29:58.248321 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f334685-5c29-48b6-bb09-d302e45181df None admin] PATH_INFO: `/v3/users/placement` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:29:58.257374 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f334685-5c29-48b6-bb09-d302e45181df None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:29:58.258798 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f334685-5c29-48b6-bb09-d302e45181df None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:29:58.270516 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-2f334685-5c29-48b6-bb09-d302e45181df None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 08:29:58.270516 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:29:58.270516 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:29:58.270516 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:29:58.270516 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:29:58.270516 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:29:58.270516 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:29:58.270516 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:29:58.270516 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:29:58.270516 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:29:58.270516 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:29:58.270516 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:29:58.270516 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:29:58.270516 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:29:58.270516 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:29:58.270516 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:29:58.271700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:29:58.271700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:29:58.271700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:29:58.271700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:29:58.271700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:29:58.271700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:29:58.271700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:29:58.271700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:29:58.271700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:29:58.271700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:29:58.271700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:29:58.271700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:29:58.271700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:29:58.271700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:29:58.271700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:29:58.271700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:29:58.271700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:29:58.271700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:29:58.272860 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:29:58.272860 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:29:58.272860 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:29:58.272860 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:29:58.272860 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:29:58.272860 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:29:58.272860 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:29:58.272860 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:29:58.272860 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 08:29:58.272860 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:29:58.272860 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 601/1212] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:29:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:29:58.278128 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3e5f1-eab4-41ab-bf1a-b243b00763a4 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:29:58.379606 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3e5f1-eab4-41ab-bf1a-b243b00763a4 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:29:58.412029 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a24002-9f1c-426b-b3fd-22c5dcd30046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:29:58.412626 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a24002-9f1c-426b-b3fd-22c5dcd30046 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:29:58.412907 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a24002-9f1c-426b-b3fd-22c5dcd30046 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:29:58.413189 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a24002-9f1c-426b-b3fd-22c5dcd30046 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:29:58.414476 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a24002-9f1c-426b-b3fd-22c5dcd30046 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:29:58.414476 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a24002-9f1c-426b-b3fd-22c5dcd30046 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:29:58.415678 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a24002-9f1c-426b-b3fd-22c5dcd30046 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:29:58.433310 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 612/1213] 10.222.0.26 () {56 vars in 1143 bytes} [Sun Sep 11 08:29:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:29:58.439825 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f334685-5c29-48b6-bb09-d302e45181df None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:29:58.541168 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f334685-5c29-48b6-bb09-d302e45181df None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:29:58.575050 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21160163-92bf-490a-9ab1-505cf582838e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:29:58.575688 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21160163-92bf-490a-9ab1-505cf582838e None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:29:58.575970 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21160163-92bf-490a-9ab1-505cf582838e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:29:58.576244 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21160163-92bf-490a-9ab1-505cf582838e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:29:58.606634 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:29:58.644644 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21160163-92bf-490a-9ab1-505cf582838e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:29:58.646052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21160163-92bf-490a-9ab1-505cf582838e None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:29:58.751022 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 602/1214] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:29:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 08:29:58.757143 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a24002-9f1c-426b-b3fd-22c5dcd30046 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:29:58.784368 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:29:58.869111 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a24002-9f1c-426b-b3fd-22c5dcd30046 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:29:58.903579 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e0254-2a60-46e2-bcf0-1e6645e70d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:29:58.904130 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e0254-2a60-46e2-bcf0-1e6645e70d9a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:29:58.904412 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e0254-2a60-46e2-bcf0-1e6645e70d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:29:58.904686 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e0254-2a60-46e2-bcf0-1e6645e70d9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:29:58.916614 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e0254-2a60-46e2-bcf0-1e6645e70d9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:29:58.918088 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e0254-2a60-46e2-bcf0-1e6645e70d9a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:29:58.934184 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-998e0254-2a60-46e2-bcf0-1e6645e70d9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:29:58.934184 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:29:58.934184 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:29:58.934184 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:29:58.934184 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:29:58.934184 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:29:58.934184 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:29:58.934184 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:29:58.934184 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:29:58.934184 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:29:58.934184 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:29:58.934184 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:29:58.934184 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:29:58.934184 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:29:58.934184 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:29:58.934184 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:29:58.935453 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:29:58.935453 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:29:58.935453 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:29:58.935453 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:29:58.935453 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:29:58.935453 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:29:58.935453 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:29:58.935453 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:29:58.935453 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:29:58.935453 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:29:58.935453 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:29:58.935453 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:29:58.935453 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:29:58.935453 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:29:58.935453 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:29:58.935453 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:29:58.935453 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:29:58.936598 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:29:58.936598 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:29:58.936598 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:29:58.936598 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 613/1215] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:29:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:29:58.941347 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21160163-92bf-490a-9ab1-505cf582838e None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:29:59.004727 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:29:59.044876 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21160163-92bf-490a-9ab1-505cf582838e None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:29:59.078972 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15004e6-10f2-4771-baaa-f9e5dfdf296c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:29:59.079687 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15004e6-10f2-4771-baaa-f9e5dfdf296c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:29:59.079971 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15004e6-10f2-4771-baaa-f9e5dfdf296c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:29:59.080247 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15004e6-10f2-4771-baaa-f9e5dfdf296c None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:29:59.080885 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15004e6-10f2-4771-baaa-f9e5dfdf296c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:29:59.081193 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15004e6-10f2-4771-baaa-f9e5dfdf296c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:29:59.082551 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15004e6-10f2-4771-baaa-f9e5dfdf296c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:29:59.094498 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 603/1216] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:29:59.101731 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e0254-2a60-46e2-bcf0-1e6645e70d9a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:29:59.172925 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:29:59.204437 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e0254-2a60-46e2-bcf0-1e6645e70d9a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:29:59.238626 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc302c-3f38-4613-ac66-1c8fd97a5511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:29:59.239321 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc302c-3f38-4613-ac66-1c8fd97a5511 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:29:59.245447 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc302c-3f38-4613-ac66-1c8fd97a5511 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:29:59.245447 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc302c-3f38-4613-ac66-1c8fd97a5511 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:29:59.246680 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc302c-3f38-4613-ac66-1c8fd97a5511 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:29:59.248177 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc302c-3f38-4613-ac66-1c8fd97a5511 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:29:59.259667 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-7afc302c-3f38-4613-ac66-1c8fd97a5511 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:29:59.259667 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:29:59.259667 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:29:59.259667 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:29:59.259667 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:29:59.259667 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:29:59.259667 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:29:59.259667 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:29:59.259667 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:29:59.259667 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:29:59.259667 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:29:59.259667 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:29:59.259667 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:29:59.259667 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:29:59.259667 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:29:59.260800 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:29:59.260800 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:29:59.260800 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:29:59.260800 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:29:59.260800 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:29:59.260800 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:29:59.260800 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:29:59.260800 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:29:59.260800 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:29:59.260800 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:29:59.260800 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:29:59.260800 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:29:59.260800 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:29:59.260800 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:29:59.260800 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:29:59.260800 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:29:59.260800 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:29:59.262045 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:29:59.262045 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:29:59.262045 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:29:59.262045 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:29:59.262045 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:29:59.262045 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:29:59.262045 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:29:59.262045 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:29:59.262045 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 614/1217] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:29:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:29:59.267388 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15004e6-10f2-4771-baaa-f9e5dfdf296c None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:29:59.370504 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15004e6-10f2-4771-baaa-f9e5dfdf296c None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:29:59.393705 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:29:59.405761 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5882a-dc6f-4305-91d2-585ef906a98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:29:59.406376 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5882a-dc6f-4305-91d2-585ef906a98c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:29:59.406659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5882a-dc6f-4305-91d2-585ef906a98c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:29:59.406941 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5882a-dc6f-4305-91d2-585ef906a98c None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:29:59.407675 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5882a-dc6f-4305-91d2-585ef906a98c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:29:59.407986 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5882a-dc6f-4305-91d2-585ef906a98c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:29:59.409480 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5882a-dc6f-4305-91d2-585ef906a98c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:29:59.421949 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 604/1218] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:29:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:29:59.428668 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc302c-3f38-4613-ac66-1c8fd97a5511 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:29:59.532644 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc302c-3f38-4613-ac66-1c8fd97a5511 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:29:59.560431 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:29:59.566691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e3ed6-0be9-466a-bc74-abce9835a67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:29:59.567313 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e3ed6-0be9-466a-bc74-abce9835a67f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:29:59.567594 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e3ed6-0be9-466a-bc74-abce9835a67f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:29:59.567870 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e3ed6-0be9-466a-bc74-abce9835a67f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:29:59.568596 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e3ed6-0be9-466a-bc74-abce9835a67f None admin] RBAC: Adding query filter params (role.id=b936dc45662c4ac195fdbf9e8ac589b0, scope.project.id=b6ed5f989f4248d7bab2548eb350fe17, user.id=a48c49f7a9f44cef89dd024fecea422f) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:29:59.568902 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e3ed6-0be9-466a-bc74-abce9835a67f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:29:59.570342 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e3ed6-0be9-466a-bc74-abce9835a67f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:29:59.575706 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 615/1219] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:29:59 2022] GET /identity/v3/role_assignments?user.id=a48c49f7a9f44cef89dd024fecea422f&scope.project.id=b6ed5f989f4248d7bab2548eb350fe17&role.id=b936dc45662c4ac195fdbf9e8ac589b0 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:30:01.770228 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2b37e-0c7a-4bac-abdb-adfcb8c7db5b None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:01.770760 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2b37e-0c7a-4bac-abdb-adfcb8c7db5b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:01.770903 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2b37e-0c7a-4bac-abdb-adfcb8c7db5b None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:01.772186 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 605/1220] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:30:01.777391 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cbc77-4e9d-48fc-b863-8c177d260150 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:01.777844 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cbc77-4e9d-48fc-b863-8c177d260150 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:01.777945 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cbc77-4e9d-48fc-b863-8c177d260150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:01.797261 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-6a8cbc77-4e9d-48fc-b863-8c177d260150 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:30:01.798459 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6a8cbc77-4e9d-48fc-b863-8c177d260150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:30:01.864076 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 616/1221] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:30:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:30:02.144603 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2b37e-0c7a-4bac-abdb-adfcb8c7db5b None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:02.261917 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2b37e-0c7a-4bac-abdb-adfcb8c7db5b None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:02.302799 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14b036-c44b-4249-a006-ed4f67413194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:02.303463 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14b036-c44b-4249-a006-ed4f67413194 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:02.303739 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14b036-c44b-4249-a006-ed4f67413194 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:02.304017 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14b036-c44b-4249-a006-ed4f67413194 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:02.314199 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14b036-c44b-4249-a006-ed4f67413194 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:30:02.319126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-0f14b036-c44b-4249-a006-ed4f67413194 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:30:02.319126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:30:02.319126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:30:02.319126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:30:02.319126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:30:02.319126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:30:02.319126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:30:02.319126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:30:02.319126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:30:02.319126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:30:02.319126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:30:02.319126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:30:02.319126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:30:02.319126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:30:02.319126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:30:02.319126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:30:02.320427 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:30:02.320427 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:30:02.320427 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:30:02.320427 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:30:02.320427 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:30:02.320427 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:30:02.320427 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:30:02.320427 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:30:02.320427 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:30:02.320427 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:30:02.320427 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:30:02.320427 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:30:02.320427 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:30:02.320427 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:30:02.320427 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:30:02.320427 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:30:02.321281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:30:02.321281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:30:02.321281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:30:02.321281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:30:02.321281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:30:02.321281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:30:02.321281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:30:02.321281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:30:02.321281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:30:02.321281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:30:02.321281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:30:02.321281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:30:02.321281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 606/1222] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Sep 11 08:30:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:30:02.326422 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8cbc77-4e9d-48fc-b863-8c177d260150 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:02.424734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8cbc77-4e9d-48fc-b863-8c177d260150 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:02.448451 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:02.459424 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae7a43-1b65-4998-b58f-5e89b5550dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:02.460028 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae7a43-1b65-4998-b58f-5e89b5550dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:02.460304 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae7a43-1b65-4998-b58f-5e89b5550dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:02.460573 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae7a43-1b65-4998-b58f-5e89b5550dc1 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:02.461232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae7a43-1b65-4998-b58f-5e89b5550dc1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:30:02.461588 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae7a43-1b65-4998-b58f-5e89b5550dc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:02.462922 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae7a43-1b65-4998-b58f-5e89b5550dc1 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:02.471277 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 617/1223] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Sep 11 08:30:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:30:02.477296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14b036-c44b-4249-a006-ed4f67413194 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:02.527606 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:02.587232 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14b036-c44b-4249-a006-ed4f67413194 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:02.621290 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846e6d3-010a-4350-8162-e5aeea93fb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:02.621922 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846e6d3-010a-4350-8162-e5aeea93fb4c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:02.622200 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846e6d3-010a-4350-8162-e5aeea93fb4c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:02.622471 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846e6d3-010a-4350-8162-e5aeea93fb4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:02.633135 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846e6d3-010a-4350-8162-e5aeea93fb4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:02.634567 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846e6d3-010a-4350-8162-e5aeea93fb4c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:02.648481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-2846e6d3-010a-4350-8162-e5aeea93fb4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:30:02.648481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:30:02.648481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:30:02.648481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:30:02.648481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:30:02.648481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:30:02.648481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:30:02.648481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:30:02.648481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:30:02.648481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:30:02.648481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:30:02.648481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:30:02.648481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:30:02.648481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:30:02.648481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:30:02.648481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:30:02.649682 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:30:02.649682 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:30:02.649682 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:30:02.649682 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:30:02.649682 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:30:02.649682 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:30:02.649682 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:30:02.649682 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:30:02.649682 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:30:02.649682 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:30:02.649682 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:30:02.649682 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:30:02.649682 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:30:02.649682 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:30:02.649682 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:30:02.649682 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:30:02.649682 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:30:02.650969 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:30:02.650969 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:30:02.650969 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:30:02.650969 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 607/1224] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:30:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:30:02.656188 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae7a43-1b65-4998-b58f-5e89b5550dc1 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:02.758099 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae7a43-1b65-4998-b58f-5e89b5550dc1 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:02.792295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7aa3e-84c0-4be8-90b4-1e39b1278c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:02.792955 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7aa3e-84c0-4be8-90b4-1e39b1278c8f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:02.793180 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7aa3e-84c0-4be8-90b4-1e39b1278c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:02.793452 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7aa3e-84c0-4be8-90b4-1e39b1278c8f None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:02.794095 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7aa3e-84c0-4be8-90b4-1e39b1278c8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:30:02.794400 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7aa3e-84c0-4be8-90b4-1e39b1278c8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:02.796441 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7aa3e-84c0-4be8-90b4-1e39b1278c8f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:02.808080 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 618/1225] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:30:02.813827 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846e6d3-010a-4350-8162-e5aeea93fb4c None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:02.909034 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:02.915589 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846e6d3-010a-4350-8162-e5aeea93fb4c None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:02.950429 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcf829-ff09-4ade-abac-cbc36ae33f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:02.951085 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcf829-ff09-4ade-abac-cbc36ae33f39 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:02.951432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcf829-ff09-4ade-abac-cbc36ae33f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:02.952187 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcf829-ff09-4ade-abac-cbc36ae33f39 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:02.961002 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcf829-ff09-4ade-abac-cbc36ae33f39 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:02.962459 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcf829-ff09-4ade-abac-cbc36ae33f39 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:02.974979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-4ffcf829-ff09-4ade-abac-cbc36ae33f39 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 08:30:02.974979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:30:02.974979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:30:02.974979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:30:02.974979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:30:02.974979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:30:02.974979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:30:02.974979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:30:02.974979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:30:02.974979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:30:02.974979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:30:02.974979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:30:02.974979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:30:02.974979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:30:02.974979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:30:02.974979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:30:02.976238 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:30:02.976238 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:30:02.976238 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:30:02.976238 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:30:02.976238 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:30:02.976238 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:30:02.976238 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:30:02.976238 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:30:02.976238 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:30:02.976238 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:30:02.976238 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:30:02.976238 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:30:02.976238 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:30:02.976238 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:30:02.976238 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:30:02.976238 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:30:02.976238 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:30:02.976238 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:30:02.977633 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:30:02.977633 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:30:02.977633 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:30:02.977633 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:30:02.977633 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:30:02.977633 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:30:02.977633 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:30:02.977633 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:30:02.977633 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 08:30:02.977633 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:30:02.977633 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 608/1226] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:30:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:30:02.981974 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7aa3e-84c0-4be8-90b4-1e39b1278c8f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:03.029188 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:03.083143 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7aa3e-84c0-4be8-90b4-1e39b1278c8f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:03.119552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853eebb-5751-4e23-806c-b08f3e8c01ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:03.120166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853eebb-5751-4e23-806c-b08f3e8c01ee None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:03.120448 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853eebb-5751-4e23-806c-b08f3e8c01ee None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:03.120724 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853eebb-5751-4e23-806c-b08f3e8c01ee None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:03.121465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853eebb-5751-4e23-806c-b08f3e8c01ee None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:30:03.121773 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853eebb-5751-4e23-806c-b08f3e8c01ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:03.123291 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853eebb-5751-4e23-806c-b08f3e8c01ee None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:03.141932 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 619/1227] 10.222.0.26 () {56 vars in 1143 bytes} [Sun Sep 11 08:30:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:30:03.147092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcf829-ff09-4ade-abac-cbc36ae33f39 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:03.247397 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcf829-ff09-4ade-abac-cbc36ae33f39 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:03.281362 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d254d7e-5756-413d-b378-83cd9ebf8934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:03.281923 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d254d7e-5756-413d-b378-83cd9ebf8934 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:03.282208 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d254d7e-5756-413d-b378-83cd9ebf8934 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:03.282483 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d254d7e-5756-413d-b378-83cd9ebf8934 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:03.292748 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d254d7e-5756-413d-b378-83cd9ebf8934 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:03.294223 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d254d7e-5756-413d-b378-83cd9ebf8934 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:03.308322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-6d254d7e-5756-413d-b378-83cd9ebf8934 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:30:03.308322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:30:03.308322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:30:03.308322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:30:03.308322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:30:03.308322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:30:03.308322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:30:03.308322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:30:03.308322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:30:03.308322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:30:03.308322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:30:03.308322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:30:03.308322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:30:03.308322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:30:03.308322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:30:03.308322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:30:03.309530 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:30:03.309530 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:30:03.309530 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:30:03.309530 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:30:03.309530 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:30:03.309530 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:30:03.309530 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:30:03.309530 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:30:03.309530 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:30:03.309530 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:30:03.309530 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:30:03.309530 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:30:03.309530 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:30:03.309530 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:30:03.309530 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:30:03.309530 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:30:03.309530 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:30:03.310814 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:30:03.310814 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:30:03.310814 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:30:03.310814 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 609/1228] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:30:03.316117 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853eebb-5751-4e23-806c-b08f3e8c01ee None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:03.415234 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853eebb-5751-4e23-806c-b08f3e8c01ee None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:03.417562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:03.450544 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64ae64-2f36-4f8c-bcd3-b404ab7b66df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:03.451144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64ae64-2f36-4f8c-bcd3-b404ab7b66df None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:03.451447 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64ae64-2f36-4f8c-bcd3-b404ab7b66df None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:03.452330 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64ae64-2f36-4f8c-bcd3-b404ab7b66df None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:03.452975 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64ae64-2f36-4f8c-bcd3-b404ab7b66df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:30:03.453519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64ae64-2f36-4f8c-bcd3-b404ab7b66df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:03.455106 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64ae64-2f36-4f8c-bcd3-b404ab7b66df None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:03.466316 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 620/1229] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:30:03.472449 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d254d7e-5756-413d-b378-83cd9ebf8934 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:03.482206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:03.573788 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d254d7e-5756-413d-b378-83cd9ebf8934 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:03.609830 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8998e-527f-417c-b633-b0082dbfa467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:03.610466 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8998e-527f-417c-b633-b0082dbfa467 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:03.610745 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8998e-527f-417c-b633-b0082dbfa467 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:03.611016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8998e-527f-417c-b633-b0082dbfa467 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:03.617860 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8998e-527f-417c-b633-b0082dbfa467 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:03.619317 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8998e-527f-417c-b633-b0082dbfa467 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:03.631990 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-5fe8998e-527f-417c-b633-b0082dbfa467 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:30:03.631990 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:30:03.631990 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:30:03.631990 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:30:03.631990 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:30:03.631990 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:30:03.631990 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:30:03.631990 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:30:03.631990 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:30:03.631990 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:30:03.631990 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:30:03.631990 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:30:03.631990 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:30:03.631990 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:30:03.631990 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:30:03.634260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:30:03.634260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:30:03.634260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:30:03.634260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:30:03.634260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:30:03.634260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:30:03.634260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:30:03.634260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:30:03.634260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:30:03.634260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:30:03.634260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:30:03.634260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:30:03.634260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:30:03.634260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:30:03.634260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:30:03.634260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:30:03.634260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:30:03.635408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:30:03.635408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:30:03.635408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:30:03.635408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:30:03.635408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:30:03.635408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:30:03.635408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:30:03.635408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:30:03.635408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 610/1230] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:30:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:30:03.639189 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64ae64-2f36-4f8c-bcd3-b404ab7b66df None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:03.742686 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64ae64-2f36-4f8c-bcd3-b404ab7b66df None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:03.776988 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8c47d-5691-44df-b7d5-fe5e487d9577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:03.777595 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8c47d-5691-44df-b7d5-fe5e487d9577 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:03.777876 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8c47d-5691-44df-b7d5-fe5e487d9577 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:03.778150 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8c47d-5691-44df-b7d5-fe5e487d9577 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:03.778848 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8c47d-5691-44df-b7d5-fe5e487d9577 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:30:03.779157 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8c47d-5691-44df-b7d5-fe5e487d9577 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:03.780696 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8c47d-5691-44df-b7d5-fe5e487d9577 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:03.792832 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 621/1231] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:30:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:30:03.800100 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8998e-527f-417c-b633-b0082dbfa467 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:03.880252 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:03.914623 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8998e-527f-417c-b633-b0082dbfa467 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:03.949680 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8604f-d74a-4403-ad76-cda761c707b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:03.950435 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8604f-d74a-4403-ad76-cda761c707b0 None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:03.950718 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8604f-d74a-4403-ad76-cda761c707b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:03.950989 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8604f-d74a-4403-ad76-cda761c707b0 None admin] PATH_INFO: `/v3/projects/b6ed5f989f4248d7bab2548eb350fe17/users/a48c49f7a9f44cef89dd024fecea422f/roles/b936dc45662c4ac195fdbf9e8ac589b0` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:03.965807 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8604f-d74a-4403-ad76-cda761c707b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=b6ed5f989f4248d7bab2548eb350fe17, user_id=a48c49f7a9f44cef89dd024fecea422f, role_id=b936dc45662c4ac195fdbf9e8ac589b0)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:03.967817 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8604f-d74a-4403-ad76-cda761c707b0 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:04.063777 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 611/1232] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Sep 11 08:30:03 2022] PUT /identity/v3/projects/b6ed5f989f4248d7bab2548eb350fe17/users/a48c49f7a9f44cef89dd024fecea422f/roles/b936dc45662c4ac195fdbf9e8ac589b0 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:30:06.243134 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d7913-3e37-4684-8c40-285a38d407eb None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:06.243732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d7913-3e37-4684-8c40-285a38d407eb None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:06.243732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d7913-3e37-4684-8c40-285a38d407eb None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:06.245074 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 622/1233] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:30:06.250519 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5beb204-b4fc-479c-9930-b78c0e43cfaf None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:06.250962 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5beb204-b4fc-479c-9930-b78c0e43cfaf None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:06.252525 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5beb204-b4fc-479c-9930-b78c0e43cfaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:06.268858 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-f5beb204-b4fc-479c-9930-b78c0e43cfaf None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:30:06.270049 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f5beb204-b4fc-479c-9930-b78c0e43cfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:30:06.340194 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 612/1234] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:30:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:30:06.610931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d7913-3e37-4684-8c40-285a38d407eb None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:06.635721 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:06.715389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d7913-3e37-4684-8c40-285a38d407eb None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:06.749717 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21753d05-7aa3-409f-b52e-a2f6e42147ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:06.750334 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21753d05-7aa3-409f-b52e-a2f6e42147ec None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:06.750650 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21753d05-7aa3-409f-b52e-a2f6e42147ec None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:06.750925 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21753d05-7aa3-409f-b52e-a2f6e42147ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:06.760705 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21753d05-7aa3-409f-b52e-a2f6e42147ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:30:06.766092 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-21753d05-7aa3-409f-b52e-a2f6e42147ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:30:06.766092 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:30:06.766092 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:30:06.766092 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:30:06.766092 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:30:06.766092 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:30:06.766092 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:30:06.766092 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:30:06.766092 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:30:06.766092 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:30:06.766092 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:30:06.766092 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:30:06.766092 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:30:06.766092 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:30:06.766092 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:30:06.766092 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:30:06.767267 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:30:06.767267 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:30:06.767267 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:30:06.767267 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:30:06.767267 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:30:06.767267 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:30:06.767267 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:30:06.767267 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:30:06.767267 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:30:06.767267 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:30:06.767267 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:30:06.767267 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:30:06.767267 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:30:06.767267 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:30:06.767267 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:30:06.767267 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:30:06.768615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:30:06.768615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:30:06.768615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:30:06.768615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:30:06.768615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:30:06.768615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:30:06.768615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:30:06.768615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:30:06.768615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:30:06.768615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:30:06.768615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 08:30:06.768615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:30:06.768615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 623/1235] 10.222.0.26 () {56 vars in 1102 bytes} [Sun Sep 11 08:30:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:30:06.773350 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5beb204-b4fc-479c-9930-b78c0e43cfaf None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:06.819818 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:06.872874 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5beb204-b4fc-479c-9930-b78c0e43cfaf None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:06.907275 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78941f06-9562-4f10-8bb7-1d58bf5f0a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:06.907885 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78941f06-9562-4f10-8bb7-1d58bf5f0a2b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:06.908173 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78941f06-9562-4f10-8bb7-1d58bf5f0a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:06.908449 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78941f06-9562-4f10-8bb7-1d58bf5f0a2b None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:06.909108 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78941f06-9562-4f10-8bb7-1d58bf5f0a2b None admin] RBAC: Adding query filter params (name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:30:06.909421 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78941f06-9562-4f10-8bb7-1d58bf5f0a2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:06.910790 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78941f06-9562-4f10-8bb7-1d58bf5f0a2b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:06.918596 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 613/1236] 10.222.0.26 () {56 vars in 1103 bytes} [Sun Sep 11 08:30:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:30:06.924734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21753d05-7aa3-409f-b52e-a2f6e42147ec None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:07.050314 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:07.050314 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21753d05-7aa3-409f-b52e-a2f6e42147ec None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:07.078221 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7dce01-9b50-460b-a023-36fca2d4b31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:07.079155 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7dce01-9b50-460b-a023-36fca2d4b31e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:07.079472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7dce01-9b50-460b-a023-36fca2d4b31e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:07.079769 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7dce01-9b50-460b-a023-36fca2d4b31e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:07.091119 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7dce01-9b50-460b-a023-36fca2d4b31e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:07.092910 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7dce01-9b50-460b-a023-36fca2d4b31e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:07.108017 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-2f7dce01-9b50-460b-a023-36fca2d4b31e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:30:07.108017 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:30:07.108017 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:30:07.108017 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:30:07.108017 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:30:07.108017 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:30:07.108017 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:30:07.108017 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:30:07.108017 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:30:07.108017 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:30:07.108017 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:30:07.108017 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:30:07.108017 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:30:07.108017 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:30:07.108017 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:30:07.108017 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:30:07.109051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:30:07.109051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:30:07.109051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:30:07.109051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:30:07.109051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:30:07.109051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:30:07.109051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:30:07.109051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:30:07.109051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:30:07.109051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:30:07.109051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:30:07.109051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:30:07.109051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:30:07.109051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:30:07.109051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:30:07.109051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:30:07.109051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:30:07.109942 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:30:07.109942 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:30:07.109942 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:30:07.109942 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 624/1237] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:30:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:30:07.115674 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78941f06-9562-4f10-8bb7-1d58bf5f0a2b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:07.224213 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78941f06-9562-4f10-8bb7-1d58bf5f0a2b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:07.233606 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:07.265724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a719ea9-c850-42b9-abd4-c3facaeb0e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:07.266349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a719ea9-c850-42b9-abd4-c3facaeb0e3f None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:07.266541 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a719ea9-c850-42b9-abd4-c3facaeb0e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:07.266810 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a719ea9-c850-42b9-abd4-c3facaeb0e3f None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:07.270055 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a719ea9-c850-42b9-abd4-c3facaeb0e3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:30:07.270365 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a719ea9-c850-42b9-abd4-c3facaeb0e3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:07.271802 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a719ea9-c850-42b9-abd4-c3facaeb0e3f None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:07.285481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 614/1238] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:30:07.291521 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7dce01-9b50-460b-a023-36fca2d4b31e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:07.400745 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7dce01-9b50-460b-a023-36fca2d4b31e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:07.434064 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cdf56-03ca-495a-b451-d1fe86a5577e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:07.434691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cdf56-03ca-495a-b451-d1fe86a5577e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:07.434972 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cdf56-03ca-495a-b451-d1fe86a5577e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:07.435321 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cdf56-03ca-495a-b451-d1fe86a5577e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:07.438530 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:07.443644 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7cdf56-03ca-495a-b451-d1fe86a5577e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:07.445094 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7cdf56-03ca-495a-b451-d1fe86a5577e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:07.456430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-be7cdf56-03ca-495a-b451-d1fe86a5577e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 08:30:07.456430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:30:07.456430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:30:07.456430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:30:07.456430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:30:07.456430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:30:07.456430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:30:07.456430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:30:07.456430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:30:07.456430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:30:07.456430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:30:07.456430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:30:07.456430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:30:07.456430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:30:07.456430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:30:07.456430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:30:07.457409 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:30:07.457409 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:30:07.457409 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:30:07.457409 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:30:07.457409 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:30:07.457409 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:30:07.457409 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:30:07.457409 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:30:07.457409 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:30:07.457409 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:30:07.457409 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:30:07.457409 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:30:07.457409 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:30:07.457409 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:30:07.457409 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:30:07.457409 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:30:07.457409 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:30:07.457409 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:30:07.458753 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:30:07.458753 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:30:07.458753 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:30:07.458753 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:30:07.458753 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:30:07.458753 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:30:07.458753 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:30:07.458753 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:30:07.458753 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 08:30:07.458753 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:30:07.458753 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 625/1239] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:30:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:30:07.463651 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a719ea9-c850-42b9-abd4-c3facaeb0e3f None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:07.568536 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a719ea9-c850-42b9-abd4-c3facaeb0e3f None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:07.605114 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81989ce3-9a86-4ab8-a66f-35ee56ab3352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:07.605919 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81989ce3-9a86-4ab8-a66f-35ee56ab3352 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:07.606298 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81989ce3-9a86-4ab8-a66f-35ee56ab3352 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:07.606664 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81989ce3-9a86-4ab8-a66f-35ee56ab3352 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:07.607613 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81989ce3-9a86-4ab8-a66f-35ee56ab3352 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:30:07.608547 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81989ce3-9a86-4ab8-a66f-35ee56ab3352 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:07.610199 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81989ce3-9a86-4ab8-a66f-35ee56ab3352 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:07.634497 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 615/1240] 10.222.0.26 () {56 vars in 1143 bytes} [Sun Sep 11 08:30:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:30:07.640510 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cdf56-03ca-495a-b451-d1fe86a5577e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:07.741559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cdf56-03ca-495a-b451-d1fe86a5577e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:07.774007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050869d8-06b6-4464-ba5c-495c7f990903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:07.774616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050869d8-06b6-4464-ba5c-495c7f990903 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:07.774896 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050869d8-06b6-4464-ba5c-495c7f990903 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:07.775168 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050869d8-06b6-4464-ba5c-495c7f990903 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:07.836068 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:07.843361 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050869d8-06b6-4464-ba5c-495c7f990903 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:07.844957 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050869d8-06b6-4464-ba5c-495c7f990903 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:07.949984 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 626/1241] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:30:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 08:30:07.956921 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81989ce3-9a86-4ab8-a66f-35ee56ab3352 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:07.984075 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:08.056016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81989ce3-9a86-4ab8-a66f-35ee56ab3352 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:08.091090 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326eeb8-0f6f-490f-89b9-51a6b6907455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:08.091677 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326eeb8-0f6f-490f-89b9-51a6b6907455 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:08.091956 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326eeb8-0f6f-490f-89b9-51a6b6907455 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:08.092226 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326eeb8-0f6f-490f-89b9-51a6b6907455 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:08.102736 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326eeb8-0f6f-490f-89b9-51a6b6907455 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:08.104611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326eeb8-0f6f-490f-89b9-51a6b6907455 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:08.119608 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-e326eeb8-0f6f-490f-89b9-51a6b6907455 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:30:08.119608 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:30:08.119608 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:30:08.119608 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:30:08.119608 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:30:08.119608 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:30:08.119608 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:30:08.119608 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:30:08.119608 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:30:08.119608 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:30:08.119608 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:30:08.119608 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:30:08.119608 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:30:08.119608 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:30:08.119608 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:30:08.119608 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:30:08.120624 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:30:08.120624 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:30:08.120624 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:30:08.120624 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:30:08.120624 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:30:08.120624 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:30:08.120624 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:30:08.120624 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:30:08.120624 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:30:08.120624 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:30:08.120624 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:30:08.120624 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:30:08.120624 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:30:08.120624 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:30:08.120624 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:30:08.120624 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:30:08.120624 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:30:08.121561 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:30:08.121561 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:30:08.121561 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:30:08.121561 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 616/1242] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:30:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:30:08.127183 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050869d8-06b6-4464-ba5c-495c7f990903 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:08.221623 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:08.227275 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050869d8-06b6-4464-ba5c-495c7f990903 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:08.261746 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3a002-ccc5-46ad-be09-7ab906166425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:08.262367 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3a002-ccc5-46ad-be09-7ab906166425 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:08.262639 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3a002-ccc5-46ad-be09-7ab906166425 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:08.262912 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3a002-ccc5-46ad-be09-7ab906166425 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:08.263585 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3a002-ccc5-46ad-be09-7ab906166425 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:30:08.263889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3a002-ccc5-46ad-be09-7ab906166425 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:08.265300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3a002-ccc5-46ad-be09-7ab906166425 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:08.276707 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 627/1243] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:30:08.282608 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326eeb8-0f6f-490f-89b9-51a6b6907455 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:08.367994 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:08.389743 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326eeb8-0f6f-490f-89b9-51a6b6907455 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:08.423096 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649f71a-159b-47d4-b742-78d9ba6de853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:08.423748 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649f71a-159b-47d4-b742-78d9ba6de853 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:08.424024 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649f71a-159b-47d4-b742-78d9ba6de853 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:08.424293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649f71a-159b-47d4-b742-78d9ba6de853 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:08.430759 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649f71a-159b-47d4-b742-78d9ba6de853 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:08.432227 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649f71a-159b-47d4-b742-78d9ba6de853 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:08.443813 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-f649f71a-159b-47d4-b742-78d9ba6de853 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:30:08.443813 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:30:08.443813 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:30:08.443813 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:30:08.443813 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:30:08.443813 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:30:08.443813 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:30:08.443813 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:30:08.443813 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:30:08.443813 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:30:08.443813 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:30:08.443813 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:30:08.443813 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:30:08.443813 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:30:08.443813 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:30:08.444883 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:30:08.444883 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:30:08.444883 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:30:08.444883 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:30:08.444883 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:30:08.444883 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:30:08.444883 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:30:08.444883 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:30:08.444883 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:30:08.444883 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:30:08.444883 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:30:08.444883 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:30:08.444883 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:30:08.444883 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:30:08.444883 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:30:08.444883 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:30:08.444883 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:30:08.446207 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:30:08.446207 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:30:08.446207 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:30:08.446207 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:30:08.446207 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:30:08.446207 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:30:08.446207 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:30:08.446207 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:30:08.446207 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 617/1244] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:30:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:30:08.450786 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3a002-ccc5-46ad-be09-7ab906166425 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:08.555331 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3a002-ccc5-46ad-be09-7ab906166425 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:08.593515 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d0d5a-6414-4702-95f9-02ce890ad1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:08.594144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d0d5a-6414-4702-95f9-02ce890ad1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:08.594596 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d0d5a-6414-4702-95f9-02ce890ad1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:08.594975 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d0d5a-6414-4702-95f9-02ce890ad1e6 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:08.595682 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d0d5a-6414-4702-95f9-02ce890ad1e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:30:08.598397 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d0d5a-6414-4702-95f9-02ce890ad1e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:08.598397 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d0d5a-6414-4702-95f9-02ce890ad1e6 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:08.611105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 628/1245] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:30:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:30:08.617366 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649f71a-159b-47d4-b742-78d9ba6de853 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:08.719160 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649f71a-159b-47d4-b742-78d9ba6de853 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:08.753609 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa715193-1459-4aa0-a15d-d2c176d65c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:08.754235 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa715193-1459-4aa0-a15d-d2c176d65c69 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:08.754495 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa715193-1459-4aa0-a15d-d2c176d65c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:08.754769 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa715193-1459-4aa0-a15d-d2c176d65c69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:08.755806 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa715193-1459-4aa0-a15d-d2c176d65c69 None admin] RBAC: Adding query filter params (role.id=b936dc45662c4ac195fdbf9e8ac589b0, scope.project.id=b6ed5f989f4248d7bab2548eb350fe17, user.id=a48c49f7a9f44cef89dd024fecea422f) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:30:08.755806 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa715193-1459-4aa0-a15d-d2c176d65c69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:08.757817 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa715193-1459-4aa0-a15d-d2c176d65c69 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:08.764007 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 618/1246] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:30:08 2022] GET /identity/v3/role_assignments?user.id=a48c49f7a9f44cef89dd024fecea422f&scope.project.id=b6ed5f989f4248d7bab2548eb350fe17&role.id=b936dc45662c4ac195fdbf9e8ac589b0 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:30:11.030824 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495329e6-c2df-4944-b20e-c739150ba932 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:11.031422 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495329e6-c2df-4944-b20e-c739150ba932 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:11.031422 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495329e6-c2df-4944-b20e-c739150ba932 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:11.032725 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 629/1247] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:30:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:30:11.038338 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c01198-3812-443c-a2a3-bf0e93743ae0 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:11.038782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c01198-3812-443c-a2a3-bf0e93743ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:11.038912 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c01198-3812-443c-a2a3-bf0e93743ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:11.045751 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:11.057954 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-51c01198-3812-443c-a2a3-bf0e93743ae0 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:30:11.059154 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-51c01198-3812-443c-a2a3-bf0e93743ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:30:11.125248 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 619/1248] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:30:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:30:11.393412 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495329e6-c2df-4944-b20e-c739150ba932 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:11.411779 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:11.493739 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495329e6-c2df-4944-b20e-c739150ba932 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:11.528772 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174a156-cae9-472a-be0d-5b024beb635c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:11.529431 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174a156-cae9-472a-be0d-5b024beb635c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:11.529733 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174a156-cae9-472a-be0d-5b024beb635c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:11.530008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174a156-cae9-472a-be0d-5b024beb635c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:11.540643 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174a156-cae9-472a-be0d-5b024beb635c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:30:11.545512 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-5174a156-cae9-472a-be0d-5b024beb635c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:30:11.545512 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:30:11.545512 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:30:11.545512 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:30:11.545512 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:30:11.545512 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:30:11.545512 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:30:11.545512 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:30:11.545512 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:30:11.545512 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:30:11.545512 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:30:11.545512 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:30:11.545512 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:30:11.545512 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:30:11.545512 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:30:11.545512 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:30:11.546619 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:30:11.546619 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:30:11.546619 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:30:11.546619 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:30:11.546619 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:30:11.546619 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:30:11.546619 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:30:11.546619 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:30:11.546619 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:30:11.546619 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:30:11.546619 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:30:11.546619 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:30:11.546619 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:30:11.546619 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:30:11.546619 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:30:11.546619 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:30:11.547581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:30:11.547581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:30:11.547581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:30:11.547581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:30:11.547581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:30:11.547581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:30:11.547581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:30:11.547581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:30:11.547581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:30:11.547581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:30:11.547581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:30:11.547581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:30:11.547581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 630/1249] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:30:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:30:11.552701 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c01198-3812-443c-a2a3-bf0e93743ae0 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:11.654141 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c01198-3812-443c-a2a3-bf0e93743ae0 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:11.684169 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:11.689201 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c64cce-82aa-4689-8cde-e25b97dfe6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:11.689822 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c64cce-82aa-4689-8cde-e25b97dfe6f6 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:11.690103 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c64cce-82aa-4689-8cde-e25b97dfe6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:11.690384 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c64cce-82aa-4689-8cde-e25b97dfe6f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:11.691051 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c64cce-82aa-4689-8cde-e25b97dfe6f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:30:11.691431 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c64cce-82aa-4689-8cde-e25b97dfe6f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:11.692799 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c64cce-82aa-4689-8cde-e25b97dfe6f6 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:11.701209 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 620/1250] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:30:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:30:11.707485 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174a156-cae9-472a-be0d-5b024beb635c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:11.788606 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:11.813659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174a156-cae9-472a-be0d-5b024beb635c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:11.848743 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20b703-38d2-425b-becd-87361e309682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:11.849468 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20b703-38d2-425b-becd-87361e309682 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:11.849800 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20b703-38d2-425b-becd-87361e309682 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:11.850120 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20b703-38d2-425b-becd-87361e309682 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:11.862167 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20b703-38d2-425b-becd-87361e309682 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:11.863692 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20b703-38d2-425b-becd-87361e309682 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:11.878410 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-8a20b703-38d2-425b-becd-87361e309682 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:30:11.878410 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:30:11.878410 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:30:11.878410 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:30:11.878410 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:30:11.878410 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:30:11.878410 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:30:11.878410 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:30:11.878410 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:30:11.878410 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:30:11.878410 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:30:11.878410 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:30:11.878410 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:30:11.878410 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:30:11.878410 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:30:11.878410 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:30:11.879703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:30:11.879703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:30:11.879703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:30:11.879703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:30:11.879703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:30:11.879703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:30:11.879703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:30:11.879703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:30:11.879703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:30:11.879703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:30:11.879703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:30:11.879703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:30:11.879703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:30:11.879703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:30:11.879703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:30:11.879703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:30:11.879703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:30:11.880990 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:30:11.880990 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:30:11.880990 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:30:11.880990 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 631/1251] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:30:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:30:11.885379 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c64cce-82aa-4689-8cde-e25b97dfe6f6 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:11.997056 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c64cce-82aa-4689-8cde-e25b97dfe6f6 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:12.045187 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19432da3-20e4-45e3-a602-f751b6f636e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:12.045842 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19432da3-20e4-45e3-a602-f751b6f636e0 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:12.046175 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19432da3-20e4-45e3-a602-f751b6f636e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:12.046494 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19432da3-20e4-45e3-a602-f751b6f636e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:12.047205 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19432da3-20e4-45e3-a602-f751b6f636e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:30:12.047594 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19432da3-20e4-45e3-a602-f751b6f636e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:12.049007 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19432da3-20e4-45e3-a602-f751b6f636e0 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:12.061808 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 621/1252] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:30:12.067916 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20b703-38d2-425b-becd-87361e309682 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:12.177348 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20b703-38d2-425b-becd-87361e309682 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:12.204204 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:12.211893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2dbc0-9686-44df-ba6e-3129b40e292a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:12.212556 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2dbc0-9686-44df-ba6e-3129b40e292a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:12.212834 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2dbc0-9686-44df-ba6e-3129b40e292a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:12.213103 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2dbc0-9686-44df-ba6e-3129b40e292a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:12.222245 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2dbc0-9686-44df-ba6e-3129b40e292a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:12.223626 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2dbc0-9686-44df-ba6e-3129b40e292a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:12.235272 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-30c2dbc0-9686-44df-ba6e-3129b40e292a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 08:30:12.235272 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:30:12.235272 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:30:12.235272 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:30:12.235272 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:30:12.235272 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:30:12.235272 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:30:12.235272 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:30:12.235272 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:30:12.235272 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:30:12.235272 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:30:12.235272 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:30:12.235272 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:30:12.235272 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:30:12.235272 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:30:12.235272 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:30:12.237172 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:30:12.237172 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:30:12.237172 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:30:12.237172 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:30:12.237172 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:30:12.237172 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:30:12.237172 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:30:12.237172 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:30:12.237172 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:30:12.237172 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:30:12.237172 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:30:12.237172 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:30:12.237172 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:30:12.237172 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:30:12.237172 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:30:12.237172 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:30:12.237172 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:30:12.237172 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:30:12.238271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:30:12.238271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:30:12.238271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:30:12.238271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:30:12.238271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:30:12.238271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:30:12.238271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:30:12.238271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:30:12.238271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 08:30:12.238271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:30:12.238271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 632/1253] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:30:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:30:12.242951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19432da3-20e4-45e3-a602-f751b6f636e0 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:12.299111 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:12.363761 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19432da3-20e4-45e3-a602-f751b6f636e0 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:12.411502 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50ddcd-b083-4ed0-aa0f-019cae7e7ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:12.412151 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50ddcd-b083-4ed0-aa0f-019cae7e7ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:12.412434 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50ddcd-b083-4ed0-aa0f-019cae7e7ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:12.412701 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50ddcd-b083-4ed0-aa0f-019cae7e7ed2 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:12.413435 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50ddcd-b083-4ed0-aa0f-019cae7e7ed2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:30:12.413739 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50ddcd-b083-4ed0-aa0f-019cae7e7ed2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:12.415157 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50ddcd-b083-4ed0-aa0f-019cae7e7ed2 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:12.434744 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 622/1254] 10.222.0.26 () {56 vars in 1143 bytes} [Sun Sep 11 08:30:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:30:12.442064 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2dbc0-9686-44df-ba6e-3129b40e292a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:12.553166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2dbc0-9686-44df-ba6e-3129b40e292a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:12.589871 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadaacf-9e41-4bc9-8576-6d96ed1b04c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:12.590481 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadaacf-9e41-4bc9-8576-6d96ed1b04c4 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:12.590757 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadaacf-9e41-4bc9-8576-6d96ed1b04c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:12.591032 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadaacf-9e41-4bc9-8576-6d96ed1b04c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:12.658711 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:12.671054 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadaacf-9e41-4bc9-8576-6d96ed1b04c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:12.672551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadaacf-9e41-4bc9-8576-6d96ed1b04c4 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:12.787917 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 633/1255] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:30:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 08:30:12.794363 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50ddcd-b083-4ed0-aa0f-019cae7e7ed2 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:12.910921 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50ddcd-b083-4ed0-aa0f-019cae7e7ed2 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:12.930433 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:12.954784 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4a44f-0264-4e52-9142-c58e2b642efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:12.955468 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4a44f-0264-4e52-9142-c58e2b642efc None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:12.955468 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4a44f-0264-4e52-9142-c58e2b642efc None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:12.955468 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4a44f-0264-4e52-9142-c58e2b642efc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:12.967888 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4a44f-0264-4e52-9142-c58e2b642efc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:12.969354 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4a44f-0264-4e52-9142-c58e2b642efc None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:12.987026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-bef4a44f-0264-4e52-9142-c58e2b642efc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:30:12.987026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:30:12.987026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:30:12.987026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:30:12.987026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:30:12.987026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:30:12.987026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:30:12.987026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:30:12.987026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:30:12.987026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:30:12.987026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:30:12.987026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:30:12.987026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:30:12.987026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:30:12.987026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:30:12.987026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:30:12.988259 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:30:12.988259 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:30:12.988259 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:30:12.988259 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:30:12.988259 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:30:12.988259 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:30:12.988259 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:30:12.988259 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:30:12.988259 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:30:12.988259 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:30:12.988259 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:30:12.988259 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:30:12.988259 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:30:12.988259 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:30:12.988259 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:30:12.988259 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:30:12.988259 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:30:12.989174 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:30:12.989174 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:30:12.989174 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:30:12.989174 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 623/1256] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:30:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:30:12.994062 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadaacf-9e41-4bc9-8576-6d96ed1b04c4 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:13.085691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:13.097727 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadaacf-9e41-4bc9-8576-6d96ed1b04c4 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:13.136812 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c4c7b-6bc1-447e-9c95-5d7771abaa18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:13.137426 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c4c7b-6bc1-447e-9c95-5d7771abaa18 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:13.137711 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c4c7b-6bc1-447e-9c95-5d7771abaa18 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:13.137987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c4c7b-6bc1-447e-9c95-5d7771abaa18 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:13.138645 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c4c7b-6bc1-447e-9c95-5d7771abaa18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:30:13.139011 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c4c7b-6bc1-447e-9c95-5d7771abaa18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:13.140443 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c4c7b-6bc1-447e-9c95-5d7771abaa18 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:13.152224 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 634/1257] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:30:13.158827 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4a44f-0264-4e52-9142-c58e2b642efc None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:13.282212 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4a44f-0264-4e52-9142-c58e2b642efc None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:13.316937 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0e19c-820e-462e-8db0-706365d5ea8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:13.317561 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0e19c-820e-462e-8db0-706365d5ea8a None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:13.317836 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0e19c-820e-462e-8db0-706365d5ea8a None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:13.318105 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0e19c-820e-462e-8db0-706365d5ea8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:13.325164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0e19c-820e-462e-8db0-706365d5ea8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:13.326776 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0e19c-820e-462e-8db0-706365d5ea8a None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:13.339684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-cfb0e19c-820e-462e-8db0-706365d5ea8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:30:13.339684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:30:13.339684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:30:13.339684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:30:13.339684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:30:13.339684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:30:13.339684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:30:13.339684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:30:13.339684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:30:13.339684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:30:13.339684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:30:13.339684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:30:13.339684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:30:13.339684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:30:13.339684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:30:13.341506 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:30:13.341506 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:30:13.341506 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:30:13.341506 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:30:13.341506 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:30:13.341506 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:30:13.341506 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:30:13.341506 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:30:13.341506 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:30:13.341506 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:30:13.341506 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:30:13.341506 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:30:13.341506 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:30:13.341506 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:30:13.341506 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:30:13.341506 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:30:13.341506 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:30:13.343515 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:30:13.343515 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:30:13.343515 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:30:13.343515 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:30:13.343515 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:30:13.343515 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:30:13.343515 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:30:13.343515 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:30:13.343515 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 624/1258] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:30:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:30:13.347780 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c4c7b-6bc1-447e-9c95-5d7771abaa18 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:13.450727 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c4c7b-6bc1-447e-9c95-5d7771abaa18 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:13.485559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90393e73-7d19-4c13-91cc-534fc2f3e0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:13.486170 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90393e73-7d19-4c13-91cc-534fc2f3e0e9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:13.486449 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90393e73-7d19-4c13-91cc-534fc2f3e0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:13.486723 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90393e73-7d19-4c13-91cc-534fc2f3e0e9 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:13.487467 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90393e73-7d19-4c13-91cc-534fc2f3e0e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:30:13.487777 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90393e73-7d19-4c13-91cc-534fc2f3e0e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:13.489214 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90393e73-7d19-4c13-91cc-534fc2f3e0e9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:13.502540 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 635/1259] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:30:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:30:13.508567 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0e19c-820e-462e-8db0-706365d5ea8a None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:13.535791 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:13.626514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0e19c-820e-462e-8db0-706365d5ea8a None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:13.661505 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74155c77-14ef-4111-afed-eba8628dded2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:13.662116 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74155c77-14ef-4111-afed-eba8628dded2 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:13.662390 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74155c77-14ef-4111-afed-eba8628dded2 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:13.662660 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74155c77-14ef-4111-afed-eba8628dded2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:13.663427 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74155c77-14ef-4111-afed-eba8628dded2 None admin] RBAC: Adding query filter params (role.id=d12af9f1dfb344cd8a6a493e165030ba, scope.project.id=b6ed5f989f4248d7bab2548eb350fe17, user.id=a48c49f7a9f44cef89dd024fecea422f) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:30:13.663732 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74155c77-14ef-4111-afed-eba8628dded2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:13.665191 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74155c77-14ef-4111-afed-eba8628dded2 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:13.671192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 625/1260] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:30:13 2022] GET /identity/v3/role_assignments?user.id=a48c49f7a9f44cef89dd024fecea422f&scope.project.id=b6ed5f989f4248d7bab2548eb350fe17&role.id=d12af9f1dfb344cd8a6a493e165030ba => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:30:15.864508 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99802503-fac4-401d-aab8-fca28bb01f3b None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:15.865029 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99802503-fac4-401d-aab8-fca28bb01f3b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:15.865029 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99802503-fac4-401d-aab8-fca28bb01f3b None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:15.866387 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 636/1261] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:30:15.871692 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c4dda-4b7b-48fa-b179-a735011d339d None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:15.872103 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c4dda-4b7b-48fa-b179-a735011d339d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:15.873939 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c4dda-4b7b-48fa-b179-a735011d339d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:15.890755 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-a64c4dda-4b7b-48fa-b179-a735011d339d None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:30:15.891983 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-a64c4dda-4b7b-48fa-b179-a735011d339d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:30:15.959604 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 626/1262] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:30:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 08:30:16.241524 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99802503-fac4-401d-aab8-fca28bb01f3b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:16.253357 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:16.344967 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99802503-fac4-401d-aab8-fca28bb01f3b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:16.381063 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5bc7f-8dcf-4e07-b46d-4f6966ba8f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:16.381818 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5bc7f-8dcf-4e07-b46d-4f6966ba8f32 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:16.382109 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5bc7f-8dcf-4e07-b46d-4f6966ba8f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:16.382385 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5bc7f-8dcf-4e07-b46d-4f6966ba8f32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:16.394117 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5bc7f-8dcf-4e07-b46d-4f6966ba8f32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:30:16.399159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-3bc5bc7f-8dcf-4e07-b46d-4f6966ba8f32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:30:16.399159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:30:16.399159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:30:16.399159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:30:16.399159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:30:16.399159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:30:16.399159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:30:16.399159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:30:16.399159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:30:16.399159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:30:16.399159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:30:16.399159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:30:16.399159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:30:16.399159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:30:16.399159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:30:16.399159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:30:16.400424 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:30:16.400424 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:30:16.400424 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:30:16.400424 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:30:16.400424 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:30:16.400424 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:30:16.400424 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:30:16.400424 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:30:16.400424 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:30:16.400424 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:30:16.400424 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:30:16.400424 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:30:16.400424 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:30:16.400424 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:30:16.400424 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:30:16.400424 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:30:16.401892 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:30:16.401892 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:30:16.401892 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:30:16.401892 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:30:16.401892 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:30:16.401892 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:30:16.401892 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:30:16.401892 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:30:16.401892 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:30:16.401892 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:30:16.401892 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:30:16.401892 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:30:16.401892 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 637/1263] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:30:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:30:16.406525 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c4dda-4b7b-48fa-b179-a735011d339d None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:16.425399 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:16.506068 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c4dda-4b7b-48fa-b179-a735011d339d None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:16.540199 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba37c4a-bf31-40d3-a74e-62597d1efa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:16.540851 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba37c4a-bf31-40d3-a74e-62597d1efa06 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:16.541085 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba37c4a-bf31-40d3-a74e-62597d1efa06 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:16.541356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba37c4a-bf31-40d3-a74e-62597d1efa06 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:16.542027 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba37c4a-bf31-40d3-a74e-62597d1efa06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:30:16.542315 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba37c4a-bf31-40d3-a74e-62597d1efa06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:16.543708 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba37c4a-bf31-40d3-a74e-62597d1efa06 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:16.552633 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 627/1264] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:30:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:30:16.558479 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5bc7f-8dcf-4e07-b46d-4f6966ba8f32 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:16.628244 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:16.661788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5bc7f-8dcf-4e07-b46d-4f6966ba8f32 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:16.695468 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97739a90-dcec-43c8-8927-8d10e31c2910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:16.696100 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97739a90-dcec-43c8-8927-8d10e31c2910 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:16.696382 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97739a90-dcec-43c8-8927-8d10e31c2910 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:16.696685 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97739a90-dcec-43c8-8927-8d10e31c2910 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:16.707128 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97739a90-dcec-43c8-8927-8d10e31c2910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:16.708740 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97739a90-dcec-43c8-8927-8d10e31c2910 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:16.724344 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-97739a90-dcec-43c8-8927-8d10e31c2910 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:30:16.724344 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:30:16.724344 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:30:16.724344 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:30:16.724344 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:30:16.724344 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:30:16.724344 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:30:16.724344 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:30:16.724344 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:30:16.724344 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:30:16.724344 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:30:16.724344 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:30:16.724344 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:30:16.724344 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:30:16.724344 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:30:16.724344 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:30:16.734549 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:30:16.734549 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:30:16.734549 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:30:16.734549 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:30:16.734549 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:30:16.734549 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:30:16.734549 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:30:16.734549 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:30:16.734549 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:30:16.734549 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:30:16.734549 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:30:16.734549 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:30:16.734549 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:30:16.734549 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:30:16.734549 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:30:16.734549 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:30:16.734549 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:30:16.735713 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:30:16.735713 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:30:16.735713 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:30:16.735713 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 638/1265] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:30:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:30:16.736007 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba37c4a-bf31-40d3-a74e-62597d1efa06 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:16.814501 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:16.834155 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba37c4a-bf31-40d3-a74e-62597d1efa06 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:16.869473 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da2be4-073e-4355-88f0-1a471c9d71ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:16.870089 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da2be4-073e-4355-88f0-1a471c9d71ee None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:16.870372 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da2be4-073e-4355-88f0-1a471c9d71ee None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:16.870652 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da2be4-073e-4355-88f0-1a471c9d71ee None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:16.871405 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da2be4-073e-4355-88f0-1a471c9d71ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:30:16.871724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da2be4-073e-4355-88f0-1a471c9d71ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:16.873113 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da2be4-073e-4355-88f0-1a471c9d71ee None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:16.887014 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 628/1266] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:30:16.892984 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97739a90-dcec-43c8-8927-8d10e31c2910 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:16.996867 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97739a90-dcec-43c8-8927-8d10e31c2910 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:17.017020 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:17.031795 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a77b9-305f-4b36-bcbe-32ebd9ca738b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:17.032436 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a77b9-305f-4b36-bcbe-32ebd9ca738b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:17.032796 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a77b9-305f-4b36-bcbe-32ebd9ca738b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:17.033137 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a77b9-305f-4b36-bcbe-32ebd9ca738b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:17.040894 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a77b9-305f-4b36-bcbe-32ebd9ca738b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:17.042336 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a77b9-305f-4b36-bcbe-32ebd9ca738b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:17.054498 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-d23a77b9-305f-4b36-bcbe-32ebd9ca738b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 08:30:17.054498 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:30:17.054498 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:30:17.054498 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:30:17.054498 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:30:17.054498 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:30:17.054498 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:30:17.054498 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:30:17.054498 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:30:17.054498 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:30:17.054498 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:30:17.054498 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:30:17.054498 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:30:17.054498 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:30:17.054498 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:30:17.054498 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:30:17.057889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:30:17.057889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:30:17.057889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:30:17.057889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:30:17.057889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:30:17.057889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:30:17.057889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:30:17.057889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:30:17.057889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:30:17.057889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:30:17.057889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:30:17.057889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:30:17.057889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:30:17.057889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:30:17.057889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:30:17.057889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:30:17.057889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:30:17.057889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:30:17.059300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:30:17.059300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:30:17.059300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:30:17.059300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:30:17.059300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:30:17.059300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:30:17.059300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:30:17.059300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:30:17.059300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 08:30:17.059300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:30:17.059300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 639/1267] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:30:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:30:17.061801 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da2be4-073e-4355-88f0-1a471c9d71ee None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:17.165779 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da2be4-073e-4355-88f0-1a471c9d71ee None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:17.201078 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa83400-928c-4f02-9f4d-578255c92011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:17.202225 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa83400-928c-4f02-9f4d-578255c92011 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:17.202498 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa83400-928c-4f02-9f4d-578255c92011 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:17.202762 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa83400-928c-4f02-9f4d-578255c92011 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:17.203529 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa83400-928c-4f02-9f4d-578255c92011 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:30:17.204081 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa83400-928c-4f02-9f4d-578255c92011 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:17.205497 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa83400-928c-4f02-9f4d-578255c92011 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:17.214466 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:17.223865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 629/1268] 10.222.0.26 () {56 vars in 1143 bytes} [Sun Sep 11 08:30:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:30:17.229949 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a77b9-305f-4b36-bcbe-32ebd9ca738b None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:17.331890 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a77b9-305f-4b36-bcbe-32ebd9ca738b None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:17.365493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefad33c-ebcb-4e09-8b19-dabf7d2fa8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:17.366118 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefad33c-ebcb-4e09-8b19-dabf7d2fa8e9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:17.366399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefad33c-ebcb-4e09-8b19-dabf7d2fa8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:17.366671 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefad33c-ebcb-4e09-8b19-dabf7d2fa8e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:17.377220 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefad33c-ebcb-4e09-8b19-dabf7d2fa8e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:17.378676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefad33c-ebcb-4e09-8b19-dabf7d2fa8e9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:17.398060 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-aefad33c-ebcb-4e09-8b19-dabf7d2fa8e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:30:17.398060 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:30:17.398060 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:30:17.398060 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:30:17.398060 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:30:17.398060 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:30:17.398060 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:30:17.398060 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:30:17.398060 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:30:17.398060 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:30:17.398060 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:30:17.398060 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:30:17.398060 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:30:17.398060 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:30:17.398060 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:30:17.398060 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:30:17.399295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:30:17.399295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:30:17.399295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:30:17.399295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:30:17.399295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:30:17.399295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:30:17.399295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:30:17.399295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:30:17.399295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:30:17.399295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:30:17.399295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:30:17.399295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:30:17.399295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:30:17.399295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:30:17.399295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:30:17.399295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:30:17.399295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:30:17.400400 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:30:17.400400 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:30:17.400400 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:30:17.400400 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 640/1269] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:30:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:30:17.405649 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa83400-928c-4f02-9f4d-578255c92011 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:17.511542 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa83400-928c-4f02-9f4d-578255c92011 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:17.557447 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b0801-1649-4e58-8f20-5b5af889b551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:17.558241 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b0801-1649-4e58-8f20-5b5af889b551 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:17.558614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b0801-1649-4e58-8f20-5b5af889b551 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:17.559023 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b0801-1649-4e58-8f20-5b5af889b551 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:17.559816 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b0801-1649-4e58-8f20-5b5af889b551 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:30:17.560211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b0801-1649-4e58-8f20-5b5af889b551 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:17.562283 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b0801-1649-4e58-8f20-5b5af889b551 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:17.581827 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 630/1270] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:30:17.588346 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefad33c-ebcb-4e09-8b19-dabf7d2fa8e9 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:17.627466 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:17.715563 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefad33c-ebcb-4e09-8b19-dabf7d2fa8e9 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:17.774194 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15405a88-ada9-41ef-9175-080140e13ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:17.774768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15405a88-ada9-41ef-9175-080140e13ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:17.775046 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15405a88-ada9-41ef-9175-080140e13ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:17.775352 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15405a88-ada9-41ef-9175-080140e13ca1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:17.785627 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15405a88-ada9-41ef-9175-080140e13ca1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:17.788154 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15405a88-ada9-41ef-9175-080140e13ca1 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:17.810405 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-15405a88-ada9-41ef-9175-080140e13ca1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:30:17.810405 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:30:17.810405 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:30:17.810405 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:30:17.810405 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:30:17.810405 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:30:17.810405 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:30:17.810405 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:30:17.810405 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:30:17.810405 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:30:17.810405 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:30:17.810405 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:30:17.810405 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:30:17.810405 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:30:17.810405 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:30:17.811972 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:30:17.811972 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:30:17.811972 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:30:17.811972 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:30:17.811972 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:30:17.811972 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:30:17.811972 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:30:17.811972 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:30:17.811972 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:30:17.811972 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:30:17.811972 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:30:17.811972 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:30:17.811972 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:30:17.811972 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:30:17.811972 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:30:17.811972 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:30:17.811972 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:30:17.812994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:30:17.812994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:30:17.812994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:30:17.812994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:30:17.812994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:30:17.812994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:30:17.812994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:30:17.812994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:30:17.812994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 641/1271] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:30:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:30:17.822405 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b0801-1649-4e58-8f20-5b5af889b551 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:17.890311 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:17.934056 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b0801-1649-4e58-8f20-5b5af889b551 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:17.970667 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce023c33-6e13-4d7b-b72f-9f48f277a6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:17.971345 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce023c33-6e13-4d7b-b72f-9f48f277a6eb None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:17.971601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce023c33-6e13-4d7b-b72f-9f48f277a6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:17.971871 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce023c33-6e13-4d7b-b72f-9f48f277a6eb None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:17.972564 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce023c33-6e13-4d7b-b72f-9f48f277a6eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:30:17.972870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce023c33-6e13-4d7b-b72f-9f48f277a6eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:17.974300 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce023c33-6e13-4d7b-b72f-9f48f277a6eb None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:17.988298 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 631/1272] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:30:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:30:17.994128 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15405a88-ada9-41ef-9175-080140e13ca1 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:18.100593 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:18.110637 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15405a88-ada9-41ef-9175-080140e13ca1 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:18.146835 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ee74f-650b-45d6-ab8a-6c4c44557fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:18.147540 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ee74f-650b-45d6-ab8a-6c4c44557fb0 None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:18.147826 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ee74f-650b-45d6-ab8a-6c4c44557fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:18.148101 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ee74f-650b-45d6-ab8a-6c4c44557fb0 None admin] PATH_INFO: `/v3/projects/b6ed5f989f4248d7bab2548eb350fe17/users/a48c49f7a9f44cef89dd024fecea422f/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:18.150049 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ee74f-650b-45d6-ab8a-6c4c44557fb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=b6ed5f989f4248d7bab2548eb350fe17, user_id=a48c49f7a9f44cef89dd024fecea422f, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:18.151585 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ee74f-650b-45d6-ab8a-6c4c44557fb0 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:18.397300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 642/1273] 10.222.0.26 () {58 vars in 1439 bytes} [Sun Sep 11 08:30:17 2022] PUT /identity/v3/projects/b6ed5f989f4248d7bab2548eb350fe17/users/a48c49f7a9f44cef89dd024fecea422f/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:30:20.583047 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b3a19-9f57-4ed7-ac6c-5ccc1770eae6 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:20.583628 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b3a19-9f57-4ed7-ac6c-5ccc1770eae6 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:20.583628 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b3a19-9f57-4ed7-ac6c-5ccc1770eae6 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:20.585224 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 632/1274] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:30:20.590611 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880ac7e-958a-40a4-9ef8-cd78c73155fb None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:20.591043 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880ac7e-958a-40a4-9ef8-cd78c73155fb None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:20.591161 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880ac7e-958a-40a4-9ef8-cd78c73155fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:20.610715 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e880ac7e-958a-40a4-9ef8-cd78c73155fb None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:30:20.612051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e880ac7e-958a-40a4-9ef8-cd78c73155fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:30:20.680934 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 643/1275] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:30:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:30:20.954889 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b3a19-9f57-4ed7-ac6c-5ccc1770eae6 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:21.057629 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b3a19-9f57-4ed7-ac6c-5ccc1770eae6 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:21.074981 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:21.092984 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d30e7-6fc0-4cb9-97e8-cfa18bd2f0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:21.093621 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d30e7-6fc0-4cb9-97e8-cfa18bd2f0bc None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:21.093906 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d30e7-6fc0-4cb9-97e8-cfa18bd2f0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:21.094182 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d30e7-6fc0-4cb9-97e8-cfa18bd2f0bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:21.104304 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d30e7-6fc0-4cb9-97e8-cfa18bd2f0bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 08:30:21.109258 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-ae9d30e7-6fc0-4cb9-97e8-cfa18bd2f0bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:30:21.109258 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:30:21.109258 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:30:21.109258 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:30:21.109258 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:30:21.109258 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:30:21.109258 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:30:21.109258 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:30:21.109258 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:30:21.109258 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:30:21.109258 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:30:21.109258 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:30:21.109258 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 08:30:21.109258 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 08:30:21.109258 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 08:30:21.109258 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 08:30:21.110349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 08:30:21.110349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 08:30:21.110349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 08:30:21.110349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 08:30:21.110349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:30:21.110349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:30:21.110349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:30:21.110349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:30:21.110349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:30:21.110349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:30:21.110349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:30:21.110349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:30:21.110349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:30:21.110349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:30:21.110349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:30:21.110349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:30:21.111418 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:30:21.111418 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:30:21.111418 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:30:21.111418 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:30:21.111418 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 08:30:21.111418 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 08:30:21.111418 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 08:30:21.111418 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 08:30:21.111418 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 08:30:21.111418 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 08:30:21.111418 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 08:30:21.111418 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:30:21.111418 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 633/1276] 10.222.0.26 () {56 vars in 1096 bytes} [Sun Sep 11 08:30:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:30:21.116643 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880ac7e-958a-40a4-9ef8-cd78c73155fb None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:21.202925 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:21.223325 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880ac7e-958a-40a4-9ef8-cd78c73155fb None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:21.257565 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ae2a0-06d7-486d-bb30-74ede7bd3f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:21.259536 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ae2a0-06d7-486d-bb30-74ede7bd3f82 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:21.259536 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ae2a0-06d7-486d-bb30-74ede7bd3f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:21.259536 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ae2a0-06d7-486d-bb30-74ede7bd3f82 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:21.259536 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ae2a0-06d7-486d-bb30-74ede7bd3f82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:30:21.259927 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ae2a0-06d7-486d-bb30-74ede7bd3f82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:21.261176 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ae2a0-06d7-486d-bb30-74ede7bd3f82 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:21.270531 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 644/1277] 10.222.0.26 () {56 vars in 1099 bytes} [Sun Sep 11 08:30:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:30:21.276431 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d30e7-6fc0-4cb9-97e8-cfa18bd2f0bc None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:21.381428 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d30e7-6fc0-4cb9-97e8-cfa18bd2f0bc None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:21.428549 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf0563-7f40-4946-9929-9f06e5f48af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:21.429291 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf0563-7f40-4946-9929-9f06e5f48af7 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:21.429601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf0563-7f40-4946-9929-9f06e5f48af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:21.429898 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf0563-7f40-4946-9929-9f06e5f48af7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:21.443406 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf0563-7f40-4946-9929-9f06e5f48af7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:21.445734 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf0563-7f40-4946-9929-9f06e5f48af7 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:21.466974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-bbdf0563-7f40-4946-9929-9f06e5f48af7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:30:21.466974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:30:21.466974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:30:21.466974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:30:21.466974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:30:21.466974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:30:21.466974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:30:21.466974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:30:21.466974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:30:21.466974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:30:21.466974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:30:21.466974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:30:21.466974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:30:21.466974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:30:21.466974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:30:21.466974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:30:21.469523 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:30:21.469523 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:30:21.469523 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:30:21.469523 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:30:21.469523 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:30:21.469523 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:30:21.469523 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:30:21.469523 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:30:21.469523 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:30:21.469523 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:30:21.469523 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:30:21.469523 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:30:21.469523 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:30:21.469523 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:30:21.469523 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:30:21.469523 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:30:21.469523 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:30:21.471810 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:30:21.471810 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:30:21.471810 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:30:21.471810 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 634/1278] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:30:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:30:21.474805 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ae2a0-06d7-486d-bb30-74ede7bd3f82 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:21.588819 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ae2a0-06d7-486d-bb30-74ede7bd3f82 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:21.622829 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ca246-6a1f-4695-bef5-9bda4c2782bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:21.624133 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ca246-6a1f-4695-bef5-9bda4c2782bb None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:21.624359 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ca246-6a1f-4695-bef5-9bda4c2782bb None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:21.624645 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ca246-6a1f-4695-bef5-9bda4c2782bb None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:21.625332 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ca246-6a1f-4695-bef5-9bda4c2782bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:30:21.625639 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ca246-6a1f-4695-bef5-9bda4c2782bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:21.627024 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ca246-6a1f-4695-bef5-9bda4c2782bb None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:21.639053 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 645/1279] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:30:21.645029 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf0563-7f40-4946-9929-9f06e5f48af7 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:21.677535 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:21.753561 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf0563-7f40-4946-9929-9f06e5f48af7 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:21.791646 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563248f4-dd84-4ef9-80fe-bb6410b65296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:21.792311 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563248f4-dd84-4ef9-80fe-bb6410b65296 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:21.792586 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563248f4-dd84-4ef9-80fe-bb6410b65296 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:21.792855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563248f4-dd84-4ef9-80fe-bb6410b65296 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:21.801396 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563248f4-dd84-4ef9-80fe-bb6410b65296 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:21.802828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563248f4-dd84-4ef9-80fe-bb6410b65296 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:21.815357 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-563248f4-dd84-4ef9-80fe-bb6410b65296 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 08:30:21.815357 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:30:21.815357 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:30:21.815357 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:30:21.815357 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:30:21.815357 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:30:21.815357 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:30:21.815357 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:30:21.815357 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:30:21.815357 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:30:21.815357 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:30:21.815357 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:30:21.815357 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 08:30:21.815357 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 08:30:21.815357 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 08:30:21.815357 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 08:30:21.816825 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:30:21.816825 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:30:21.816825 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 08:30:21.816825 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:30:21.816825 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 08:30:21.816825 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 08:30:21.816825 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:30:21.816825 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:30:21.816825 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:30:21.816825 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:30:21.816825 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:30:21.816825 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:30:21.816825 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:30:21.816825 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:30:21.816825 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:30:21.816825 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:30:21.816825 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:30:21.816825 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:30:21.818110 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:30:21.818110 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:30:21.818110 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 08:30:21.818110 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 08:30:21.818110 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 08:30:21.818110 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 08:30:21.818110 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 08:30:21.818110 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 08:30:21.818110 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 08:30:21.818110 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:30:21.818110 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 635/1280] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:30:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:30:21.822430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ca246-6a1f-4695-bef5-9bda4c2782bb None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:21.826194 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:21.924144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ca246-6a1f-4695-bef5-9bda4c2782bb None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:21.958908 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db13bc-1cc0-4846-b7c0-717002a17837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:21.959546 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db13bc-1cc0-4846-b7c0-717002a17837 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:21.959823 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db13bc-1cc0-4846-b7c0-717002a17837 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:21.960092 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db13bc-1cc0-4846-b7c0-717002a17837 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:21.960826 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db13bc-1cc0-4846-b7c0-717002a17837 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:30:21.961134 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db13bc-1cc0-4846-b7c0-717002a17837 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:21.962595 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db13bc-1cc0-4846-b7c0-717002a17837 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:21.981168 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 646/1281] 10.222.0.26 () {56 vars in 1143 bytes} [Sun Sep 11 08:30:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:30:21.987849 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563248f4-dd84-4ef9-80fe-bb6410b65296 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:22.088993 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:22.098442 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563248f4-dd84-4ef9-80fe-bb6410b65296 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:22.136735 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b49f6-2379-4f0b-b236-4c696c9a8fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:22.137361 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b49f6-2379-4f0b-b236-4c696c9a8fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:22.137641 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b49f6-2379-4f0b-b236-4c696c9a8fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:22.137912 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b49f6-2379-4f0b-b236-4c696c9a8fa0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:22.214753 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b49f6-2379-4f0b-b236-4c696c9a8fa0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:22.216258 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b49f6-2379-4f0b-b236-4c696c9a8fa0 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:22.309939 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:22.320357 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 636/1282] 10.222.0.26 () {58 vars in 1282 bytes} [Sun Sep 11 08:30:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 08:30:22.326364 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db13bc-1cc0-4846-b7c0-717002a17837 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:22.407363 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:22.461655 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db13bc-1cc0-4846-b7c0-717002a17837 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:22.500241 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d52ce-1a29-44ad-a77d-4e1bd90a6422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:22.500876 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d52ce-1a29-44ad-a77d-4e1bd90a6422 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:22.501172 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d52ce-1a29-44ad-a77d-4e1bd90a6422 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:22.501426 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d52ce-1a29-44ad-a77d-4e1bd90a6422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:22.511572 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d52ce-1a29-44ad-a77d-4e1bd90a6422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:22.512993 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d52ce-1a29-44ad-a77d-4e1bd90a6422 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:22.528159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-c84d52ce-1a29-44ad-a77d-4e1bd90a6422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:30:22.528159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:30:22.528159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:30:22.528159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:30:22.528159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:30:22.528159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:30:22.528159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:30:22.528159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:30:22.528159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:30:22.528159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:30:22.528159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:30:22.528159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:30:22.528159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 08:30:22.528159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 08:30:22.528159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 08:30:22.528159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 08:30:22.529269 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:30:22.529269 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:30:22.529269 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:30:22.529269 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:30:22.529269 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:30:22.529269 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:30:22.529269 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:30:22.529269 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:30:22.529269 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:30:22.529269 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:30:22.529269 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:30:22.529269 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:30:22.529269 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:30:22.529269 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:30:22.529269 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:30:22.529269 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:30:22.529269 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 08:30:22.530950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 08:30:22.530950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 08:30:22.530950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:30:22.530950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 647/1283] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:30:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:30:22.537328 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b49f6-2379-4f0b-b236-4c696c9a8fa0 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:22.651275 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b49f6-2379-4f0b-b236-4c696c9a8fa0 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:22.696028 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a9ebc-eb5c-4d72-a3ea-2ef5f4f93d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:22.696656 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a9ebc-eb5c-4d72-a3ea-2ef5f4f93d81 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:22.696936 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a9ebc-eb5c-4d72-a3ea-2ef5f4f93d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:22.697212 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a9ebc-eb5c-4d72-a3ea-2ef5f4f93d81 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:22.697922 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a9ebc-eb5c-4d72-a3ea-2ef5f4f93d81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:30:22.698234 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a9ebc-eb5c-4d72-a3ea-2ef5f4f93d81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:22.699673 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a9ebc-eb5c-4d72-a3ea-2ef5f4f93d81 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:22.713160 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 637/1284] 10.222.0.26 () {56 vars in 1109 bytes} [Sun Sep 11 08:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:30:22.719686 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d52ce-1a29-44ad-a77d-4e1bd90a6422 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:22.831381 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d52ce-1a29-44ad-a77d-4e1bd90a6422 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:22.845464 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:22.866686 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f204a1c-74ea-479f-b2d1-81ad32fdb420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:22.867366 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f204a1c-74ea-479f-b2d1-81ad32fdb420 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:22.867675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f204a1c-74ea-479f-b2d1-81ad32fdb420 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:22.867944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f204a1c-74ea-479f-b2d1-81ad32fdb420 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:22.877602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f204a1c-74ea-479f-b2d1-81ad32fdb420 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:22.880002 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f204a1c-74ea-479f-b2d1-81ad32fdb420 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:22.898705 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-7f204a1c-74ea-479f-b2d1-81ad32fdb420 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:30:22.898705 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:30:22.898705 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:30:22.898705 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:30:22.898705 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:30:22.898705 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:30:22.898705 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:30:22.898705 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:30:22.898705 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:30:22.898705 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:30:22.898705 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:30:22.898705 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:30:22.898705 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 08:30:22.898705 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 08:30:22.898705 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 08:30:22.899816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 08:30:22.899816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:30:22.899816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:30:22.899816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:30:22.899816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:30:22.899816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:30:22.899816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:30:22.899816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:30:22.899816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 11 08:30:22.899816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:30:22.899816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:30:22.899816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:30:22.899816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:30:22.899816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:30:22.899816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:30:22.899816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:30:22.899816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:30:22.900746 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 08:30:22.900746 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 08:30:22.900746 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 08:30:22.900746 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 08:30:22.900746 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 08:30:22.900746 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 08:30:22.900746 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 08:30:22.900746 dv-cinder-856941-2-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 11 08:30:22.900746 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 648/1285] 10.222.0.26 () {56 vars in 1111 bytes} [Sun Sep 11 08:30:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:30:22.907971 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a9ebc-eb5c-4d72-a3ea-2ef5f4f93d81 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:22.974114 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:23.025845 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a9ebc-eb5c-4d72-a3ea-2ef5f4f93d81 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:23.058444 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad522744-39d8-4996-acc3-f800577e329e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:23.059050 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad522744-39d8-4996-acc3-f800577e329e None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:23.059354 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad522744-39d8-4996-acc3-f800577e329e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:23.059626 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad522744-39d8-4996-acc3-f800577e329e None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:23.060368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad522744-39d8-4996-acc3-f800577e329e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:30:23.061231 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad522744-39d8-4996-acc3-f800577e329e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:23.062690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad522744-39d8-4996-acc3-f800577e329e None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:23.074930 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 638/1286] 10.222.0.26 () {56 vars in 1148 bytes} [Sun Sep 11 08:30:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:30:23.082196 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f204a1c-74ea-479f-b2d1-81ad32fdb420 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:23.192444 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f204a1c-74ea-479f-b2d1-81ad32fdb420 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:23.242826 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9148c-79b2-4a20-b753-5c6929ae95f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:23.242826 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9148c-79b2-4a20-b753-5c6929ae95f3 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:23.242826 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9148c-79b2-4a20-b753-5c6929ae95f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:23.242826 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9148c-79b2-4a20-b753-5c6929ae95f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:23.243520 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9148c-79b2-4a20-b753-5c6929ae95f3 None admin] RBAC: Adding query filter params (role.id=d12af9f1dfb344cd8a6a493e165030ba, scope.project.id=b6ed5f989f4248d7bab2548eb350fe17, user.id=a48c49f7a9f44cef89dd024fecea422f) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:30:23.243520 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9148c-79b2-4a20-b753-5c6929ae95f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:23.243520 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9148c-79b2-4a20-b753-5c6929ae95f3 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:23.243520 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 649/1287] 10.222.0.26 () {56 vars in 1374 bytes} [Sun Sep 11 08:30:23 2022] GET /identity/v3/role_assignments?user.id=a48c49f7a9f44cef89dd024fecea422f&scope.project.id=b6ed5f989f4248d7bab2548eb350fe17&role.id=d12af9f1dfb344cd8a6a493e165030ba => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:30:25.454978 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeecae4-519a-47a5-be96-0a4d086f6b75 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:25.455664 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeecae4-519a-47a5-be96-0a4d086f6b75 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:25.455664 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeecae4-519a-47a5-be96-0a4d086f6b75 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:25.457040 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 639/1288] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:30:25.462717 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dda4f8-424c-4c78-bcdb-328b2303151e None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:25.463166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dda4f8-424c-4c78-bcdb-328b2303151e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:25.463288 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dda4f8-424c-4c78-bcdb-328b2303151e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:25.482369 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e0dda4f8-424c-4c78-bcdb-328b2303151e None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:30:25.483592 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e0dda4f8-424c-4c78-bcdb-328b2303151e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:30:25.513230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:25.552582 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 650/1289] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:30:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:30:25.820228 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeecae4-519a-47a5-be96-0a4d086f6b75 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:25.930776 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeecae4-519a-47a5-be96-0a4d086f6b75 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:25.941919 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:25.965750 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d2ace-541b-431b-b1ee-d949133c1244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:25.966398 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d2ace-541b-431b-b1ee-d949133c1244 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:25.966666 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d2ace-541b-431b-b1ee-d949133c1244 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:25.966968 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d2ace-541b-431b-b1ee-d949133c1244 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:25.967584 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d2ace-541b-431b-b1ee-d949133c1244 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:25.968953 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d2ace-541b-431b-b1ee-d949133c1244 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:25.977998 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-b80d2ace-541b-431b-b1ee-d949133c1244 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 08:30:25.977998 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:30:25.977998 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 08:30:25.977998 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 08:30:25.977998 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 08:30:25.977998 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 08:30:25.977998 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 08:30:25.977998 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:30:25.977998 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 08:30:25.977998 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:30:25.977998 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 08:30:25.977998 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:30:25.977998 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:30:25.977998 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:30:25.977998 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:30:25.977998 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:30:25.977998 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:30:25.983082 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:30:25.983082 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:30:25.983082 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:30:25.983082 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:30:25.983082 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:30:25.983082 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:30:25.983082 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 08:30:25.983082 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 08:30:25.983082 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 08:30:25.983082 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 08:30:25.983082 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:30:25.983082 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:30:25.983082 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:30:25.983082 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:30:25.983082 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:30:25.983082 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:30:25.984226 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:30:25.984226 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:30:25.984226 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:30:25.984226 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:30:25.984226 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:30:25.984226 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:30:25.984226 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:30:25.984226 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:30:25.984226 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:30:25.984226 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:30:25.984226 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 08:30:25.984226 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:30:25.984226 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 08:30:25.984226 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:30:25.984226 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 640/1290] 10.222.0.26 () {56 vars in 1117 bytes} [Sun Sep 11 08:30:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 08:30:25.986280 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dda4f8-424c-4c78-bcdb-328b2303151e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:26.085666 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dda4f8-424c-4c78-bcdb-328b2303151e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:26.120371 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957faf87-2c51-4192-b136-8f2b1843ba07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:26.120971 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957faf87-2c51-4192-b136-8f2b1843ba07 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:26.121251 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957faf87-2c51-4192-b136-8f2b1843ba07 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:26.121525 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957faf87-2c51-4192-b136-8f2b1843ba07 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:26.122187 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957faf87-2c51-4192-b136-8f2b1843ba07 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:30:26.122493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957faf87-2c51-4192-b136-8f2b1843ba07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:26.124440 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957faf87-2c51-4192-b136-8f2b1843ba07 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:26.129256 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 651/1291] 10.222.0.26 () {56 vars in 1116 bytes} [Sun Sep 11 08:30:25 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:30:26.135119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d2ace-541b-431b-b1ee-d949133c1244 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:26.237409 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d2ace-541b-431b-b1ee-d949133c1244 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:26.271008 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5accfb5-170f-4986-851c-e6b5e7a6e6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:26.271645 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5accfb5-170f-4986-851c-e6b5e7a6e6d2 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:26.271925 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5accfb5-170f-4986-851c-e6b5e7a6e6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:26.272195 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5accfb5-170f-4986-851c-e6b5e7a6e6d2 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:26.272815 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5accfb5-170f-4986-851c-e6b5e7a6e6d2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:30:26.273114 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5accfb5-170f-4986-851c-e6b5e7a6e6d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:26.274532 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5accfb5-170f-4986-851c-e6b5e7a6e6d2 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:26.279562 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 641/1292] 10.222.0.26 () {56 vars in 1116 bytes} [Sun Sep 11 08:30:26 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:30:28.518388 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10176135-ab4b-4892-80a0-8ed2dfeca997 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:28.519024 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10176135-ab4b-4892-80a0-8ed2dfeca997 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:28.519024 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10176135-ab4b-4892-80a0-8ed2dfeca997 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:28.520335 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 652/1293] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:30:28.526071 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373eca4-e74d-486e-85ef-f88b0a54205d None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:28.526542 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373eca4-e74d-486e-85ef-f88b0a54205d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:28.526640 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373eca4-e74d-486e-85ef-f88b0a54205d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:28.545794 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-8373eca4-e74d-486e-85ef-f88b0a54205d None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:30:28.547098 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-8373eca4-e74d-486e-85ef-f88b0a54205d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:30:28.577951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:28.614727 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 642/1294] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:30:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:30:28.898982 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10176135-ab4b-4892-80a0-8ed2dfeca997 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:28.930154 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:28.999234 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10176135-ab4b-4892-80a0-8ed2dfeca997 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:29.032812 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b37c31-0b32-4e9f-9c3a-67639631b71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:29.033425 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b37c31-0b32-4e9f-9c3a-67639631b71f None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:29.033698 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b37c31-0b32-4e9f-9c3a-67639631b71f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:29.033970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b37c31-0b32-4e9f-9c3a-67639631b71f None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:29.034635 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b37c31-0b32-4e9f-9c3a-67639631b71f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:29.036043 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b37c31-0b32-4e9f-9c3a-67639631b71f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:29.123867 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 653/1295] 10.222.0.26 () {60 vars in 1141 bytes} [Sun Sep 11 08:30:28 2022] POST /identity/v3/services => generated 246 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:30:31.353839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa51c7-776b-471d-8302-f7948ccb692b None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:31.354393 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa51c7-776b-471d-8302-f7948ccb692b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:31.354393 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa51c7-776b-471d-8302-f7948ccb692b None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:31.355761 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 643/1296] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:30:31.361599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f73a9-4d50-4664-9f23-3d15337409c8 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:31.362044 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f73a9-4d50-4664-9f23-3d15337409c8 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:31.362148 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f73a9-4d50-4664-9f23-3d15337409c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:31.381003 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-718f73a9-4d50-4664-9f23-3d15337409c8 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:30:31.382191 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-718f73a9-4d50-4664-9f23-3d15337409c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:30:31.453573 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 654/1297] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:30:31 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 08:30:31.735658 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa51c7-776b-471d-8302-f7948ccb692b None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:31.836734 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa51c7-776b-471d-8302-f7948ccb692b None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:31.872354 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da69c8-958a-4c84-89fa-53b900d43ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:31.880305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da69c8-958a-4c84-89fa-53b900d43ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:31.880305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da69c8-958a-4c84-89fa-53b900d43ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:31.880305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da69c8-958a-4c84-89fa-53b900d43ae0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:31.880305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da69c8-958a-4c84-89fa-53b900d43ae0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:31.880305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da69c8-958a-4c84-89fa-53b900d43ae0 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:31.884373 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-65da69c8-958a-4c84-89fa-53b900d43ae0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 08:30:31.884373 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:30:31.884373 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 08:30:31.884373 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 08:30:31.884373 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 08:30:31.884373 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 08:30:31.884373 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 08:30:31.884373 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:30:31.884373 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 08:30:31.884373 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:30:31.884373 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 08:30:31.884373 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:30:31.884373 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:30:31.884373 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:30:31.884373 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:30:31.884373 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:30:31.884373 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:30:31.885786 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:30:31.885786 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:30:31.885786 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:30:31.885786 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:30:31.885786 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:30:31.885786 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:30:31.885786 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 08:30:31.885786 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 08:30:31.885786 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 08:30:31.885786 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 08:30:31.885786 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:30:31.885786 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:30:31.885786 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:30:31.885786 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:30:31.885786 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:30:31.885786 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:30:31.886755 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:30:31.886755 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:30:31.886755 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:30:31.886755 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:30:31.886755 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:30:31.886755 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:30:31.886755 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:30:31.886755 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:30:31.886755 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:30:31.886755 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:30:31.886755 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 08:30:31.886755 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:30:31.886755 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 08:30:31.886755 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:30:31.886755 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 644/1298] 10.222.0.26 () {56 vars in 1117 bytes} [Sun Sep 11 08:30:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:30:31.891766 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f73a9-4d50-4664-9f23-3d15337409c8 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:31.910796 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:31.993170 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f73a9-4d50-4664-9f23-3d15337409c8 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:32.026543 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e961729-50bd-4699-9bc2-a07f0fb36edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:32.027158 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e961729-50bd-4699-9bc2-a07f0fb36edb None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:32.027474 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e961729-50bd-4699-9bc2-a07f0fb36edb None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:32.027753 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e961729-50bd-4699-9bc2-a07f0fb36edb None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:32.028385 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e961729-50bd-4699-9bc2-a07f0fb36edb None admin] RBAC: Adding query filter params (name=placement) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:30:32.028714 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e961729-50bd-4699-9bc2-a07f0fb36edb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:32.030645 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e961729-50bd-4699-9bc2-a07f0fb36edb None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:32.035795 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 655/1299] 10.222.0.26 () {56 vars in 1116 bytes} [Sun Sep 11 08:30:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:30:32.041738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da69c8-958a-4c84-89fa-53b900d43ae0 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:32.073914 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:32.143571 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da69c8-958a-4c84-89fa-53b900d43ae0 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:32.177821 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccfdaf-5c11-4f7d-b6d6-76aff1927a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:32.178438 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccfdaf-5c11-4f7d-b6d6-76aff1927a97 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:32.178717 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccfdaf-5c11-4f7d-b6d6-76aff1927a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:32.178991 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccfdaf-5c11-4f7d-b6d6-76aff1927a97 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:32.179788 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ccfdaf-5c11-4f7d-b6d6-76aff1927a97 None admin] RBAC: Adding query filter params (interface=public, service_id=b3407000a8744fb4931791b9be3e4f2a, region_id=RegionOne) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:30:32.180100 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ccfdaf-5c11-4f7d-b6d6-76aff1927a97 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:32.181503 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ccfdaf-5c11-4f7d-b6d6-76aff1927a97 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:32.186784 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 645/1300] 10.222.0.26 () {56 vars in 1251 bytes} [Sun Sep 11 08:30:32 2022] GET /identity/v3/endpoints?service_id=b3407000a8744fb4931791b9be3e4f2a&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:30:32.192523 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e961729-50bd-4699-9bc2-a07f0fb36edb None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:32.276233 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:32.295481 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e961729-50bd-4699-9bc2-a07f0fb36edb None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:32.329925 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8206073-f4e1-44f2-8c99-fb1852007b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:32.330531 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8206073-f4e1-44f2-8c99-fb1852007b99 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:32.330809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8206073-f4e1-44f2-8c99-fb1852007b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:32.331085 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8206073-f4e1-44f2-8c99-fb1852007b99 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:32.331740 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8206073-f4e1-44f2-8c99-fb1852007b99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:32.333111 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8206073-f4e1-44f2-8c99-fb1852007b99 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:32.339904 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 656/1301] 10.222.0.26 () {56 vars in 1087 bytes} [Sun Sep 11 08:30:32 2022] GET /identity/v3/services => generated 2191 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:30:34.557355 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b367f3-27a1-4bbd-9a10-49562f6710d4 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:34.557900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b367f3-27a1-4bbd-9a10-49562f6710d4 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:34.557900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b367f3-27a1-4bbd-9a10-49562f6710d4 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:34.559334 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 646/1302] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:30:34.570112 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae292a40-7e28-47f3-94fb-46ca51388329 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:34.570639 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae292a40-7e28-47f3-94fb-46ca51388329 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:34.570639 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae292a40-7e28-47f3-94fb-46ca51388329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:34.589681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-ae292a40-7e28-47f3-94fb-46ca51388329 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:30:34.592655 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ae292a40-7e28-47f3-94fb-46ca51388329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:30:34.661687 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 657/1303] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:30:34 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 08:30:34.940980 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b367f3-27a1-4bbd-9a10-49562f6710d4 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:35.043453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:35.050950 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b367f3-27a1-4bbd-9a10-49562f6710d4 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:35.088760 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971ab3d-04e8-41ab-93b4-31e044c3e39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:35.089396 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971ab3d-04e8-41ab-93b4-31e044c3e39c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:35.089677 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971ab3d-04e8-41ab-93b4-31e044c3e39c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:35.089951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971ab3d-04e8-41ab-93b4-31e044c3e39c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:35.090574 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4971ab3d-04e8-41ab-93b4-31e044c3e39c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:35.092013 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4971ab3d-04e8-41ab-93b4-31e044c3e39c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:35.101249 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-4971ab3d-04e8-41ab-93b4-31e044c3e39c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 08:30:35.101249 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:30:35.101249 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 08:30:35.101249 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 08:30:35.101249 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 08:30:35.101249 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 08:30:35.101249 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 08:30:35.101249 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:30:35.101249 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 08:30:35.101249 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:30:35.101249 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 08:30:35.101249 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:30:35.101249 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 08:30:35.101249 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 08:30:35.101249 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 08:30:35.101249 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 08:30:35.101249 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 08:30:35.103944 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 08:30:35.103944 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 08:30:35.103944 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 08:30:35.103944 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 08:30:35.103944 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 08:30:35.103944 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 08:30:35.103944 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 08:30:35.103944 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 08:30:35.103944 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 08:30:35.103944 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 08:30:35.103944 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 08:30:35.103944 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 08:30:35.103944 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 08:30:35.103944 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 08:30:35.103944 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 08:30:35.103944 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 08:30:35.105884 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 08:30:35.105884 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Sep 11 08:30:35.105884 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 08:30:35.105884 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Sep 11 08:30:35.105884 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 08:30:35.105884 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 08:30:35.105884 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 08:30:35.105884 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Sep 11 08:30:35.105884 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 08:30:35.105884 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Sep 11 08:30:35.105884 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 08:30:35.105884 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 08:30:35.105884 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 08:30:35.105884 dv-cinder-856941-2-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Sep 11 08:30:35.105884 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 647/1304] 10.222.0.26 () {56 vars in 1117 bytes} [Sun Sep 11 08:30:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 08:30:35.111243 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae292a40-7e28-47f3-94fb-46ca51388329 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:35.193607 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:35.214833 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae292a40-7e28-47f3-94fb-46ca51388329 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:35.253196 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae235a-ccf4-4a52-9d6d-1a3558f60087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:35.253809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae235a-ccf4-4a52-9d6d-1a3558f60087 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:35.254089 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae235a-ccf4-4a52-9d6d-1a3558f60087 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:35.254364 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae235a-ccf4-4a52-9d6d-1a3558f60087 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:35.255035 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae235a-ccf4-4a52-9d6d-1a3558f60087 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:30:35.255370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae235a-ccf4-4a52-9d6d-1a3558f60087 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:35.256779 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae235a-ccf4-4a52-9d6d-1a3558f60087 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:35.262253 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 658/1305] 10.222.0.26 () {56 vars in 1116 bytes} [Sun Sep 11 08:30:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:30:35.271371 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971ab3d-04e8-41ab-93b4-31e044c3e39c None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:30:35.378663 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971ab3d-04e8-41ab-93b4-31e044c3e39c None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:30:35.413728 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3770a-87c3-4fe1-85f6-218752826bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:30:35.414343 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3770a-87c3-4fe1-85f6-218752826bd9 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:30:35.414625 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3770a-87c3-4fe1-85f6-218752826bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:30:35.414901 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3770a-87c3-4fe1-85f6-218752826bd9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:30:35.415629 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3770a-87c3-4fe1-85f6-218752826bd9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:30:35.417020 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3770a-87c3-4fe1-85f6-218752826bd9 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:30:35.633401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 648/1306] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:30:35 2022] POST /identity/v3/endpoints => generated 331 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:30:45.258957 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=30 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:30:45.628895 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:38:11.031587 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88fc49-963b-48c3-8994-9765db3e66fd None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:11.032339 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88fc49-963b-48c3-8994-9765db3e66fd None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:11.032513 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88fc49-963b-48c3-8994-9765db3e66fd None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:11.035189 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 659/1307] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:38:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:38:11.043007 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dfca4-efcd-4039-889b-6ec01fa41a20 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:11.043791 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dfca4-efcd-4039-889b-6ec01fa41a20 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:11.044183 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dfca4-efcd-4039-889b-6ec01fa41a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:11.217671 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-343dfca4-efcd-4039-889b-6ec01fa41a20 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:38:11.219802 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-343dfca4-efcd-4039-889b-6ec01fa41a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:11.395444 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 649/1308] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:38:11.723113 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808ac85-049b-4fd8-887e-24f6388b6cfb None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:11.723623 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808ac85-049b-4fd8-887e-24f6388b6cfb None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:11.723782 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808ac85-049b-4fd8-887e-24f6388b6cfb None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:11.725569 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 660/1309] 10.222.0.26 () {54 vars in 965 bytes} [Sun Sep 11 08:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:38:11.735945 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e916f-a731-4976-9623-f75e863a69fe None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:11.736227 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e916f-a731-4976-9623-f75e863a69fe None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:11.736583 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e916f-a731-4976-9623-f75e863a69fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:11.902049 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-330e916f-a731-4976-9623-f75e863a69fe None None] MFA Rules not processed for user `7c86ca1e378c4042a1807c7a45aaab99`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:38:11.904385 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-330e916f-a731-4976-9623-f75e863a69fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:11.943660 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:38:12.018049 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 650/1310] 10.222.0.26 () {58 vars in 1062 bytes} [Sun Sep 11 08:38:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:38:12.029160 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808ac85-049b-4fd8-887e-24f6388b6cfb None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:38:12.032284 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d808ac85-049b-4fd8-887e-24f6388b6cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:12.170807 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808ac85-049b-4fd8-887e-24f6388b6cfb None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:38:12.314691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda41b5c-cab3-4c3d-ab77-44336a4b1f39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:38:12.315843 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda41b5c-cab3-4c3d-ab77-44336a4b1f39 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:12.316187 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda41b5c-cab3-4c3d-ab77-44336a4b1f39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:12.316659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda41b5c-cab3-4c3d-ab77-44336a4b1f39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:12.320317 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-eda41b5c-cab3-4c3d-ab77-44336a4b1f39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:12.419952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:38:12.523320 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda41b5c-cab3-4c3d-ab77-44336a4b1f39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:38:12.526082 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda41b5c-cab3-4c3d-ab77-44336a4b1f39 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:38:12.562706 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 661/1311] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:38:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:38:15.756707 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206689a-5103-47a2-ae93-f545dd16f9ad None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:15.757550 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206689a-5103-47a2-ae93-f545dd16f9ad None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:15.757715 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206689a-5103-47a2-ae93-f545dd16f9ad None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:15.759112 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 651/1312] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:38:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:38:15.765161 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1cfed-62be-4771-a4fa-1c706a81b77d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:15.765916 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1cfed-62be-4771-a4fa-1c706a81b77d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:15.766094 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1cfed-62be-4771-a4fa-1c706a81b77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:15.848599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-97e1cfed-62be-4771-a4fa-1c706a81b77d None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:38:15.850050 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-97e1cfed-62be-4771-a4fa-1c706a81b77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:15.977382 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 662/1313] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:38:16.281672 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcce5a-1141-4868-b5a6-e4030ac91878 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:16.282085 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcce5a-1141-4868-b5a6-e4030ac91878 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:16.282416 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcce5a-1141-4868-b5a6-e4030ac91878 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:16.283973 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 652/1314] 10.222.0.26 () {54 vars in 965 bytes} [Sun Sep 11 08:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:38:16.290733 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28580f-5e4f-4183-9270-9d125c9d398f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:16.291017 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28580f-5e4f-4183-9270-9d125c9d398f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:16.291325 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28580f-5e4f-4183-9270-9d125c9d398f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:16.303646 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:38:16.377959 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-6b28580f-5e4f-4183-9270-9d125c9d398f None None] MFA Rules not processed for user `7c86ca1e378c4042a1807c7a45aaab99`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:38:16.379223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6b28580f-5e4f-4183-9270-9d125c9d398f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:16.494182 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 663/1315] 10.222.0.26 () {58 vars in 1062 bytes} [Sun Sep 11 08:38:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:38:16.504768 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcce5a-1141-4868-b5a6-e4030ac91878 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:38:16.507768 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-69fcce5a-1141-4868-b5a6-e4030ac91878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:16.669210 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcce5a-1141-4868-b5a6-e4030ac91878 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:38:16.752473 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:38:16.755050 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ac008-03bc-4965-baa6-3c4460adb8ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:38:16.755734 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ac008-03bc-4965-baa6-3c4460adb8ac service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:16.756015 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ac008-03bc-4965-baa6-3c4460adb8ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:16.756294 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ac008-03bc-4965-baa6-3c4460adb8ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:16.772139 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-0d9ac008-03bc-4965-baa6-3c4460adb8ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:16.918579 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ac008-03bc-4965-baa6-3c4460adb8ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:38:16.920121 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ac008-03bc-4965-baa6-3c4460adb8ac service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:38:16.941484 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 653/1316] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:38:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:38:20.009157 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc3fd1-a1e8-427e-bf7a-e356bf215bce None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:20.009731 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc3fd1-a1e8-427e-bf7a-e356bf215bce None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:20.009731 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc3fd1-a1e8-427e-bf7a-e356bf215bce None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:20.011060 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 664/1317] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:38:20.016705 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abcb17-a844-4805-b7f7-f99d9b85a607 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:20.017155 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abcb17-a844-4805-b7f7-f99d9b85a607 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:20.017264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abcb17-a844-4805-b7f7-f99d9b85a607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:20.084744 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-12abcb17-a844-4805-b7f7-f99d9b85a607 None None] MFA Rules not processed for user `6888ff673cd64e31b2d50533a8dbc8a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:38:20.085964 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-12abcb17-a844-4805-b7f7-f99d9b85a607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:20.139326 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:38:20.185233 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 654/1318] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:38:20 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:38:20.469857 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc3fd1-a1e8-427e-bf7a-e356bf215bce None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:38:20.471446 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-27fc3fd1-a1e8-427e-bf7a-e356bf215bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:20.575082 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc3fd1-a1e8-427e-bf7a-e356bf215bce None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:38:20.577891 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:38:20.652247 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bea300-c654-4588-8e87-d1bf64b09017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:38:20.652848 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bea300-c654-4588-8e87-d1bf64b09017 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:20.653122 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bea300-c654-4588-8e87-d1bf64b09017 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:20.653392 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bea300-c654-4588-8e87-d1bf64b09017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:20.654976 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-67bea300-c654-4588-8e87-d1bf64b09017 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:20.765598 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bea300-c654-4588-8e87-d1bf64b09017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:38:20.766970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bea300-c654-4588-8e87-d1bf64b09017 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:38:20.785632 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 665/1319] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:38:20 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:38:23.796003 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148dabf-05e6-4b66-9505-6a1f4623ef84 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:23.796647 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148dabf-05e6-4b66-9505-6a1f4623ef84 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:23.796647 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148dabf-05e6-4b66-9505-6a1f4623ef84 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:23.797892 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 655/1320] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:38:23.803142 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d284f9-8172-49af-bee2-e90a95bd3709 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:23.803601 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d284f9-8172-49af-bee2-e90a95bd3709 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:23.803734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d284f9-8172-49af-bee2-e90a95bd3709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:23.846096 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:38:23.871155 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-32d284f9-8172-49af-bee2-e90a95bd3709 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:38:23.872636 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-32d284f9-8172-49af-bee2-e90a95bd3709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:23.968342 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 666/1321] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:38:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:38:24.255848 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148dabf-05e6-4b66-9505-6a1f4623ef84 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:38:24.257402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1148dabf-05e6-4b66-9505-6a1f4623ef84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:24.367175 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148dabf-05e6-4b66-9505-6a1f4623ef84 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:38:24.440797 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ba3b2-9565-4d1a-a122-bf4be43fc105 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:38:24.441406 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ba3b2-9565-4d1a-a122-bf4be43fc105 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:24.441688 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ba3b2-9565-4d1a-a122-bf4be43fc105 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:24.441968 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ba3b2-9565-4d1a-a122-bf4be43fc105 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:24.444212 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f60ba3b2-9565-4d1a-a122-bf4be43fc105 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:24.451411 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:38:24.556343 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ba3b2-9565-4d1a-a122-bf4be43fc105 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:38:24.557801 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ba3b2-9565-4d1a-a122-bf4be43fc105 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:38:24.577589 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 656/1322] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:38:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:38:28.076402 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef08b9c-ca4d-4079-8eed-31b87ddda4da None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:28.076952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef08b9c-ca4d-4079-8eed-31b87ddda4da None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:28.076952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef08b9c-ca4d-4079-8eed-31b87ddda4da None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:28.078280 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 667/1323] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:38:28.084595 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d936f-8cc2-435c-a08a-7c3e7e4bbd86 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:28.085050 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d936f-8cc2-435c-a08a-7c3e7e4bbd86 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:28.085146 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d936f-8cc2-435c-a08a-7c3e7e4bbd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:28.155764 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-da2d936f-8cc2-435c-a08a-7c3e7e4bbd86 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:38:28.156973 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-da2d936f-8cc2-435c-a08a-7c3e7e4bbd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:28.219418 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:38:28.263298 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 657/1324] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:38:28.555532 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef08b9c-ca4d-4079-8eed-31b87ddda4da None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:38:28.557537 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-aef08b9c-ca4d-4079-8eed-31b87ddda4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:28.665034 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef08b9c-ca4d-4079-8eed-31b87ddda4da None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:38:28.679940 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:38:28.743586 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f312e-6bbc-4b7f-84bd-4e5e364cbda1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:38:28.744207 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f312e-6bbc-4b7f-84bd-4e5e364cbda1 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:28.744482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f312e-6bbc-4b7f-84bd-4e5e364cbda1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:28.744769 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f312e-6bbc-4b7f-84bd-4e5e364cbda1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:28.746355 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8e0f312e-6bbc-4b7f-84bd-4e5e364cbda1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:28.860852 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f312e-6bbc-4b7f-84bd-4e5e364cbda1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:38:28.862303 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f312e-6bbc-4b7f-84bd-4e5e364cbda1 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:38:28.881759 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 668/1325] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:38:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:38:31.218937 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7e78e-46c6-40e9-825a-1e90b2a823e5 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:31.219551 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7e78e-46c6-40e9-825a-1e90b2a823e5 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:31.219551 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7e78e-46c6-40e9-825a-1e90b2a823e5 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:31.221039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 658/1326] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:38:31.228002 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b7e50-742f-4ab6-969f-f2aba3e5b2a7 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:31.228586 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b7e50-742f-4ab6-969f-f2aba3e5b2a7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:31.228586 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b7e50-742f-4ab6-969f-f2aba3e5b2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:31.283715 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:38:31.303193 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-4b6b7e50-742f-4ab6-969f-f2aba3e5b2a7 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:38:31.304809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4b6b7e50-742f-4ab6-969f-f2aba3e5b2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:31.440291 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 669/1327] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:38:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:38:31.716943 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7e78e-46c6-40e9-825a-1e90b2a823e5 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:38:31.718527 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2ae7e78e-46c6-40e9-825a-1e90b2a823e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:31.826883 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7e78e-46c6-40e9-825a-1e90b2a823e5 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:38:31.905353 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653a870-5da9-48ea-8422-c0e738486e1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:38:31.905964 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653a870-5da9-48ea-8422-c0e738486e1d service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:31.906242 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653a870-5da9-48ea-8422-c0e738486e1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:31.906514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653a870-5da9-48ea-8422-c0e738486e1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:31.908140 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5653a870-5da9-48ea-8422-c0e738486e1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:31.927298 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:38:32.031088 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653a870-5da9-48ea-8422-c0e738486e1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:38:32.032570 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653a870-5da9-48ea-8422-c0e738486e1d service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:38:32.051021 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 659/1328] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:38:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:38:34.329107 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858c38e-a11b-423f-82ef-20a7ed7d26a8 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:34.329628 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858c38e-a11b-423f-82ef-20a7ed7d26a8 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:34.329721 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858c38e-a11b-423f-82ef-20a7ed7d26a8 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:34.331160 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 670/1329] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:38:34.336795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cd4a2-67cb-4e60-ac53-c974802248a7 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:34.337249 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cd4a2-67cb-4e60-ac53-c974802248a7 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:34.337343 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cd4a2-67cb-4e60-ac53-c974802248a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:34.415424 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-9f3cd4a2-67cb-4e60-ac53-c974802248a7 None None] MFA Rules not processed for user `6888ff673cd64e31b2d50533a8dbc8a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:38:34.416584 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9f3cd4a2-67cb-4e60-ac53-c974802248a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:34.491464 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:38:34.526116 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 660/1330] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:38:34 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:38:34.811497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858c38e-a11b-423f-82ef-20a7ed7d26a8 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:38:34.813047 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3858c38e-a11b-423f-82ef-20a7ed7d26a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:34.945180 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858c38e-a11b-423f-82ef-20a7ed7d26a8 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:38:34.968279 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:38:35.030752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756952a-d62d-421a-b0a9-a8a54db9d65f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:38:35.031436 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756952a-d62d-421a-b0a9-a8a54db9d65f service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:35.031712 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756952a-d62d-421a-b0a9-a8a54db9d65f service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:35.031977 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756952a-d62d-421a-b0a9-a8a54db9d65f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:35.033629 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5756952a-d62d-421a-b0a9-a8a54db9d65f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:35.158252 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756952a-d62d-421a-b0a9-a8a54db9d65f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:38:35.159733 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756952a-d62d-421a-b0a9-a8a54db9d65f service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:38:35.179517 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 671/1331] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:38:34 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:38:37.861054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7258d-09a2-4f5c-96b4-b962a6515bb6 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:37.861585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7258d-09a2-4f5c-96b4-b962a6515bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:37.861585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7258d-09a2-4f5c-96b4-b962a6515bb6 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:37.862856 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 661/1332] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:38:37.868411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cc0df-3625-456b-9c5f-22fc9877180f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:37.868863 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cc0df-3625-456b-9c5f-22fc9877180f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:37.868958 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cc0df-3625-456b-9c5f-22fc9877180f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:37.933857 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:38:37.936709 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-ed3cc0df-3625-456b-9c5f-22fc9877180f None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:38:37.938416 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ed3cc0df-3625-456b-9c5f-22fc9877180f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:38.040734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 672/1333] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:38:38.330037 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7258d-09a2-4f5c-96b4-b962a6515bb6 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:38:38.331604 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-52b7258d-09a2-4f5c-96b4-b962a6515bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:38.440036 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7258d-09a2-4f5c-96b4-b962a6515bb6 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:38:38.528240 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652f8d7-6e1b-46e6-b06a-fb7bec867ee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:38:38.528858 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652f8d7-6e1b-46e6-b06a-fb7bec867ee0 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:38.529140 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652f8d7-6e1b-46e6-b06a-fb7bec867ee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:38.529417 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652f8d7-6e1b-46e6-b06a-fb7bec867ee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:38.531080 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6652f8d7-6e1b-46e6-b06a-fb7bec867ee0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:38.560095 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:38:38.643759 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6652f8d7-6e1b-46e6-b06a-fb7bec867ee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:38:38.645108 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6652f8d7-6e1b-46e6-b06a-fb7bec867ee0 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:38:38.663315 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 662/1334] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:38:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:38:40.945780 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3b7a0-fc1b-47a5-ba1b-79a193a9648d None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:40.946345 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3b7a0-fc1b-47a5-ba1b-79a193a9648d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:40.946345 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3b7a0-fc1b-47a5-ba1b-79a193a9648d None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:40.947622 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 673/1335] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:38:40.953099 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd84660-4160-4650-8417-bb559f06f840 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:40.953551 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd84660-4160-4650-8417-bb559f06f840 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:40.953665 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd84660-4160-4650-8417-bb559f06f840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:41.021043 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-2bd84660-4160-4650-8417-bb559f06f840 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:38:41.022259 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2bd84660-4160-4650-8417-bb559f06f840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:41.096322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:38:41.118227 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 663/1336] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:38:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:38:41.405222 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3b7a0-fc1b-47a5-ba1b-79a193a9648d None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:38:41.406834 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a3e3b7a0-fc1b-47a5-ba1b-79a193a9648d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:41.515528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3b7a0-fc1b-47a5-ba1b-79a193a9648d None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:38:41.544297 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:38:41.591655 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663b901-4da7-484e-abc3-3688f7222e21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:38:41.592272 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663b901-4da7-484e-abc3-3688f7222e21 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:41.592551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663b901-4da7-484e-abc3-3688f7222e21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:41.592822 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663b901-4da7-484e-abc3-3688f7222e21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:41.594500 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3663b901-4da7-484e-abc3-3688f7222e21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:41.711842 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663b901-4da7-484e-abc3-3688f7222e21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:38:41.713329 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663b901-4da7-484e-abc3-3688f7222e21 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:38:41.732360 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 674/1337] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:38:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:38:44.545506 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca2c57-604e-489b-bb04-99064de4eb76 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:44.546103 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca2c57-604e-489b-bb04-99064de4eb76 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:44.546103 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca2c57-604e-489b-bb04-99064de4eb76 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:44.547480 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 664/1338] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:38:44.553338 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ca140-13d5-41e0-8a10-e7a782b0021f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:44.553781 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ca140-13d5-41e0-8a10-e7a782b0021f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:44.553900 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ca140-13d5-41e0-8a10-e7a782b0021f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:44.628449 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-795ca140-13d5-41e0-8a10-e7a782b0021f None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:38:44.630301 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-795ca140-13d5-41e0-8a10-e7a782b0021f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:44.638523 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:38:44.729785 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 675/1339] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:38:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:38:45.013868 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca2c57-604e-489b-bb04-99064de4eb76 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:38:45.015565 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-78ca2c57-604e-489b-bb04-99064de4eb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:45.120328 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca2c57-604e-489b-bb04-99064de4eb76 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:38:45.193477 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ab7c8-b490-4e78-b9c7-2e75002ff402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:38:45.194079 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ab7c8-b490-4e78-b9c7-2e75002ff402 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:45.194358 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ab7c8-b490-4e78-b9c7-2e75002ff402 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:45.194631 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ab7c8-b490-4e78-b9c7-2e75002ff402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:45.196267 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6f7ab7c8-b490-4e78-b9c7-2e75002ff402 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:45.232674 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:38:45.306475 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ab7c8-b490-4e78-b9c7-2e75002ff402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:38:45.307876 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ab7c8-b490-4e78-b9c7-2e75002ff402 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:38:45.327679 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 665/1340] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:38:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:38:49.789372 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308ccd6-ce8c-4875-9bd1-89bf09af09da None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:49.789923 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308ccd6-ce8c-4875-9bd1-89bf09af09da None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:49.789923 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308ccd6-ce8c-4875-9bd1-89bf09af09da None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:49.791314 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 676/1341] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:38:49.797042 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d4e37-5d8d-44f4-87ae-de453e575172 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:49.797514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d4e37-5d8d-44f4-87ae-de453e575172 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:49.797631 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d4e37-5d8d-44f4-87ae-de453e575172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:49.870393 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-3a8d4e37-5d8d-44f4-87ae-de453e575172 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:38:49.871675 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3a8d4e37-5d8d-44f4-87ae-de453e575172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:49.963224 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:38:49.975396 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 666/1342] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:38:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:38:50.261255 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308ccd6-ce8c-4875-9bd1-89bf09af09da None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:38:50.262801 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6308ccd6-ce8c-4875-9bd1-89bf09af09da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:50.372471 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308ccd6-ce8c-4875-9bd1-89bf09af09da None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:38:50.415779 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:38:50.454979 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5fa1ad-a2d2-458f-8428-cfdfa29f40d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:38:50.455614 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fa1ad-a2d2-458f-8428-cfdfa29f40d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:50.455892 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fa1ad-a2d2-458f-8428-cfdfa29f40d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:50.456163 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fa1ad-a2d2-458f-8428-cfdfa29f40d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:50.458184 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-fc5fa1ad-a2d2-458f-8428-cfdfa29f40d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:50.586157 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5fa1ad-a2d2-458f-8428-cfdfa29f40d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:38:50.587698 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5fa1ad-a2d2-458f-8428-cfdfa29f40d2 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:38:50.611823 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 677/1343] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:38:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:38:54.014248 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf24ab-e858-4b5c-91c2-f1d387165cef None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:54.014833 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf24ab-e858-4b5c-91c2-f1d387165cef None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:54.014833 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf24ab-e858-4b5c-91c2-f1d387165cef None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:54.016306 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 667/1344] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:38:54.022368 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35969e-de5f-4314-9dcc-aeacfd80c0c5 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:54.023231 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35969e-de5f-4314-9dcc-aeacfd80c0c5 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:54.023568 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35969e-de5f-4314-9dcc-aeacfd80c0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:54.099888 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2e35969e-de5f-4314-9dcc-aeacfd80c0c5 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:38:54.101151 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2e35969e-de5f-4314-9dcc-aeacfd80c0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:54.121845 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:38:54.221146 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 678/1345] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:38:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:38:54.504238 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf24ab-e858-4b5c-91c2-f1d387165cef None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:38:54.505784 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-12bf24ab-e858-4b5c-91c2-f1d387165cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:54.637337 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf24ab-e858-4b5c-91c2-f1d387165cef None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:38:54.753106 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cf364-c713-4909-9733-e004b5fc9f0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:38:54.754628 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cf364-c713-4909-9733-e004b5fc9f0d service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:54.755103 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cf364-c713-4909-9733-e004b5fc9f0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:54.755624 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cf364-c713-4909-9733-e004b5fc9f0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:54.758759 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-8f7cf364-c713-4909-9733-e004b5fc9f0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:54.835032 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:38:54.914534 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7cf364-c713-4909-9733-e004b5fc9f0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:38:54.916243 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7cf364-c713-4909-9733-e004b5fc9f0d service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:38:54.937522 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 668/1346] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:38:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:38:59.572205 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf71f4-8677-45ec-96e9-57128b3f9caf None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:59.573181 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf71f4-8677-45ec-96e9-57128b3f9caf None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:59.573762 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf71f4-8677-45ec-96e9-57128b3f9caf None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:59.576362 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 679/1347] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:38:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:38:59.582925 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d585aa-3243-48dc-b8ef-93a710af9ecf None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:38:59.583685 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d585aa-3243-48dc-b8ef-93a710af9ecf None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:38:59.583685 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d585aa-3243-48dc-b8ef-93a710af9ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:38:59.667645 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-67d585aa-3243-48dc-b8ef-93a710af9ecf None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:38:59.671080 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-67d585aa-3243-48dc-b8ef-93a710af9ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:38:59.802367 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:38:59.811333 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 669/1348] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:38:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:39:00.122219 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf71f4-8677-45ec-96e9-57128b3f9caf None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:39:00.124732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2bbf71f4-8677-45ec-96e9-57128b3f9caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:00.250230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf71f4-8677-45ec-96e9-57128b3f9caf None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:39:00.301913 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:00.327736 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1dfba-45ac-419e-be6c-34ea455a76ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:39:00.328346 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1dfba-45ac-419e-be6c-34ea455a76ed service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:00.328627 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1dfba-45ac-419e-be6c-34ea455a76ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:00.328901 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1dfba-45ac-419e-be6c-34ea455a76ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:00.330498 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-49f1dfba-45ac-419e-be6c-34ea455a76ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:00.442847 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f1dfba-45ac-419e-be6c-34ea455a76ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:39:00.444353 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f1dfba-45ac-419e-be6c-34ea455a76ed service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:39:00.467628 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 680/1349] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:39:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:39:05.578963 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af5da1-de31-4da6-a936-186183812d06 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:05.579563 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af5da1-de31-4da6-a936-186183812d06 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:05.584565 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af5da1-de31-4da6-a936-186183812d06 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:05.586449 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 670/1350] 10.222.0.26 () {54 vars in 921 bytes} [Sun Sep 11 08:39:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:39:05.597290 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feaaa22-4a72-4482-9fd9-6a789d94e7ea None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:05.597779 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feaaa22-4a72-4482-9fd9-6a789d94e7ea None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:05.597990 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feaaa22-4a72-4482-9fd9-6a789d94e7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:05.723061 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-5feaaa22-4a72-4482-9fd9-6a789d94e7ea None None] MFA Rules not processed for user `a48c49f7a9f44cef89dd024fecea422f`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:39:05.724556 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5feaaa22-4a72-4482-9fd9-6a789d94e7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:05.751106 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:05.879438 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 681/1351] 10.222.0.26 () {58 vars in 1018 bytes} [Sun Sep 11 08:39:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:39:11.021764 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c5876-f356-4f6c-a1c8-6eda1ff8bac6 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:11.022826 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c5876-f356-4f6c-a1c8-6eda1ff8bac6 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:11.022826 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c5876-f356-4f6c-a1c8-6eda1ff8bac6 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:11.025467 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 671/1352] 10.222.0.26 () {54 vars in 921 bytes} [Sun Sep 11 08:39:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:39:11.035183 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd23eed-7c4a-48a9-b945-5a0056fa14ef None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:11.036911 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd23eed-7c4a-48a9-b945-5a0056fa14ef None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:11.037734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd23eed-7c4a-48a9-b945-5a0056fa14ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:11.156010 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-ddd23eed-7c4a-48a9-b945-5a0056fa14ef None None] MFA Rules not processed for user `a48c49f7a9f44cef89dd024fecea422f`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:39:11.157246 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ddd23eed-7c4a-48a9-b945-5a0056fa14ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:11.251602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:11.297596 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 682/1353] 10.222.0.26 () {58 vars in 1018 bytes} [Sun Sep 11 08:39:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:39:12.626088 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c816ec-a3e2-4473-af4f-4a3219ee08c4 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:12.626912 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c816ec-a3e2-4473-af4f-4a3219ee08c4 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:12.627123 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c816ec-a3e2-4473-af4f-4a3219ee08c4 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:12.629365 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 672/1354] 10.222.0.26 () {54 vars in 921 bytes} [Sun Sep 11 08:39:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:39:12.637274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185e7c0-4a04-456e-a26e-de49627cc1a7 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:12.638078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185e7c0-4a04-456e-a26e-de49627cc1a7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:12.638239 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185e7c0-4a04-456e-a26e-de49627cc1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:12.740978 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-6185e7c0-4a04-456e-a26e-de49627cc1a7 None None] MFA Rules not processed for user `a48c49f7a9f44cef89dd024fecea422f`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:39:12.742350 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6185e7c0-4a04-456e-a26e-de49627cc1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:12.867980 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 683/1355] 10.222.0.26 () {58 vars in 1018 bytes} [Sun Sep 11 08:39:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:39:17.202999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec3c43-7983-43fd-9d35-a6a7879dad27 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:17.203543 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec3c43-7983-43fd-9d35-a6a7879dad27 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:17.203543 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec3c43-7983-43fd-9d35-a6a7879dad27 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:17.205307 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 673/1356] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:39:17.212809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75088b-8227-4afc-bb59-2745bd365bf9 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:17.213370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75088b-8227-4afc-bb59-2745bd365bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:17.213467 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75088b-8227-4afc-bb59-2745bd365bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:17.259192 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:17.303551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-8a75088b-8227-4afc-bb59-2745bd365bf9 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:39:17.306222 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8a75088b-8227-4afc-bb59-2745bd365bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:17.439377 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 684/1357] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:39:17.862202 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfbab2-626b-4b67-beca-4c6f0482b3b4 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:17.862839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfbab2-626b-4b67-beca-4c6f0482b3b4 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:17.864374 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfbab2-626b-4b67-beca-4c6f0482b3b4 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:17.866143 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 674/1358] 10.222.0.26 () {54 vars in 962 bytes} [Sun Sep 11 08:39:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:39:17.874014 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3c439-3c75-4b1f-bbc9-4c69a4c11a38 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:17.881207 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3c439-3c75-4b1f-bbc9-4c69a4c11a38 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:17.881207 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3c439-3c75-4b1f-bbc9-4c69a4c11a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:18.012388 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-02c3c439-3c75-4b1f-bbc9-4c69a4c11a38 None None] MFA Rules not processed for user `e62bb9d2e13649b5af239bb56001ce16`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:39:18.013736 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-02c3c439-3c75-4b1f-bbc9-4c69a4c11a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:18.075004 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:18.177687 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 685/1359] 10.222.0.26 () {58 vars in 1059 bytes} [Sun Sep 11 08:39:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:39:18.185787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cfbab2-626b-4b67-beca-4c6f0482b3b4 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:39:18.187415 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-21cfbab2-626b-4b67-beca-4c6f0482b3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:18.356344 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cfbab2-626b-4b67-beca-4c6f0482b3b4 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:39:18.443130 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:18.493508 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12163f-2ce3-4365-abcd-2712c9af5e99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:39:18.494120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12163f-2ce3-4365-abcd-2712c9af5e99 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:18.494398 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12163f-2ce3-4365-abcd-2712c9af5e99 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:18.494672 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12163f-2ce3-4365-abcd-2712c9af5e99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:18.496310 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3f12163f-2ce3-4365-abcd-2712c9af5e99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:18.605799 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12163f-2ce3-4365-abcd-2712c9af5e99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:39:18.607614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12163f-2ce3-4365-abcd-2712c9af5e99 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:39:18.630992 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 675/1360] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:39:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:39:21.132333 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21deb6cd-4ffe-4c34-813c-88bf812e9ff3 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:21.133118 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21deb6cd-4ffe-4c34-813c-88bf812e9ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:21.133118 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21deb6cd-4ffe-4c34-813c-88bf812e9ff3 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:21.134125 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 686/1361] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:39:21.141201 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab868a-5697-4f51-b7aa-d3051f0338cd None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:21.142012 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab868a-5697-4f51-b7aa-d3051f0338cd None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:21.142012 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab868a-5697-4f51-b7aa-d3051f0338cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:21.223949 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-22ab868a-5697-4f51-b7aa-d3051f0338cd None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:39:21.225222 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-22ab868a-5697-4f51-b7aa-d3051f0338cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:21.269299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:21.347300 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 676/1362] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:39:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:39:21.644313 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21deb6cd-4ffe-4c34-813c-88bf812e9ff3 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:39:21.647076 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-21deb6cd-4ffe-4c34-813c-88bf812e9ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:21.849794 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21deb6cd-4ffe-4c34-813c-88bf812e9ff3 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:39:21.861378 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:21.998273 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179fdc9-5c9a-47f6-aef3-0594c20d87d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:39:21.999710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179fdc9-5c9a-47f6-aef3-0594c20d87d4 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:22.000143 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179fdc9-5c9a-47f6-aef3-0594c20d87d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:22.000601 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179fdc9-5c9a-47f6-aef3-0594c20d87d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:22.003394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3179fdc9-5c9a-47f6-aef3-0594c20d87d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:22.129648 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179fdc9-5c9a-47f6-aef3-0594c20d87d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:39:22.132258 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179fdc9-5c9a-47f6-aef3-0594c20d87d4 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:39:22.162662 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 687/1363] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:39:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:39:25.246899 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab646b6-dfa0-4d27-a47e-ad2546fd9586 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:25.247761 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab646b6-dfa0-4d27-a47e-ad2546fd9586 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:25.247761 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab646b6-dfa0-4d27-a47e-ad2546fd9586 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:25.249218 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 677/1364] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:39:25.255619 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d70d2e-dd84-4050-a7e0-18e7cf83e7e2 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:25.256228 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d70d2e-dd84-4050-a7e0-18e7cf83e7e2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:25.256228 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d70d2e-dd84-4050-a7e0-18e7cf83e7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:25.272399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:25.333765 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-13d70d2e-dd84-4050-a7e0-18e7cf83e7e2 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:39:25.334987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-13d70d2e-dd84-4050-a7e0-18e7cf83e7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:25.453641 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 688/1365] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:39:25.753997 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeaa669-6361-4977-a167-30e4c6d006c2 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:25.754275 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeaa669-6361-4977-a167-30e4c6d006c2 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:25.754745 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeaa669-6361-4977-a167-30e4c6d006c2 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:25.756216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 678/1366] 10.222.0.26 () {54 vars in 962 bytes} [Sun Sep 11 08:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:39:25.769708 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287d4a2-ed75-4969-9817-b54143415278 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:25.770178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287d4a2-ed75-4969-9817-b54143415278 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:25.770437 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287d4a2-ed75-4969-9817-b54143415278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:25.844477 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901180a-11bf-4b5a-bbdc-0dc636277738 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:25.844817 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901180a-11bf-4b5a-bbdc-0dc636277738 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:25.845100 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901180a-11bf-4b5a-bbdc-0dc636277738 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:25.847155 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 679/1367] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:39:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:39:25.854699 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84dadca-4039-4151-a5e9-543aacef3347 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:25.855009 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84dadca-4039-4151-a5e9-543aacef3347 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:25.855652 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84dadca-4039-4151-a5e9-543aacef3347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:25.879193 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-7287d4a2-ed75-4969-9817-b54143415278 None None] MFA Rules not processed for user `e62bb9d2e13649b5af239bb56001ce16`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:39:25.880517 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7287d4a2-ed75-4969-9817-b54143415278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:25.930776 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:25.948328 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-f84dadca-4039-4151-a5e9-543aacef3347 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:39:25.949966 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f84dadca-4039-4151-a5e9-543aacef3347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:26.067054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 680/1368] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:39:26.077629 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 689/1369] 10.222.0.26 () {58 vars in 1059 bytes} [Sun Sep 11 08:39:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:39:26.087111 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84dadca-4039-4151-a5e9-543aacef3347 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:39:26.088445 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f84dadca-4039-4151-a5e9-543aacef3347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:26.114993 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:26.263651 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84dadca-4039-4151-a5e9-543aacef3347 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:39:26.456676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15747dde-1740-42e2-8b1f-b2e9f1e7fbeb None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:26.457302 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15747dde-1740-42e2-8b1f-b2e9f1e7fbeb None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:26.457882 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15747dde-1740-42e2-8b1f-b2e9f1e7fbeb None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:26.461125 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 690/1370] 10.222.0.26 () {54 vars in 964 bytes} [Sun Sep 11 08:39:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:39:26.468968 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f031074-e775-4c1a-a73d-5e5b7a2662e8 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:26.469248 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f031074-e775-4c1a-a73d-5e5b7a2662e8 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:26.469523 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f031074-e775-4c1a-a73d-5e5b7a2662e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:26.486633 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb026f54-58ac-48b5-be18-eacc153ec47b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:39:26.488141 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb026f54-58ac-48b5-be18-eacc153ec47b service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:26.488976 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb026f54-58ac-48b5-be18-eacc153ec47b service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:26.489594 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb026f54-58ac-48b5-be18-eacc153ec47b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:26.493008 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-eb026f54-58ac-48b5-be18-eacc153ec47b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:26.515759 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:26.566163 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-9f031074-e775-4c1a-a73d-5e5b7a2662e8 None None] MFA Rules not processed for user `211fa4ad83be44cd8164e0e47278273a`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:39:26.567439 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9f031074-e775-4c1a-a73d-5e5b7a2662e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:26.626991 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb026f54-58ac-48b5-be18-eacc153ec47b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:39:26.628930 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb026f54-58ac-48b5-be18-eacc153ec47b service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:39:26.659011 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 681/1371] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:39:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:39:26.679745 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 691/1372] 10.222.0.26 () {58 vars in 1061 bytes} [Sun Sep 11 08:39:26 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:39:26.688940 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb026f54-58ac-48b5-be18-eacc153ec47b service nova] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:39:26.690430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-eb026f54-58ac-48b5-be18-eacc153ec47b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:26.799503 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb026f54-58ac-48b5-be18-eacc153ec47b service nova] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:39:26.887400 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:26.900010 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a5fb1-2f34-42db-96e6-e8cfd2156fe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:39:26.900847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a5fb1-2f34-42db-96e6-e8cfd2156fe5 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:26.901216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a5fb1-2f34-42db-96e6-e8cfd2156fe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:26.901576 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a5fb1-2f34-42db-96e6-e8cfd2156fe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:26.903449 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-0a1a5fb1-2f34-42db-96e6-e8cfd2156fe5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:27.085625 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a5fb1-2f34-42db-96e6-e8cfd2156fe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:39:27.087512 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a5fb1-2f34-42db-96e6-e8cfd2156fe5 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:39:27.111062 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 682/1373] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:39:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:39:29.174882 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa2b0a-179e-46bd-b43a-eaa78b4c0acc None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:29.175496 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa2b0a-179e-46bd-b43a-eaa78b4c0acc None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:29.175496 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa2b0a-179e-46bd-b43a-eaa78b4c0acc None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:29.176556 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 692/1374] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:39:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:39:29.182512 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc05938-d461-438c-8391-92f647173fb5 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:29.183188 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc05938-d461-438c-8391-92f647173fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:29.183188 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc05938-d461-438c-8391-92f647173fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:29.270859 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-1fc05938-d461-438c-8391-92f647173fb5 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:39:29.272183 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1fc05938-d461-438c-8391-92f647173fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:29.333572 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:29.393378 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 683/1375] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:39:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:39:29.689637 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa2b0a-179e-46bd-b43a-eaa78b4c0acc None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:39:29.691137 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-49fa2b0a-179e-46bd-b43a-eaa78b4c0acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:29.702088 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:29.886496 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa2b0a-179e-46bd-b43a-eaa78b4c0acc None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:39:29.994113 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:30.037994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a4070-7cd3-4134-ac82-dd5808b8fa96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:39:30.038600 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a4070-7cd3-4134-ac82-dd5808b8fa96 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:30.038877 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a4070-7cd3-4134-ac82-dd5808b8fa96 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:30.039151 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a4070-7cd3-4134-ac82-dd5808b8fa96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:30.040812 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e09a4070-7cd3-4134-ac82-dd5808b8fa96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:30.181144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a4070-7cd3-4134-ac82-dd5808b8fa96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:39:30.182762 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a4070-7cd3-4134-ac82-dd5808b8fa96 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:39:30.204534 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 693/1376] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:39:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:39:32.788502 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db040e73-cd84-408a-84f1-a43ffbb9ffcf None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:32.789062 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db040e73-cd84-408a-84f1-a43ffbb9ffcf None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:32.789062 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db040e73-cd84-408a-84f1-a43ffbb9ffcf None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:32.790697 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 684/1377] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:39:32.796319 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a178367-11b8-4ff9-8394-ff14efbc4591 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:32.797161 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a178367-11b8-4ff9-8394-ff14efbc4591 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:32.797161 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a178367-11b8-4ff9-8394-ff14efbc4591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:32.882373 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-0a178367-11b8-4ff9-8394-ff14efbc4591 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:39:32.883910 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0a178367-11b8-4ff9-8394-ff14efbc4591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:32.933446 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:32.995291 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 694/1378] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:39:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:39:33.291030 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db040e73-cd84-408a-84f1-a43ffbb9ffcf None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:39:33.292560 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-db040e73-cd84-408a-84f1-a43ffbb9ffcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:33.485103 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db040e73-cd84-408a-84f1-a43ffbb9ffcf None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:39:33.530870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:33.637849 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0eb336-af2f-4913-8f44-5dad672d9177 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:39:33.638479 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0eb336-af2f-4913-8f44-5dad672d9177 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:33.638751 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0eb336-af2f-4913-8f44-5dad672d9177 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:33.639415 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0eb336-af2f-4913-8f44-5dad672d9177 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:33.640644 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ed0eb336-af2f-4913-8f44-5dad672d9177 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:33.770343 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0eb336-af2f-4913-8f44-5dad672d9177 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:39:33.772159 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0eb336-af2f-4913-8f44-5dad672d9177 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:39:33.811527 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 685/1379] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:39:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:39:36.270341 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68a89a-f081-4400-b1bf-b5da36386ac2 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:36.270979 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68a89a-f081-4400-b1bf-b5da36386ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:36.271149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68a89a-f081-4400-b1bf-b5da36386ac2 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:36.272903 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 695/1380] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:39:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:39:36.279691 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad289a-00cb-4c9e-b132-4a5c914c5af6 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:36.280189 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad289a-00cb-4c9e-b132-4a5c914c5af6 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:36.280338 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad289a-00cb-4c9e-b132-4a5c914c5af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:36.335649 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:36.364493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-45ad289a-00cb-4c9e-b132-4a5c914c5af6 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:39:36.365777 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-45ad289a-00cb-4c9e-b132-4a5c914c5af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:36.516152 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 686/1381] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:39:36.935151 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68a89a-f081-4400-b1bf-b5da36386ac2 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:39:36.937440 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8f68a89a-f081-4400-b1bf-b5da36386ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:37.131681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68a89a-f081-4400-b1bf-b5da36386ac2 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:39:37.172077 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:37.294357 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77966014-7fc1-4fad-a632-9f00d942d12d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:39:37.295195 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77966014-7fc1-4fad-a632-9f00d942d12d service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:37.295716 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77966014-7fc1-4fad-a632-9f00d942d12d service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:37.295997 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77966014-7fc1-4fad-a632-9f00d942d12d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:37.298299 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-77966014-7fc1-4fad-a632-9f00d942d12d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:37.434455 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77966014-7fc1-4fad-a632-9f00d942d12d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:39:37.436121 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77966014-7fc1-4fad-a632-9f00d942d12d service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:39:37.466708 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 696/1382] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:39:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:39:40.024852 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe0c61-ab55-4778-bac6-f20789c7997f None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:40.025458 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe0c61-ab55-4778-bac6-f20789c7997f None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:40.025894 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe0c61-ab55-4778-bac6-f20789c7997f None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:40.028656 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 687/1383] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:39:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:39:40.037684 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fbec6-2b62-4c96-8eb2-ed0a00d00e1f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:40.038541 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fbec6-2b62-4c96-8eb2-ed0a00d00e1f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:40.038541 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fbec6-2b62-4c96-8eb2-ed0a00d00e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:40.083598 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:40.130126 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-d10fbec6-2b62-4c96-8eb2-ed0a00d00e1f None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:39:40.132669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d10fbec6-2b62-4c96-8eb2-ed0a00d00e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:40.278253 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 697/1384] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:39:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:39:40.727191 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe0c61-ab55-4778-bac6-f20789c7997f None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:39:40.728810 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-59fe0c61-ab55-4778-bac6-f20789c7997f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:40.861319 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:40.901120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe0c61-ab55-4778-bac6-f20789c7997f None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:39:41.053419 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006050e-0ec0-409a-b95d-fed73da43d91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:39:41.054447 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006050e-0ec0-409a-b95d-fed73da43d91 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:41.054447 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006050e-0ec0-409a-b95d-fed73da43d91 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:41.054700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006050e-0ec0-409a-b95d-fed73da43d91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:41.056307 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b006050e-0ec0-409a-b95d-fed73da43d91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:41.150301 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:41.164727 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006050e-0ec0-409a-b95d-fed73da43d91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:39:41.166339 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006050e-0ec0-409a-b95d-fed73da43d91 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:39:41.187690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 688/1385] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:39:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:39:43.612041 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd36876-056b-407e-af5f-156084c24bae None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:43.612652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd36876-056b-407e-af5f-156084c24bae None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:43.612652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd36876-056b-407e-af5f-156084c24bae None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:43.613942 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 698/1386] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:39:43.619629 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be839f-38d5-4c48-a0d5-ff38236c9fef None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:43.620145 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be839f-38d5-4c48-a0d5-ff38236c9fef None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:43.620252 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be839f-38d5-4c48-a0d5-ff38236c9fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:43.705794 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-13be839f-38d5-4c48-a0d5-ff38236c9fef None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:39:43.706898 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-13be839f-38d5-4c48-a0d5-ff38236c9fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:43.821542 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 689/1387] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:39:44.146698 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e27f3-521a-4aa5-8b3b-26155fd2ecac None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:44.147081 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e27f3-521a-4aa5-8b3b-26155fd2ecac None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:44.147498 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e27f3-521a-4aa5-8b3b-26155fd2ecac None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:44.149295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 699/1388] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:39:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:39:44.152287 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b836e-5cf7-4b9d-acf8-463d5b96ff81 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:44.152693 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b836e-5cf7-4b9d-acf8-463d5b96ff81 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:44.152996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b836e-5cf7-4b9d-acf8-463d5b96ff81 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:44.154971 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 690/1389] 10.222.0.26 () {54 vars in 966 bytes} [Sun Sep 11 08:39:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:39:44.156001 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e48f00-6215-4402-9ef5-583533d41e32 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:44.156389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e48f00-6215-4402-9ef5-583533d41e32 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:44.156675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e48f00-6215-4402-9ef5-583533d41e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:44.161105 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b9657-73f3-4325-b359-755fc6673980 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:44.161394 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b9657-73f3-4325-b359-755fc6673980 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:44.161905 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b9657-73f3-4325-b359-755fc6673980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:44.232219 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f1e48f00-6215-4402-9ef5-583533d41e32 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:39:44.233881 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f1e48f00-6215-4402-9ef5-583533d41e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:44.248180 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:44.259179 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-fb4b9657-73f3-4325-b359-755fc6673980 None None] MFA Rules not processed for user `7690af0cd266458f9cdd799c98ff5bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:39:44.261240 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-fb4b9657-73f3-4325-b359-755fc6673980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:44.312771 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:44.360424 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 700/1390] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:39:44.369211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 691/1391] 10.222.0.26 () {58 vars in 1063 bytes} [Sun Sep 11 08:39:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:39:44.378590 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e48f00-6215-4402-9ef5-583533d41e32 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:39:44.379865 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f1e48f00-6215-4402-9ef5-583533d41e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:44.481052 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e48f00-6215-4402-9ef5-583533d41e32 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:39:44.564053 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed6285-59f0-4727-a2e9-002995e44cce service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7690af0cd266458f9cdd799c98ff5bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:39:44.564689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed6285-59f0-4727-a2e9-002995e44cce service glance] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:44.565013 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed6285-59f0-4727-a2e9-002995e44cce service glance] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:44.565331 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed6285-59f0-4727-a2e9-002995e44cce service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:44.567020 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-dbed6285-59f0-4727-a2e9-002995e44cce service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:44.615727 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:44.653993 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b9657-73f3-4325-b359-755fc6673980 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:39:44.655668 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-fb4b9657-73f3-4325-b359-755fc6673980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:44.718387 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed6285-59f0-4727-a2e9-002995e44cce service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:39:44.721030 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed6285-59f0-4727-a2e9-002995e44cce service glance] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:39:44.744107 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 701/1392] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:39:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:39:44.822849 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b9657-73f3-4325-b359-755fc6673980 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:39:44.867018 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:44.966183 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a715806-71f4-4df0-b20a-425fbd7c1617 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:39:44.966807 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a715806-71f4-4df0-b20a-425fbd7c1617 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:44.967090 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a715806-71f4-4df0-b20a-425fbd7c1617 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:44.967397 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a715806-71f4-4df0-b20a-425fbd7c1617 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:44.969007 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7a715806-71f4-4df0-b20a-425fbd7c1617 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:45.098910 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a715806-71f4-4df0-b20a-425fbd7c1617 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:39:45.101251 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a715806-71f4-4df0-b20a-425fbd7c1617 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:39:45.128642 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 692/1393] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:39:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:39:45.805639 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45247ce0-7820-46d1-bee0-4a0c7f888d78 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:45.806215 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45247ce0-7820-46d1-bee0-4a0c7f888d78 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:45.806215 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45247ce0-7820-46d1-bee0-4a0c7f888d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:45.884534 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-45247ce0-7820-46d1-bee0-4a0c7f888d78 None None] MFA Rules not processed for user `84fcccb19a5e43ac9da5d7ca501563e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:39:45.885638 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-45247ce0-7820-46d1-bee0-4a0c7f888d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:45.989445 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:45.993332 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 702/1394] 10.222.0.26 () {58 vars in 1009 bytes} [Sun Sep 11 08:39:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:39:46.044823 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832201e-d142-49d5-81a2-ce86954e8682 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:46.045373 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832201e-d142-49d5-81a2-ce86954e8682 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:46.045373 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832201e-d142-49d5-81a2-ce86954e8682 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:46.046784 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 693/1395] 10.222.0.26 () {54 vars in 943 bytes} [Sun Sep 11 08:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:39:46.055043 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee4d9c-32b0-4bc2-8505-834d08e83050 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:46.055377 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee4d9c-32b0-4bc2-8505-834d08e83050 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:46.055659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee4d9c-32b0-4bc2-8505-834d08e83050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:46.153547 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2aee4d9c-32b0-4bc2-8505-834d08e83050 None None] MFA Rules not processed for user `d1a4f25df9724d34afdd6a41e719546a`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:39:46.154758 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2aee4d9c-32b0-4bc2-8505-834d08e83050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:46.316199 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 703/1396] 10.222.0.26 () {58 vars in 1040 bytes} [Sun Sep 11 08:39:46 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:39:46.328787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832201e-d142-49d5-81a2-ce86954e8682 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:39:46.330690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b832201e-d142-49d5-81a2-ce86954e8682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:46.395539 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:46.519190 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832201e-d142-49d5-81a2-ce86954e8682 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:39:46.667058 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f9be8-889e-4e90-91b6-f37a70c1ab3d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a4f25df9724d34afdd6a41e719546a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:39:46.668002 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f9be8-889e-4e90-91b6-f37a70c1ab3d service swift] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:46.668426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f9be8-889e-4e90-91b6-f37a70c1ab3d service swift] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:46.668844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f9be8-889e-4e90-91b6-f37a70c1ab3d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:46.671791 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-427f9be8-889e-4e90-91b6-f37a70c1ab3d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:46.702536 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:46.779406 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f9be8-889e-4e90-91b6-f37a70c1ab3d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:39:46.780933 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f9be8-889e-4e90-91b6-f37a70c1ab3d service swift] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:39:46.790369 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 694/1397] 10.222.0.26 () {60 vars in 1384 bytes} [Sun Sep 11 08:39:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 08:39:47.537336 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9273676-8102-4e66-b89d-fd3676bc317e None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:47.537962 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9273676-8102-4e66-b89d-fd3676bc317e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:47.537962 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9273676-8102-4e66-b89d-fd3676bc317e None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:47.539235 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 704/1398] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:39:47.544927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae30c6-4bac-4201-82c3-9b6efb53a521 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:47.545376 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae30c6-4bac-4201-82c3-9b6efb53a521 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:47.545480 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae30c6-4bac-4201-82c3-9b6efb53a521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:47.628456 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-7eae30c6-4bac-4201-82c3-9b6efb53a521 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:39:47.629693 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7eae30c6-4bac-4201-82c3-9b6efb53a521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:47.794644 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 695/1399] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:39:48.098458 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9273676-8102-4e66-b89d-fd3676bc317e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:39:48.100041 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d9273676-8102-4e66-b89d-fd3676bc317e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:48.191726 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:48.312672 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9273676-8102-4e66-b89d-fd3676bc317e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:39:48.498038 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa43df3-3a64-4135-9a03-fbf692926c77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:39:48.498776 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa43df3-3a64-4135-9a03-fbf692926c77 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:48.499132 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa43df3-3a64-4135-9a03-fbf692926c77 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:48.499501 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa43df3-3a64-4135-9a03-fbf692926c77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:48.501806 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7fa43df3-3a64-4135-9a03-fbf692926c77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:48.528924 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:48.629519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa43df3-3a64-4135-9a03-fbf692926c77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:39:48.631148 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa43df3-3a64-4135-9a03-fbf692926c77 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:39:48.651834 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 705/1400] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:39:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:39:51.180469 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1155807-3739-4d85-87c7-a96056a275b0 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:51.181360 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1155807-3739-4d85-87c7-a96056a275b0 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:51.181360 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1155807-3739-4d85-87c7-a96056a275b0 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:51.183553 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 696/1401] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:39:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:39:51.187979 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d11d9-0e2e-401f-87fe-214319cedb3c None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:51.208594 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d11d9-0e2e-401f-87fe-214319cedb3c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:51.208594 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d11d9-0e2e-401f-87fe-214319cedb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:51.271080 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-d57d11d9-0e2e-401f-87fe-214319cedb3c None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:39:51.272360 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d57d11d9-0e2e-401f-87fe-214319cedb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:51.399003 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:51.409885 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 706/1402] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:39:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:39:51.710267 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1155807-3739-4d85-87c7-a96056a275b0 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:39:51.711790 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e1155807-3739-4d85-87c7-a96056a275b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:51.734735 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:51.949235 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1155807-3739-4d85-87c7-a96056a275b0 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:39:52.086205 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:52.120870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401a166-db43-449e-a072-885445df33db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:39:52.121627 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401a166-db43-449e-a072-885445df33db service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:52.122010 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401a166-db43-449e-a072-885445df33db service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:52.122292 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401a166-db43-449e-a072-885445df33db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:52.124025 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1401a166-db43-449e-a072-885445df33db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:52.260830 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401a166-db43-449e-a072-885445df33db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:39:52.262498 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401a166-db43-449e-a072-885445df33db service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:39:52.298777 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 697/1403] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:39:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:39:54.797334 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6abf7e-aace-4162-8dc3-cb1196c39ec6 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:54.797334 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6abf7e-aace-4162-8dc3-cb1196c39ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:54.797334 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6abf7e-aace-4162-8dc3-cb1196c39ec6 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:54.800308 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 707/1404] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:39:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:39:54.804713 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9bcee-c703-4c8e-9149-377f6bc53373 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:54.805600 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9bcee-c703-4c8e-9149-377f6bc53373 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:54.805600 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9bcee-c703-4c8e-9149-377f6bc53373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:54.910211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-b7b9bcee-c703-4c8e-9149-377f6bc53373 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:39:54.912845 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b7b9bcee-c703-4c8e-9149-377f6bc53373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:55.008328 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:55.082232 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 698/1405] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:39:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:39:55.386615 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6abf7e-aace-4162-8dc3-cb1196c39ec6 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:39:55.388640 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0d6abf7e-aace-4162-8dc3-cb1196c39ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:55.655526 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6abf7e-aace-4162-8dc3-cb1196c39ec6 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:39:55.777850 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:55.834471 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cffc7d-1504-42ab-ae59-5d6375296326 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:39:55.835229 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cffc7d-1504-42ab-ae59-5d6375296326 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:55.835461 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cffc7d-1504-42ab-ae59-5d6375296326 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:55.835667 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cffc7d-1504-42ab-ae59-5d6375296326 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:55.837440 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b3cffc7d-1504-42ab-ae59-5d6375296326 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:55.993406 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cffc7d-1504-42ab-ae59-5d6375296326 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:39:55.995673 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cffc7d-1504-42ab-ae59-5d6375296326 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:39:56.019123 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 708/1406] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:39:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:39:58.754630 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbae9e-d043-4ee2-a884-09a5b937e494 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:58.755548 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbae9e-d043-4ee2-a884-09a5b937e494 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:58.755548 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbae9e-d043-4ee2-a884-09a5b937e494 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:58.756818 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 699/1407] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:39:58.762459 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38344e-05e8-4ecd-a1e6-2e46566576c0 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:58.763349 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38344e-05e8-4ecd-a1e6-2e46566576c0 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:58.763349 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38344e-05e8-4ecd-a1e6-2e46566576c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:58.849050 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-7f38344e-05e8-4ecd-a1e6-2e46566576c0 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:39:58.850322 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7f38344e-05e8-4ecd-a1e6-2e46566576c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:58.895040 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:59.002049 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 709/1408] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:39:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:39:59.323747 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bbae9e-d043-4ee2-a884-09a5b937e494 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:39:59.325274 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f0bbae9e-d043-4ee2-a884-09a5b937e494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:59.564093 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bbae9e-d043-4ee2-a884-09a5b937e494 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:39:59.611583 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:59.726139 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b697aa9-fa97-41c6-a37e-57b3df703be6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:39:59.726760 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b697aa9-fa97-41c6-a37e-57b3df703be6 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:39:59.727045 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b697aa9-fa97-41c6-a37e-57b3df703be6 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:39:59.727366 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b697aa9-fa97-41c6-a37e-57b3df703be6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:39:59.729689 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2b697aa9-fa97-41c6-a37e-57b3df703be6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:39:59.846462 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b697aa9-fa97-41c6-a37e-57b3df703be6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:39:59.848154 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b697aa9-fa97-41c6-a37e-57b3df703be6 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:39:59.871918 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 700/1409] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:39:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:40:08.998024 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=29 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:09.869194 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=83 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:12.094421 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acccbcc-b03f-4c38-a86a-2008d5f8fddc None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:12.095488 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acccbcc-b03f-4c38-a86a-2008d5f8fddc None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:12.095488 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acccbcc-b03f-4c38-a86a-2008d5f8fddc None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:12.096388 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 710/1410] 10.222.0.26 () {54 vars in 918 bytes} [Sun Sep 11 08:40:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:40:12.104206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea0c64-dc0b-4428-b522-39ac961d0aaa None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:12.104780 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea0c64-dc0b-4428-b522-39ac961d0aaa None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:12.104780 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea0c64-dc0b-4428-b522-39ac961d0aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:12.193453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-47ea0c64-dc0b-4428-b522-39ac961d0aaa None None] MFA Rules not processed for user `a48c49f7a9f44cef89dd024fecea422f`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:40:12.198375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-47ea0c64-dc0b-4428-b522-39ac961d0aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:12.337891 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 701/1411] 10.222.0.26 () {58 vars in 1015 bytes} [Sun Sep 11 08:40:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:40:12.359715 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0703779-f063-41e6-8a9f-947a2fd4d6bf None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:12.360047 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0703779-f063-41e6-8a9f-947a2fd4d6bf None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:12.360315 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0703779-f063-41e6-8a9f-947a2fd4d6bf None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:12.362700 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 711/1412] 10.222.0.26 () {54 vars in 918 bytes} [Sun Sep 11 08:40:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:40:12.372187 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6855bc-84f5-407a-9756-5aa3bd58d5aa None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:12.372615 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6855bc-84f5-407a-9756-5aa3bd58d5aa None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:12.372988 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6855bc-84f5-407a-9756-5aa3bd58d5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:12.474172 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:12.481226 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-ee6855bc-84f5-407a-9756-5aa3bd58d5aa None None] MFA Rules not processed for user `e62bb9d2e13649b5af239bb56001ce16`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:40:12.483393 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ee6855bc-84f5-407a-9756-5aa3bd58d5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:12.645357 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 702/1413] 10.222.0.26 () {58 vars in 1015 bytes} [Sun Sep 11 08:40:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:40:15.295209 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c93a2-f596-4805-899b-af5f378e3a92 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:15.295815 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c93a2-f596-4805-899b-af5f378e3a92 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:15.295815 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c93a2-f596-4805-899b-af5f378e3a92 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:15.297623 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 712/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 08:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:40:15.302939 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722982a-2070-46e1-ba06-7d59158fbddd None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:15.303394 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722982a-2070-46e1-ba06-7d59158fbddd None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:15.303538 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722982a-2070-46e1-ba06-7d59158fbddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:15.371371 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-b722982a-2070-46e1-ba06-7d59158fbddd None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:40:15.372602 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b722982a-2070-46e1-ba06-7d59158fbddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:15.429214 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:15.479050 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 703/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 08:40:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:40:15.767206 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c93a2-f596-4805-899b-af5f378e3a92 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:40:15.768802 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-015c93a2-f596-4805-899b-af5f378e3a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:15.917874 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c93a2-f596-4805-899b-af5f378e3a92 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:40:15.993079 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:16.035000 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ddb2c6-9298-46c5-a389-d7e3b1144f7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:40:16.035640 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddb2c6-9298-46c5-a389-d7e3b1144f7c service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:16.035920 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddb2c6-9298-46c5-a389-d7e3b1144f7c service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:16.036190 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddb2c6-9298-46c5-a389-d7e3b1144f7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:16.037819 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-16ddb2c6-9298-46c5-a389-d7e3b1144f7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:16.126660 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ddb2c6-9298-46c5-a389-d7e3b1144f7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:40:16.128313 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ddb2c6-9298-46c5-a389-d7e3b1144f7c service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:40:16.146584 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 713/1416] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:40:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:40:17.308640 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbc4ca-84e0-44d8-8d17-518f1e361934 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:17.309183 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbc4ca-84e0-44d8-8d17-518f1e361934 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:17.309183 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbc4ca-84e0-44d8-8d17-518f1e361934 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:17.310602 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 704/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 08:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:40:17.317177 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614dc6a0-2c01-4691-b625-c1c4a0c899e7 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:17.317775 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614dc6a0-2c01-4691-b625-c1c4a0c899e7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:17.317775 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614dc6a0-2c01-4691-b625-c1c4a0c899e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:17.400402 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-614dc6a0-2c01-4691-b625-c1c4a0c899e7 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:40:17.401540 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-614dc6a0-2c01-4691-b625-c1c4a0c899e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:17.429430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:17.501666 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 714/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 08:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:40:17.652553 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbc4ca-84e0-44d8-8d17-518f1e361934 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:40:17.653917 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-17bbc4ca-84e0-44d8-8d17-518f1e361934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:17.809959 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbc4ca-84e0-44d8-8d17-518f1e361934 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:40:17.858690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:17.934104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f517ae-95f2-4d47-aa10-23647ba68df0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:40:17.934620 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f517ae-95f2-4d47-aa10-23647ba68df0 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:17.934900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f517ae-95f2-4d47-aa10-23647ba68df0 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:17.935172 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f517ae-95f2-4d47-aa10-23647ba68df0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:17.936824 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f5f517ae-95f2-4d47-aa10-23647ba68df0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:18.029602 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f517ae-95f2-4d47-aa10-23647ba68df0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:40:18.031337 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f517ae-95f2-4d47-aa10-23647ba68df0 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:40:18.052388 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 705/1419] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:40:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:40:19.226062 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1c2f5-7d43-4c78-bbf8-d54da1f78e43 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:19.226625 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1c2f5-7d43-4c78-bbf8-d54da1f78e43 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:19.226625 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1c2f5-7d43-4c78-bbf8-d54da1f78e43 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:19.227991 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 715/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 08:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:40:19.234381 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf1670-08ab-4253-a496-5605c949f676 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:19.234828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf1670-08ab-4253-a496-5605c949f676 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:19.234924 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf1670-08ab-4253-a496-5605c949f676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:19.289365 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:19.310858 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-1fbf1670-08ab-4253-a496-5605c949f676 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:40:19.312658 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1fbf1670-08ab-4253-a496-5605c949f676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:19.408988 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 706/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 08:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:40:19.563583 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1c2f5-7d43-4c78-bbf8-d54da1f78e43 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:40:19.565045 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-26a1c2f5-7d43-4c78-bbf8-d54da1f78e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:19.711342 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1c2f5-7d43-4c78-bbf8-d54da1f78e43 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:40:19.723566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:19.832298 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069235d-39e8-4cb2-bf84-23b66f2c542a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:40:19.833074 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069235d-39e8-4cb2-bf84-23b66f2c542a service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:19.833356 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069235d-39e8-4cb2-bf84-23b66f2c542a service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:19.833630 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069235d-39e8-4cb2-bf84-23b66f2c542a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:19.835242 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3069235d-39e8-4cb2-bf84-23b66f2c542a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:19.932282 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069235d-39e8-4cb2-bf84-23b66f2c542a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:40:19.933932 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069235d-39e8-4cb2-bf84-23b66f2c542a service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:40:19.952912 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 716/1422] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:40:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:40:21.102165 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89dd50-545e-4dbd-b4c2-0144626ef1be None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:21.102746 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89dd50-545e-4dbd-b4c2-0144626ef1be None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:21.102746 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89dd50-545e-4dbd-b4c2-0144626ef1be None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:21.104093 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 707/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 08:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:40:21.111349 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d17a4a-b504-49bb-b086-45d4afd9fafc None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:21.111970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d17a4a-b504-49bb-b086-45d4afd9fafc None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:21.111970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d17a4a-b504-49bb-b086-45d4afd9fafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:21.132842 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:21.192950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f4d17a4a-b504-49bb-b086-45d4afd9fafc None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:40:21.194259 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f4d17a4a-b504-49bb-b086-45d4afd9fafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:21.306787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 717/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 08:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:40:21.458233 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89dd50-545e-4dbd-b4c2-0144626ef1be None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:40:21.459777 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ce89dd50-545e-4dbd-b4c2-0144626ef1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:21.579155 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:21.616403 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89dd50-545e-4dbd-b4c2-0144626ef1be None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:40:21.731099 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690ceec-f82e-4d24-bf9e-a8baac95029c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:40:21.731743 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690ceec-f82e-4d24-bf9e-a8baac95029c service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:21.732018 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690ceec-f82e-4d24-bf9e-a8baac95029c service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:21.732284 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690ceec-f82e-4d24-bf9e-a8baac95029c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:21.734453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5690ceec-f82e-4d24-bf9e-a8baac95029c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:21.811661 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:21.825422 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5690ceec-f82e-4d24-bf9e-a8baac95029c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:40:21.827054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5690ceec-f82e-4d24-bf9e-a8baac95029c service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:40:21.847101 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 708/1425] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:40:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:40:22.995399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f7744-056a-447b-8d69-742771917373 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:22.995974 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f7744-056a-447b-8d69-742771917373 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:22.995974 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f7744-056a-447b-8d69-742771917373 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:22.997322 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 718/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 08:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:40:23.004738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12814c4f-f3f8-4d2c-927d-0b3c24a3df56 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:23.005283 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12814c4f-f3f8-4d2c-927d-0b3c24a3df56 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:23.005283 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12814c4f-f3f8-4d2c-927d-0b3c24a3df56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:23.083839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-12814c4f-f3f8-4d2c-927d-0b3c24a3df56 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:40:23.085069 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-12814c4f-f3f8-4d2c-927d-0b3c24a3df56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:23.187736 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 709/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 08:40:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:40:23.340269 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f7744-056a-447b-8d69-742771917373 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:40:23.341729 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ae5f7744-056a-447b-8d69-742771917373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:23.428980 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:23.494473 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f7744-056a-447b-8d69-742771917373 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:40:23.607737 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73395b51-91f6-4515-947e-d98d93fd5d48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:40:23.608274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73395b51-91f6-4515-947e-d98d93fd5d48 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:23.608697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73395b51-91f6-4515-947e-d98d93fd5d48 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:23.608968 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73395b51-91f6-4515-947e-d98d93fd5d48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:23.610568 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-73395b51-91f6-4515-947e-d98d93fd5d48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:23.659706 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:23.700739 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73395b51-91f6-4515-947e-d98d93fd5d48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:40:23.702895 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73395b51-91f6-4515-947e-d98d93fd5d48 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:40:23.721857 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 719/1428] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:40:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:40:24.854516 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb75979-eb00-45eb-9bf1-49da1461792b None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:24.855063 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb75979-eb00-45eb-9bf1-49da1461792b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:24.855063 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb75979-eb00-45eb-9bf1-49da1461792b None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:24.856435 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 710/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 08:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:40:24.863819 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93662f73-0efd-42d1-a2e8-109d07bb7b4d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:24.864337 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93662f73-0efd-42d1-a2e8-109d07bb7b4d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:24.864444 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93662f73-0efd-42d1-a2e8-109d07bb7b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:24.961722 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-93662f73-0efd-42d1-a2e8-109d07bb7b4d None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:40:24.962860 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-93662f73-0efd-42d1-a2e8-109d07bb7b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:25.061862 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 720/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 08:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:40:25.213758 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb75979-eb00-45eb-9bf1-49da1461792b None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:40:25.215365 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-8fb75979-eb00-45eb-9bf1-49da1461792b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:25.285640 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:25.385274 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb75979-eb00-45eb-9bf1-49da1461792b None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:40:25.502429 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47817ad0-0381-41b4-a6c2-e01a31e004b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:40:25.503041 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47817ad0-0381-41b4-a6c2-e01a31e004b2 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:25.503358 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47817ad0-0381-41b4-a6c2-e01a31e004b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:25.503636 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47817ad0-0381-41b4-a6c2-e01a31e004b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:25.505243 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-47817ad0-0381-41b4-a6c2-e01a31e004b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:25.512278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:25.601237 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47817ad0-0381-41b4-a6c2-e01a31e004b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:40:25.602859 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47817ad0-0381-41b4-a6c2-e01a31e004b2 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:40:25.621043 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 711/1431] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:40:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:40:26.789027 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00616e46-8b5f-4a88-a09d-c8765bdd43da None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:26.789618 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00616e46-8b5f-4a88-a09d-c8765bdd43da None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:26.789618 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00616e46-8b5f-4a88-a09d-c8765bdd43da None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:26.790941 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 721/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 08:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:40:26.797968 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aeb945-928b-4b9c-bcba-75bc69860fcf None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:26.798499 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aeb945-928b-4b9c-bcba-75bc69860fcf None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:26.798499 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aeb945-928b-4b9c-bcba-75bc69860fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:26.877404 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-d1aeb945-928b-4b9c-bcba-75bc69860fcf None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:40:26.878644 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d1aeb945-928b-4b9c-bcba-75bc69860fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:26.950573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:26.980722 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 712/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 08:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:40:27.134192 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00616e46-8b5f-4a88-a09d-c8765bdd43da None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:40:27.135461 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-00616e46-8b5f-4a88-a09d-c8765bdd43da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:27.154755 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:27.283162 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00616e46-8b5f-4a88-a09d-c8765bdd43da None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:40:27.368792 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:27.393838 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae7e88-b52e-43cc-be21-fc93f28450d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:40:27.394443 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae7e88-b52e-43cc-be21-fc93f28450d7 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:27.394718 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae7e88-b52e-43cc-be21-fc93f28450d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:27.394989 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae7e88-b52e-43cc-be21-fc93f28450d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:27.396744 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-92ae7e88-b52e-43cc-be21-fc93f28450d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:27.490855 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae7e88-b52e-43cc-be21-fc93f28450d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:40:27.492540 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae7e88-b52e-43cc-be21-fc93f28450d7 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:40:27.511327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 722/1434] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:40:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:40:28.632679 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1410d8-e63a-4ddd-990f-c3155f8f04e3 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:28.633264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1410d8-e63a-4ddd-990f-c3155f8f04e3 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:28.633264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1410d8-e63a-4ddd-990f-c3155f8f04e3 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:28.634580 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 713/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 08:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:40:28.642586 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4780f8-7753-464c-819e-4e605b358938 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:28.642586 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4780f8-7753-464c-819e-4e605b358938 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:28.643224 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4780f8-7753-464c-819e-4e605b358938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:28.731675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-ee4780f8-7753-464c-819e-4e605b358938 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:40:28.732928 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ee4780f8-7753-464c-819e-4e605b358938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:28.776211 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:28.833763 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 723/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 08:40:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:40:28.986744 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1410d8-e63a-4ddd-990f-c3155f8f04e3 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:40:28.988499 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-cd1410d8-e63a-4ddd-990f-c3155f8f04e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:29.137222 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1410d8-e63a-4ddd-990f-c3155f8f04e3 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:40:29.192129 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:29.251997 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff82c72-8e3a-4a72-a45e-5d3bbbfa5425 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:40:29.252529 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff82c72-8e3a-4a72-a45e-5d3bbbfa5425 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:29.252813 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff82c72-8e3a-4a72-a45e-5d3bbbfa5425 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:29.253089 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff82c72-8e3a-4a72-a45e-5d3bbbfa5425 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:29.254714 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-cff82c72-8e3a-4a72-a45e-5d3bbbfa5425 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:29.344844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff82c72-8e3a-4a72-a45e-5d3bbbfa5425 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:40:29.346468 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff82c72-8e3a-4a72-a45e-5d3bbbfa5425 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:40:29.364848 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 714/1437] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:40:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:40:30.524668 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731ec61-db15-4125-a352-61e696f8a5a9 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:30.525258 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731ec61-db15-4125-a352-61e696f8a5a9 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:30.525258 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731ec61-db15-4125-a352-61e696f8a5a9 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:30.526587 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 724/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 08:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:40:30.533406 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f105d-d9e2-4c95-9771-f9c2945ef8d6 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:30.533940 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f105d-d9e2-4c95-9771-f9c2945ef8d6 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:30.533940 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f105d-d9e2-4c95-9771-f9c2945ef8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:30.613511 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-cf7f105d-d9e2-4c95-9771-f9c2945ef8d6 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:40:30.614727 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-cf7f105d-d9e2-4c95-9771-f9c2945ef8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:30.616931 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:30.716960 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 715/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 08:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:40:30.869732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731ec61-db15-4125-a352-61e696f8a5a9 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:40:30.871174 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d731ec61-db15-4125-a352-61e696f8a5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:31.015265 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731ec61-db15-4125-a352-61e696f8a5a9 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:40:31.041968 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:31.126457 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40649c5c-e7a5-41a7-856d-2a9ab129bc74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:40:31.126971 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40649c5c-e7a5-41a7-856d-2a9ab129bc74 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:31.127275 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40649c5c-e7a5-41a7-856d-2a9ab129bc74 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:31.127555 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40649c5c-e7a5-41a7-856d-2a9ab129bc74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:31.129159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-40649c5c-e7a5-41a7-856d-2a9ab129bc74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:31.220880 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40649c5c-e7a5-41a7-856d-2a9ab129bc74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:40:31.222495 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40649c5c-e7a5-41a7-856d-2a9ab129bc74 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:40:31.240820 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 725/1440] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:40:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:40:33.352593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd1d25-d3e8-4ddb-a864-1d3728ca76b9 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:33.353251 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd1d25-d3e8-4ddb-a864-1d3728ca76b9 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:33.353251 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd1d25-d3e8-4ddb-a864-1d3728ca76b9 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:33.354493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 716/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 08:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:40:33.360524 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ff4d8-efb8-4e93-a021-328df2606eb4 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:33.360971 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ff4d8-efb8-4e93-a021-328df2606eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:33.361117 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ff4d8-efb8-4e93-a021-328df2606eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:33.402666 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:33.428466 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-0f8ff4d8-efb8-4e93-a021-328df2606eb4 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:40:33.429686 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0f8ff4d8-efb8-4e93-a021-328df2606eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:33.527598 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 726/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 08:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:40:33.835272 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd1d25-d3e8-4ddb-a864-1d3728ca76b9 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:40:33.837065 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e4cd1d25-d3e8-4ddb-a864-1d3728ca76b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:33.945067 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd1d25-d3e8-4ddb-a864-1d3728ca76b9 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:40:33.978773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:34.030286 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2394a-0c83-4905-9eb2-6413594bb0c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:40:34.030897 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2394a-0c83-4905-9eb2-6413594bb0c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:34.031173 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2394a-0c83-4905-9eb2-6413594bb0c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:34.031473 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2394a-0c83-4905-9eb2-6413594bb0c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:34.033191 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-06a2394a-0c83-4905-9eb2-6413594bb0c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:34.145598 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a2394a-0c83-4905-9eb2-6413594bb0c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:40:34.147049 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a2394a-0c83-4905-9eb2-6413594bb0c0 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:40:34.165936 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 717/1443] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:40:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:40:36.665194 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9565a9a-6454-4a86-9f15-9c997562bbe3 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:36.665799 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9565a9a-6454-4a86-9f15-9c997562bbe3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:36.665799 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9565a9a-6454-4a86-9f15-9c997562bbe3 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:36.667143 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 727/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 08:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:40:36.673953 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d636a17-b80e-405f-bc08-28bcb1f5ece3 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:36.673953 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d636a17-b80e-405f-bc08-28bcb1f5ece3 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:36.674420 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d636a17-b80e-405f-bc08-28bcb1f5ece3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:36.743543 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-3d636a17-b80e-405f-bc08-28bcb1f5ece3 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:40:36.744775 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3d636a17-b80e-405f-bc08-28bcb1f5ece3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:36.757873 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:36.843579 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 718/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 08:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:40:37.134228 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9565a9a-6454-4a86-9f15-9c997562bbe3 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:40:37.135805 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c9565a9a-6454-4a86-9f15-9c997562bbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:37.244708 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9565a9a-6454-4a86-9f15-9c997562bbe3 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:40:37.257673 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:37.320814 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a04a9c-7c28-4885-9cf8-dcfcff1b0771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:40:37.321421 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a04a9c-7c28-4885-9cf8-dcfcff1b0771 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:37.321731 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a04a9c-7c28-4885-9cf8-dcfcff1b0771 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:37.322004 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a04a9c-7c28-4885-9cf8-dcfcff1b0771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:37.323686 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-47a04a9c-7c28-4885-9cf8-dcfcff1b0771 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:37.434488 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a04a9c-7c28-4885-9cf8-dcfcff1b0771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:40:37.436384 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a04a9c-7c28-4885-9cf8-dcfcff1b0771 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:40:37.455304 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 728/1446] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:40:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:40:39.969051 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b6d95-4e13-4984-a469-0cf5da457498 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:39.969576 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b6d95-4e13-4984-a469-0cf5da457498 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:39.969695 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b6d95-4e13-4984-a469-0cf5da457498 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:39.970974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 719/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 08:40:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:40:39.976439 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108ab5c-0eef-4d64-b425-2a1a5a18b4c4 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:39.976906 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108ab5c-0eef-4d64-b425-2a1a5a18b4c4 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:39.977011 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108ab5c-0eef-4d64-b425-2a1a5a18b4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:40.025757 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:40.046140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2108ab5c-0eef-4d64-b425-2a1a5a18b4c4 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:40:40.047413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2108ab5c-0eef-4d64-b425-2a1a5a18b4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:40.145791 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 729/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 08:40:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:40:40.440956 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b6d95-4e13-4984-a469-0cf5da457498 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:40:40.442503 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-697b6d95-4e13-4984-a469-0cf5da457498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:40.555792 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b6d95-4e13-4984-a469-0cf5da457498 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:40:40.598578 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:40.633044 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa526a3-cb4c-43f7-92fb-36edcfd11a01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:40:40.633657 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa526a3-cb4c-43f7-92fb-36edcfd11a01 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:40.633938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa526a3-cb4c-43f7-92fb-36edcfd11a01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:40.634210 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa526a3-cb4c-43f7-92fb-36edcfd11a01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:40.635853 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3aa526a3-cb4c-43f7-92fb-36edcfd11a01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:40.747676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa526a3-cb4c-43f7-92fb-36edcfd11a01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:40:40.747676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa526a3-cb4c-43f7-92fb-36edcfd11a01 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:40:40.768589 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 720/1449] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:40:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:40:43.118088 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c7729-a7f2-4442-a70d-14d241f0d10f None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:43.118934 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c7729-a7f2-4442-a70d-14d241f0d10f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:43.118934 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c7729-a7f2-4442-a70d-14d241f0d10f None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:43.120055 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 730/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 08:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:40:43.126357 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3dcc5-df6e-4780-9088-0b939a036549 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:43.126965 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3dcc5-df6e-4780-9088-0b939a036549 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:43.126965 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3dcc5-df6e-4780-9088-0b939a036549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:43.200214 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-26d3dcc5-df6e-4780-9088-0b939a036549 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:40:43.201996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-26d3dcc5-df6e-4780-9088-0b939a036549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:43.224602 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:43.304033 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 721/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 08:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:40:43.594547 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c7729-a7f2-4442-a70d-14d241f0d10f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:40:43.596224 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-992c7729-a7f2-4442-a70d-14d241f0d10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:43.707523 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c7729-a7f2-4442-a70d-14d241f0d10f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:40:43.736880 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:43.793200 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076179b-6fc2-40dd-960d-868f4855b033 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:40:43.793808 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076179b-6fc2-40dd-960d-868f4855b033 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:43.794090 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076179b-6fc2-40dd-960d-868f4855b033 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:43.794367 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076179b-6fc2-40dd-960d-868f4855b033 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:43.796513 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0076179b-6fc2-40dd-960d-868f4855b033 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:43.910034 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076179b-6fc2-40dd-960d-868f4855b033 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:40:43.911544 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076179b-6fc2-40dd-960d-868f4855b033 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:40:43.930246 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 731/1452] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:40:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:40:46.200300 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b6707-ae2f-4124-b395-1b6035e293b5 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:46.200888 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b6707-ae2f-4124-b395-1b6035e293b5 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:46.200888 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b6707-ae2f-4124-b395-1b6035e293b5 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:46.202258 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 722/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 08:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:40:46.208078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fb1db-c6ec-4ae3-9575-2344f150d1dc None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:46.208530 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fb1db-c6ec-4ae3-9575-2344f150d1dc None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:46.208625 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fb1db-c6ec-4ae3-9575-2344f150d1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:46.272659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:46.275693 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-470fb1db-c6ec-4ae3-9575-2344f150d1dc None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:40:46.276996 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-470fb1db-c6ec-4ae3-9575-2344f150d1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:46.375883 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 732/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 08:40:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:40:46.696457 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b6707-ae2f-4124-b395-1b6035e293b5 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:40:46.698045 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-147b6707-ae2f-4124-b395-1b6035e293b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:46.818656 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b6707-ae2f-4124-b395-1b6035e293b5 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:40:46.869970 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:46.894116 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055c893-3a0b-43d6-9bad-b3f1e4abc9a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:40:46.894722 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055c893-3a0b-43d6-9bad-b3f1e4abc9a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:46.895001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055c893-3a0b-43d6-9bad-b3f1e4abc9a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:46.895300 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055c893-3a0b-43d6-9bad-b3f1e4abc9a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:46.896891 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3055c893-3a0b-43d6-9bad-b3f1e4abc9a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:47.005270 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3055c893-3a0b-43d6-9bad-b3f1e4abc9a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:40:47.006741 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3055c893-3a0b-43d6-9bad-b3f1e4abc9a6 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:40:47.026147 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 723/1455] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:40:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:40:49.262259 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43ab9d-832b-4334-b887-0690dbff6f23 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:49.262831 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43ab9d-832b-4334-b887-0690dbff6f23 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:49.262831 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43ab9d-832b-4334-b887-0690dbff6f23 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:49.264726 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 733/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 08:40:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:40:49.270127 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e65ae-1b04-4227-92eb-290e6fb3057c None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:49.270578 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e65ae-1b04-4227-92eb-290e6fb3057c None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:49.270673 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e65ae-1b04-4227-92eb-290e6fb3057c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:49.338846 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-4b6e65ae-1b04-4227-92eb-290e6fb3057c None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:40:49.340162 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4b6e65ae-1b04-4227-92eb-290e6fb3057c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:49.369759 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:49.439727 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 724/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 08:40:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:40:49.722573 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43ab9d-832b-4334-b887-0690dbff6f23 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:40:49.724152 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0a43ab9d-832b-4334-b887-0690dbff6f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:49.828647 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43ab9d-832b-4334-b887-0690dbff6f23 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:40:49.858337 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:49.904073 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeef498-fc56-4d2f-a292-23955d3f2ae9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:40:49.904680 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeef498-fc56-4d2f-a292-23955d3f2ae9 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:49.904962 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeef498-fc56-4d2f-a292-23955d3f2ae9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:49.905240 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeef498-fc56-4d2f-a292-23955d3f2ae9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:49.906877 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-eeeef498-fc56-4d2f-a292-23955d3f2ae9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:50.020272 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeef498-fc56-4d2f-a292-23955d3f2ae9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:40:50.021725 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeef498-fc56-4d2f-a292-23955d3f2ae9 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:40:50.039827 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 734/1458] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:40:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:40:52.303176 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900f3cf-6447-4a8d-ad11-3a67b04da1c3 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:52.303913 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900f3cf-6447-4a8d-ad11-3a67b04da1c3 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:52.303913 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900f3cf-6447-4a8d-ad11-3a67b04da1c3 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:52.305212 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 725/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 08:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:40:52.311200 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a43075-d21b-4072-9cbe-6aa2f981a4a5 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:52.311708 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a43075-d21b-4072-9cbe-6aa2f981a4a5 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:52.311838 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a43075-d21b-4072-9cbe-6aa2f981a4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:52.379337 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-65a43075-d21b-4072-9cbe-6aa2f981a4a5 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:40:52.380858 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-65a43075-d21b-4072-9cbe-6aa2f981a4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:52.389485 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:52.477791 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 735/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 08:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:40:52.762716 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900f3cf-6447-4a8d-ad11-3a67b04da1c3 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:40:52.764817 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6900f3cf-6447-4a8d-ad11-3a67b04da1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:52.872281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900f3cf-6447-4a8d-ad11-3a67b04da1c3 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:40:52.935203 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:52.956449 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1671ebe-d727-4cb7-b34e-7cd922cc8b36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:40:52.957132 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1671ebe-d727-4cb7-b34e-7cd922cc8b36 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:52.957683 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1671ebe-d727-4cb7-b34e-7cd922cc8b36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:52.957955 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1671ebe-d727-4cb7-b34e-7cd922cc8b36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:52.959697 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e1671ebe-d727-4cb7-b34e-7cd922cc8b36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:53.070028 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1671ebe-d727-4cb7-b34e-7cd922cc8b36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:40:53.071485 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1671ebe-d727-4cb7-b34e-7cd922cc8b36 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:40:53.090456 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 726/1461] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:40:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:40:55.360501 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19319d94-6bc5-4068-a347-b2e718bf3192 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:55.361091 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19319d94-6bc5-4068-a347-b2e718bf3192 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:55.361091 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19319d94-6bc5-4068-a347-b2e718bf3192 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:55.362370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 736/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 08:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:40:55.367925 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b5ebb-f9f9-4b23-9c9c-5f4bc88f8d9e None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:55.368404 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b5ebb-f9f9-4b23-9c9c-5f4bc88f8d9e None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:55.368514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b5ebb-f9f9-4b23-9c9c-5f4bc88f8d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:55.436367 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-bb4b5ebb-f9f9-4b23-9c9c-5f4bc88f8d9e None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:40:55.437608 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-bb4b5ebb-f9f9-4b23-9c9c-5f4bc88f8d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:55.479451 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:55.541936 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 727/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 08:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:40:55.823403 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19319d94-6bc5-4068-a347-b2e718bf3192 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:40:55.824956 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-19319d94-6bc5-4068-a347-b2e718bf3192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:55.931165 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19319d94-6bc5-4068-a347-b2e718bf3192 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:40:55.970002 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:56.010590 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7baa1-ecec-4dc8-9994-288f06ca5086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:40:56.011265 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7baa1-ecec-4dc8-9994-288f06ca5086 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:56.011548 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7baa1-ecec-4dc8-9994-288f06ca5086 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:56.011817 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7baa1-ecec-4dc8-9994-288f06ca5086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:56.013524 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c9e7baa1-ecec-4dc8-9994-288f06ca5086 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:56.122063 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e7baa1-ecec-4dc8-9994-288f06ca5086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:40:56.123553 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e7baa1-ecec-4dc8-9994-288f06ca5086 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:40:56.142944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 737/1464] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:40:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:40:58.359014 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda9761-a92f-4858-8646-1b932beffac3 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:58.359622 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda9761-a92f-4858-8646-1b932beffac3 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:58.359622 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda9761-a92f-4858-8646-1b932beffac3 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:58.360949 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 728/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 08:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:40:58.366928 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26587a19-53a4-4704-bf6b-4912ba767c31 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:58.367540 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26587a19-53a4-4704-bf6b-4912ba767c31 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:58.367540 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26587a19-53a4-4704-bf6b-4912ba767c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:58.439149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-26587a19-53a4-4704-bf6b-4912ba767c31 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:40:58.439149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-26587a19-53a4-4704-bf6b-4912ba767c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:58.460758 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:58.548095 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 738/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 08:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:40:58.840577 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda9761-a92f-4858-8646-1b932beffac3 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:40:58.843046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-fdda9761-a92f-4858-8646-1b932beffac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:58.948863 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda9761-a92f-4858-8646-1b932beffac3 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:40:59.016656 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:59.023222 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7654798-af78-4f54-a285-b8332f84fadf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:40:59.023914 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7654798-af78-4f54-a285-b8332f84fadf service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:40:59.024142 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7654798-af78-4f54-a285-b8332f84fadf service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:40:59.024419 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7654798-af78-4f54-a285-b8332f84fadf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:40:59.026033 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c7654798-af78-4f54-a285-b8332f84fadf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:40:59.256335 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7654798-af78-4f54-a285-b8332f84fadf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:40:59.257765 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7654798-af78-4f54-a285-b8332f84fadf service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:40:59.276884 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 729/1467] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:40:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:41:01.503044 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25023b49-79f8-455b-899b-c17bd9d7570b None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:41:01.503751 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25023b49-79f8-455b-899b-c17bd9d7570b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:41:01.503751 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25023b49-79f8-455b-899b-c17bd9d7570b None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:41:01.505088 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 739/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 08:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:41:01.511358 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab57ae8-51fb-4daf-a3e4-78f19d26cc56 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:41:01.511923 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab57ae8-51fb-4daf-a3e4-78f19d26cc56 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:41:01.511923 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab57ae8-51fb-4daf-a3e4-78f19d26cc56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:41:01.587041 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-4ab57ae8-51fb-4daf-a3e4-78f19d26cc56 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:41:01.588318 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4ab57ae8-51fb-4daf-a3e4-78f19d26cc56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:41:01.639095 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:41:01.689512 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 730/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 08:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:41:01.976130 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25023b49-79f8-455b-899b-c17bd9d7570b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:41:01.977670 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-25023b49-79f8-455b-899b-c17bd9d7570b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:41:02.081688 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25023b49-79f8-455b-899b-c17bd9d7570b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:41:02.130283 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:41:02.155700 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de621ae7-fcaf-4a04-9af5-b3dd57aaccc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:41:02.156309 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de621ae7-fcaf-4a04-9af5-b3dd57aaccc8 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:41:02.156592 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de621ae7-fcaf-4a04-9af5-b3dd57aaccc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:41:02.156864 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de621ae7-fcaf-4a04-9af5-b3dd57aaccc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:41:02.158476 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-de621ae7-fcaf-4a04-9af5-b3dd57aaccc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:41:02.274853 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de621ae7-fcaf-4a04-9af5-b3dd57aaccc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:41:02.276293 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de621ae7-fcaf-4a04-9af5-b3dd57aaccc8 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:41:02.305215 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 740/1470] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:41:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:41:11.687869 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=22 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:41:12.302836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=66 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:41:22.754578 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3f982-d7f8-4ea4-9b23-09ea8b1e50ac None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:41:22.755145 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3f982-d7f8-4ea4-9b23-09ea8b1e50ac None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:41:22.755145 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3f982-d7f8-4ea4-9b23-09ea8b1e50ac None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:41:22.756521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 731/1471] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:41:22.762485 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6bba4-3d2b-40c8-8bb6-9cb0416db50c None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:41:22.762963 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6bba4-3d2b-40c8-8bb6-9cb0416db50c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:41:22.763069 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6bba4-3d2b-40c8-8bb6-9cb0416db50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:41:22.830828 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-1dc6bba4-3d2b-40c8-8bb6-9cb0416db50c None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:41:22.832323 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1dc6bba4-3d2b-40c8-8bb6-9cb0416db50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:41:22.952568 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 741/1472] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:41:23.249232 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2617814-709d-4a86-9a9b-668a3ff554cc None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:41:23.249524 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2617814-709d-4a86-9a9b-668a3ff554cc None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:41:23.249832 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2617814-709d-4a86-9a9b-668a3ff554cc None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:41:23.251168 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 732/1473] 10.222.0.26 () {54 vars in 966 bytes} [Sun Sep 11 08:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:41:23.256778 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44d9a7-e659-43e0-ac51-785a537584a4 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:41:23.257096 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44d9a7-e659-43e0-ac51-785a537584a4 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:41:23.257373 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44d9a7-e659-43e0-ac51-785a537584a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:41:23.335237 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-dc44d9a7-e659-43e0-ac51-785a537584a4 None None] MFA Rules not processed for user `7690af0cd266458f9cdd799c98ff5bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:41:23.336469 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-dc44d9a7-e659-43e0-ac51-785a537584a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:41:23.356911 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:41:23.411679 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 742/1474] 10.222.0.26 () {58 vars in 1063 bytes} [Sun Sep 11 08:41:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:41:23.419865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2617814-709d-4a86-9a9b-668a3ff554cc None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:41:23.421366 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e2617814-709d-4a86-9a9b-668a3ff554cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:41:23.525185 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2617814-709d-4a86-9a9b-668a3ff554cc None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:41:23.602860 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbfd30-c893-4995-b2e6-ed1fca7158e1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7690af0cd266458f9cdd799c98ff5bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:41:23.603503 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbfd30-c893-4995-b2e6-ed1fca7158e1 service glance] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:41:23.603789 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbfd30-c893-4995-b2e6-ed1fca7158e1 service glance] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:41:23.604067 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbfd30-c893-4995-b2e6-ed1fca7158e1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:41:23.606207 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ddbbfd30-c893-4995-b2e6-ed1fca7158e1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:41:23.662752 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:41:23.720788 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbbfd30-c893-4995-b2e6-ed1fca7158e1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:41:23.722220 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbbfd30-c893-4995-b2e6-ed1fca7158e1 service glance] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:41:23.740954 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 733/1475] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:41:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:41:25.994893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac2ba3-c830-4820-8ca6-6667ca75efb6 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:41:25.995528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac2ba3-c830-4820-8ca6-6667ca75efb6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:41:25.995636 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac2ba3-c830-4820-8ca6-6667ca75efb6 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:41:25.996919 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 743/1476] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:41:26.002337 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44454b61-1e78-4c0a-a150-5bdcb6aee0b0 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:41:26.002812 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44454b61-1e78-4c0a-a150-5bdcb6aee0b0 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:41:26.002929 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44454b61-1e78-4c0a-a150-5bdcb6aee0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:41:26.069971 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-44454b61-1e78-4c0a-a150-5bdcb6aee0b0 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:41:26.071175 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-44454b61-1e78-4c0a-a150-5bdcb6aee0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:41:26.165795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 734/1477] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:41:26.442672 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac2ba3-c830-4820-8ca6-6667ca75efb6 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:41:26.444183 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d9ac2ba3-c830-4820-8ca6-6667ca75efb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:41:26.572962 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac2ba3-c830-4820-8ca6-6667ca75efb6 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:41:26.623746 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:41:26.666619 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b10c3-3946-4e10-91c2-ad25fb61a08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:41:26.667229 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b10c3-3946-4e10-91c2-ad25fb61a08b admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:41:26.667530 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b10c3-3946-4e10-91c2-ad25fb61a08b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:41:26.668333 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b10c3-3946-4e10-91c2-ad25fb61a08b admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:41:26.668970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b10c3-3946-4e10-91c2-ad25fb61a08b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:41:26.670807 dv-cinder-856941-2-smb devstack@keystone.service[81644]: WARNING py.warnings [None req-b95b10c3-3946-4e10-91c2-ad25fb61a08b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 08:41:26.670807 dv-cinder-856941-2-smb devstack@keystone.service[81644]: warnings.warn(msg) Sep 11 08:41:26.670807 dv-cinder-856941-2-smb devstack@keystone.service[81644]: Sep 11 08:41:26.672001 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b10c3-3946-4e10-91c2-ad25fb61a08b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:41:26.807397 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 744/1478] 10.222.0.26 () {56 vars in 1108 bytes} [Sun Sep 11 08:41:26 2022] GET /identity/v3/projects => generated 2553 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:41:28.986397 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bccfea-4813-4826-a471-94e5f70853c9 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:41:28.986979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bccfea-4813-4826-a471-94e5f70853c9 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:41:28.986979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bccfea-4813-4826-a471-94e5f70853c9 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:41:28.988323 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 735/1479] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:41:28.994112 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16daf4a4-1ed2-4fdc-a159-6813c0594606 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:41:28.994647 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16daf4a4-1ed2-4fdc-a159-6813c0594606 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:41:28.994647 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16daf4a4-1ed2-4fdc-a159-6813c0594606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:41:29.073193 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-16daf4a4-1ed2-4fdc-a159-6813c0594606 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:41:29.074980 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-16daf4a4-1ed2-4fdc-a159-6813c0594606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:41:29.173430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 745/1480] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:41:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:41:29.474637 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bccfea-4813-4826-a471-94e5f70853c9 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:41:29.476193 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f0bccfea-4813-4826-a471-94e5f70853c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:41:29.486045 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:41:29.624381 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bccfea-4813-4826-a471-94e5f70853c9 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:41:29.707816 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:41:29.741889 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01894a71-5d8e-4540-b274-e86587a4059d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:41:29.742497 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01894a71-5d8e-4540-b274-e86587a4059d service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:41:29.742778 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01894a71-5d8e-4540-b274-e86587a4059d service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:41:29.743056 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01894a71-5d8e-4540-b274-e86587a4059d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:41:29.744711 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-01894a71-5d8e-4540-b274-e86587a4059d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:41:29.838339 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01894a71-5d8e-4540-b274-e86587a4059d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:41:29.840003 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01894a71-5d8e-4540-b274-e86587a4059d service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:41:29.858164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 736/1481] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:41:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:41:32.217206 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc71ff2-49ca-4bea-ac74-62e5b322c8b3 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:41:32.218496 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc71ff2-49ca-4bea-ac74-62e5b322c8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:41:32.218496 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc71ff2-49ca-4bea-ac74-62e5b322c8b3 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:41:32.219194 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 746/1482] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:41:32.224647 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf21fb3-6ba6-4a80-ab11-0842beb84057 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:41:32.225056 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf21fb3-6ba6-4a80-ab11-0842beb84057 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:41:32.225203 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf21fb3-6ba6-4a80-ab11-0842beb84057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:41:32.293527 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-4cf21fb3-6ba6-4a80-ab11-0842beb84057 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:41:32.294735 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4cf21fb3-6ba6-4a80-ab11-0842beb84057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:41:32.343131 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:41:32.394946 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 737/1483] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:41:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:41:32.685410 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc71ff2-49ca-4bea-ac74-62e5b322c8b3 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:41:32.686974 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4fc71ff2-49ca-4bea-ac74-62e5b322c8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:41:32.712614 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:41:32.791327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc71ff2-49ca-4bea-ac74-62e5b322c8b3 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:41:32.865389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67292bb0-e037-45b9-bb9f-696a9b032fa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:41:32.865996 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67292bb0-e037-45b9-bb9f-696a9b032fa1 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:41:32.866275 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67292bb0-e037-45b9-bb9f-696a9b032fa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:41:32.866548 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67292bb0-e037-45b9-bb9f-696a9b032fa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:41:32.868184 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-67292bb0-e037-45b9-bb9f-696a9b032fa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:41:32.942003 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:41:32.976370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67292bb0-e037-45b9-bb9f-696a9b032fa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:41:32.977811 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67292bb0-e037-45b9-bb9f-696a9b032fa1 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:41:32.996664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 747/1484] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:41:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:41:35.241525 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d1f0c-4fc4-4654-b258-1d8d875956a2 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:41:35.242072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d1f0c-4fc4-4654-b258-1d8d875956a2 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:41:35.242072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d1f0c-4fc4-4654-b258-1d8d875956a2 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:41:35.243472 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 738/1485] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:41:35.249503 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3d59a-64d6-4947-b6cb-fd7f08f6d5c5 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:41:35.249969 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3d59a-64d6-4947-b6cb-fd7f08f6d5c5 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:41:35.250075 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3d59a-64d6-4947-b6cb-fd7f08f6d5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:41:35.324455 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-12e3d59a-64d6-4947-b6cb-fd7f08f6d5c5 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:41:35.325698 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-12e3d59a-64d6-4947-b6cb-fd7f08f6d5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:41:35.421031 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 748/1486] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:41:35.714464 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d1f0c-4fc4-4654-b258-1d8d875956a2 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:41:35.716062 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-a10d1f0c-4fc4-4654-b258-1d8d875956a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:41:35.820486 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d1f0c-4fc4-4654-b258-1d8d875956a2 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:41:35.893704 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:41:35.895338 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b18b8-87de-4174-a1ee-0cc8991a43bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:41:35.895952 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b18b8-87de-4174-a1ee-0cc8991a43bc service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:41:35.896235 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b18b8-87de-4174-a1ee-0cc8991a43bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:41:35.896511 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b18b8-87de-4174-a1ee-0cc8991a43bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:41:35.898123 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1d9b18b8-87de-4174-a1ee-0cc8991a43bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:41:36.013991 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b18b8-87de-4174-a1ee-0cc8991a43bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:41:36.015456 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b18b8-87de-4174-a1ee-0cc8991a43bc service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:41:36.034055 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 739/1487] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:41:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:41:38.335215 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73206a9e-4d82-48eb-856e-6ae71703538c None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:41:38.335802 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73206a9e-4d82-48eb-856e-6ae71703538c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:41:38.335906 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73206a9e-4d82-48eb-856e-6ae71703538c None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:41:38.337222 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 749/1488] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:41:38.343164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4535024-8950-4126-8bb4-66b832ecf483 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:41:38.343646 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4535024-8950-4126-8bb4-66b832ecf483 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:41:38.343761 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4535024-8950-4126-8bb4-66b832ecf483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:41:38.409343 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-e4535024-8950-4126-8bb4-66b832ecf483 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:41:38.410601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e4535024-8950-4126-8bb4-66b832ecf483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:41:38.470386 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:41:38.514970 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 740/1489] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:41:38.814513 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73206a9e-4d82-48eb-856e-6ae71703538c None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:41:38.816086 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-73206a9e-4d82-48eb-856e-6ae71703538c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:41:38.853814 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:41:38.922750 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73206a9e-4d82-48eb-856e-6ae71703538c None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:41:38.997718 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1347a-b5e7-4a16-b9b1-7300235ca475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:41:38.998327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1347a-b5e7-4a16-b9b1-7300235ca475 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:41:38.998603 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1347a-b5e7-4a16-b9b1-7300235ca475 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:41:38.998873 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1347a-b5e7-4a16-b9b1-7300235ca475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:41:39.000508 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-50f1347a-b5e7-4a16-b9b1-7300235ca475 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:41:39.083881 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:41:39.113179 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f1347a-b5e7-4a16-b9b1-7300235ca475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:41:39.114633 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f1347a-b5e7-4a16-b9b1-7300235ca475 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:41:39.133406 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 750/1490] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:41:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:41:41.671415 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c6d66-dad2-4bed-85dc-d5d311ca0e1c None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:41:41.671981 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c6d66-dad2-4bed-85dc-d5d311ca0e1c None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:41:41.671981 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c6d66-dad2-4bed-85dc-d5d311ca0e1c None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:41:41.673301 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 741/1491] 10.222.0.26 () {54 vars in 927 bytes} [Sun Sep 11 08:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:41:41.679094 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f80a2e-4533-48ef-b96a-0090a54590e1 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:41:41.679846 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f80a2e-4533-48ef-b96a-0090a54590e1 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:41:41.679846 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f80a2e-4533-48ef-b96a-0090a54590e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:41:41.752858 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-93f80a2e-4533-48ef-b96a-0090a54590e1 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:41:41.754467 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-93f80a2e-4533-48ef-b96a-0090a54590e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:41:41.867450 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 751/1492] 10.222.0.26 () {58 vars in 1024 bytes} [Sun Sep 11 08:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:41:42.156529 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c6d66-dad2-4bed-85dc-d5d311ca0e1c None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:41:42.158131 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-752c6d66-dad2-4bed-85dc-d5d311ca0e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:41:42.265447 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c6d66-dad2-4bed-85dc-d5d311ca0e1c None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:41:42.340850 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fe55c-ea3f-4f24-982f-56d5137444b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:41:42.341459 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fe55c-ea3f-4f24-982f-56d5137444b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:41:42.341738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fe55c-ea3f-4f24-982f-56d5137444b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:41:42.342015 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fe55c-ea3f-4f24-982f-56d5137444b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:41:42.343645 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6e4fe55c-ea3f-4f24-982f-56d5137444b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:41:42.352762 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:41:42.458997 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4fe55c-ea3f-4f24-982f-56d5137444b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:41:42.460372 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4fe55c-ea3f-4f24-982f-56d5137444b2 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:41:42.478673 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 742/1493] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:41:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:41:51.865657 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=82 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:41:52.476190 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=50 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:43:12.898878 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d9fe3-279e-41cc-bce0-78fbcab7562e None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:43:12.899529 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d9fe3-279e-41cc-bce0-78fbcab7562e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:43:12.899529 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d9fe3-279e-41cc-bce0-78fbcab7562e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:43:12.983013 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-af6d9fe3-279e-41cc-bce0-78fbcab7562e None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:43:12.984289 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-af6d9fe3-279e-41cc-bce0-78fbcab7562e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:43:13.092401 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 752/1494] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:43:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:43:13.100624 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e58f84-94b8-4059-9539-9c0bded81042 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:43:13.101176 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e58f84-94b8-4059-9539-9c0bded81042 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:43:13.101176 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e58f84-94b8-4059-9539-9c0bded81042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:43:13.122326 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-e1e58f84-94b8-4059-9539-9c0bded81042 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:43:13.123637 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e1e58f84-94b8-4059-9539-9c0bded81042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:43:13.133575 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 743/1495] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:43:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:43:13.150686 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d9fe3-279e-41cc-bce0-78fbcab7562e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:43:13.161651 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d9fe3-279e-41cc-bce0-78fbcab7562e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:43:13.166481 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4c4ad-dd6d-42bc-91db-4ed6b9ecbea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:43:13.167095 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4c4ad-dd6d-42bc-91db-4ed6b9ecbea0 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:43:13.167420 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4c4ad-dd6d-42bc-91db-4ed6b9ecbea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:43:13.167694 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4c4ad-dd6d-42bc-91db-4ed6b9ecbea0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:43:13.168352 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e4c4ad-dd6d-42bc-91db-4ed6b9ecbea0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:43:13.168661 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e4c4ad-dd6d-42bc-91db-4ed6b9ecbea0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:43:13.169719 dv-cinder-856941-2-smb devstack@keystone.service[81644]: WARNING py.warnings [None req-97e4c4ad-dd6d-42bc-91db-4ed6b9ecbea0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 08:43:13.169719 dv-cinder-856941-2-smb devstack@keystone.service[81644]: warnings.warn(msg) Sep 11 08:43:13.169719 dv-cinder-856941-2-smb devstack@keystone.service[81644]: Sep 11 08:43:13.170619 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e4c4ad-dd6d-42bc-91db-4ed6b9ecbea0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:43:13.182971 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 753/1496] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:43:13.191700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e58f84-94b8-4059-9539-9c0bded81042 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:43:13.207171 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e58f84-94b8-4059-9539-9c0bded81042 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:43:13.213379 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e0f4b-5ff7-4103-b0d0-6ff297af9883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:43:13.214007 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e0f4b-5ff7-4103-b0d0-6ff297af9883 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:43:13.214291 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e0f4b-5ff7-4103-b0d0-6ff297af9883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:43:13.214554 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e0f4b-5ff7-4103-b0d0-6ff297af9883 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:43:13.215237 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e0f4b-5ff7-4103-b0d0-6ff297af9883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:43:13.217001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: WARNING py.warnings [None req-a52e0f4b-5ff7-4103-b0d0-6ff297af9883 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 08:43:13.217001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: warnings.warn(msg) Sep 11 08:43:13.217001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: Sep 11 08:43:13.218238 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e0f4b-5ff7-4103-b0d0-6ff297af9883 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:43:13.322990 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 744/1497] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:43:13 2022] POST /identity/v3/projects => generated 379 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:43:13.327214 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4c4ad-dd6d-42bc-91db-4ed6b9ecbea0 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:43:13.338537 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4c4ad-dd6d-42bc-91db-4ed6b9ecbea0 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:43:13.391273 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:43:13.398471 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486c563-20be-4c41-8395-6024201e9bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:43:13.399203 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486c563-20be-4c41-8395-6024201e9bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:43:13.399711 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486c563-20be-4c41-8395-6024201e9bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:43:13.400129 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486c563-20be-4c41-8395-6024201e9bd5 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:43:13.401237 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486c563-20be-4c41-8395-6024201e9bd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:43:13.402859 dv-cinder-856941-2-smb devstack@keystone.service[81644]: WARNING py.warnings [None req-e486c563-20be-4c41-8395-6024201e9bd5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 08:43:13.402859 dv-cinder-856941-2-smb devstack@keystone.service[81644]: warnings.warn(msg) Sep 11 08:43:13.402859 dv-cinder-856941-2-smb devstack@keystone.service[81644]: Sep 11 08:43:13.404624 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486c563-20be-4c41-8395-6024201e9bd5 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:43:13.484522 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 754/1498] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:43:13 2022] POST /identity/v3/users => generated 290 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:43:13.486569 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e0f4b-5ff7-4103-b0d0-6ff297af9883 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:43:13.499375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e0f4b-5ff7-4103-b0d0-6ff297af9883 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:43:13.504230 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b393c-5b37-4a30-9f16-1a488508bf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:43:13.504840 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b393c-5b37-4a30-9f16-1a488508bf72 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:43:13.505120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b393c-5b37-4a30-9f16-1a488508bf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:43:13.505391 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b393c-5b37-4a30-9f16-1a488508bf72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:43:13.506083 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b393c-5b37-4a30-9f16-1a488508bf72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:43:13.507897 dv-cinder-856941-2-smb devstack@keystone.service[81645]: WARNING py.warnings [None req-0b7b393c-5b37-4a30-9f16-1a488508bf72 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 08:43:13.507897 dv-cinder-856941-2-smb devstack@keystone.service[81645]: warnings.warn(msg) Sep 11 08:43:13.507897 dv-cinder-856941-2-smb devstack@keystone.service[81645]: Sep 11 08:43:13.508797 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b393c-5b37-4a30-9f16-1a488508bf72 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:43:13.522761 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 745/1499] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:43:13.527208 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486c563-20be-4c41-8395-6024201e9bd5 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:43:13.538127 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486c563-20be-4c41-8395-6024201e9bd5 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:43:13.542845 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19c3c1-5777-4542-bddc-bf9eeeb63218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:43:13.543480 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19c3c1-5777-4542-bddc-bf9eeeb63218 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:43:13.543810 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19c3c1-5777-4542-bddc-bf9eeeb63218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:43:13.549379 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19c3c1-5777-4542-bddc-bf9eeeb63218 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:43:13.549379 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19c3c1-5777-4542-bddc-bf9eeeb63218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:43:13.549379 dv-cinder-856941-2-smb devstack@keystone.service[81644]: WARNING py.warnings [None req-fd19c3c1-5777-4542-bddc-bf9eeeb63218 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 08:43:13.549379 dv-cinder-856941-2-smb devstack@keystone.service[81644]: warnings.warn(msg) Sep 11 08:43:13.549379 dv-cinder-856941-2-smb devstack@keystone.service[81644]: Sep 11 08:43:13.549379 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19c3c1-5777-4542-bddc-bf9eeeb63218 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:43:13.562547 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 755/1500] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:43:13.566749 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b393c-5b37-4a30-9f16-1a488508bf72 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:43:13.577577 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b393c-5b37-4a30-9f16-1a488508bf72 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:43:13.582561 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe7013-144f-4629-aec8-0d4c1d415669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:43:13.583221 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe7013-144f-4629-aec8-0d4c1d415669 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:43:13.583551 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe7013-144f-4629-aec8-0d4c1d415669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:43:13.583830 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe7013-144f-4629-aec8-0d4c1d415669 admin admin] PATH_INFO: `/v3/projects/817578bd9de54111b918a6e0419aa181/users/99fa0359b50640fa83d01b9c6bae8175/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:43:13.598602 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe7013-144f-4629-aec8-0d4c1d415669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=817578bd9de54111b918a6e0419aa181, user_id=99fa0359b50640fa83d01b9c6bae8175, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:43:13.599664 dv-cinder-856941-2-smb devstack@keystone.service[81645]: WARNING py.warnings [None req-0cfe7013-144f-4629-aec8-0d4c1d415669 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 08:43:13.599664 dv-cinder-856941-2-smb devstack@keystone.service[81645]: warnings.warn(msg) Sep 11 08:43:13.599664 dv-cinder-856941-2-smb devstack@keystone.service[81645]: Sep 11 08:43:13.601677 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe7013-144f-4629-aec8-0d4c1d415669 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:43:13.681522 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 746/1501] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:43:13 2022] PUT /identity/v3/projects/817578bd9de54111b918a6e0419aa181/users/99fa0359b50640fa83d01b9c6bae8175/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:43:13.694309 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973e4cc-af6d-44d8-b7f9-32840cded951 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:43:13.694742 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973e4cc-af6d-44d8-b7f9-32840cded951 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:43:13.695202 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973e4cc-af6d-44d8-b7f9-32840cded951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:43:13.724088 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-4973e4cc-af6d-44d8-b7f9-32840cded951 None None] MFA Rules not processed for user `99fa0359b50640fa83d01b9c6bae8175`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:43:13.725895 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4973e4cc-af6d-44d8-b7f9-32840cded951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:43:13.792116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 756/1502] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:43:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:43:13.807405 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea3652-2a3a-465d-a43c-d3a74d5231cd None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:43:13.807697 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea3652-2a3a-465d-a43c-d3a74d5231cd None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:43:13.808008 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea3652-2a3a-465d-a43c-d3a74d5231cd None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:43:13.809319 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 747/1503] 10.222.0.26 () {54 vars in 964 bytes} [Sun Sep 11 08:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:43:13.814241 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b2d83-7bd6-4e0d-9802-95a542acdb51 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:43:13.814526 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b2d83-7bd6-4e0d-9802-95a542acdb51 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:43:13.814801 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b2d83-7bd6-4e0d-9802-95a542acdb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:43:13.874527 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-5c4b2d83-7bd6-4e0d-9802-95a542acdb51 None None] MFA Rules not processed for user `211fa4ad83be44cd8164e0e47278273a`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:43:13.875711 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5c4b2d83-7bd6-4e0d-9802-95a542acdb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:43:13.953577 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 757/1504] 10.222.0.26 () {58 vars in 1061 bytes} [Sun Sep 11 08:43:13 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:43:13.961655 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea3652-2a3a-465d-a43c-d3a74d5231cd None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:43:13.973275 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea3652-2a3a-465d-a43c-d3a74d5231cd None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:43:13.977323 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92b0dc-bd22-4a14-997f-bc1bcc98603b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:43:13.977919 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92b0dc-bd22-4a14-997f-bc1bcc98603b service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:43:13.978197 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92b0dc-bd22-4a14-997f-bc1bcc98603b service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:43:13.978463 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92b0dc-bd22-4a14-997f-bc1bcc98603b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:43:13.986964 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92b0dc-bd22-4a14-997f-bc1bcc98603b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:43:13.988580 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92b0dc-bd22-4a14-997f-bc1bcc98603b service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:43:13.998350 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 748/1505] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:43:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:43:14.045605 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eeb5af-c870-4476-a436-9b25d7aff42e None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:43:14.045899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eeb5af-c870-4476-a436-9b25d7aff42e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:43:14.046172 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eeb5af-c870-4476-a436-9b25d7aff42e None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:43:14.047485 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 758/1506] 10.222.0.26 () {52 vars in 830 bytes} [Sun Sep 11 08:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:43:14.051516 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92b0dc-bd22-4a14-997f-bc1bcc98603b service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:43:14.116289 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92b0dc-bd22-4a14-997f-bc1bcc98603b service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:43:14.121096 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ae66e-d870-4cce-952b-c60823e38ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:43:14.121740 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ae66e-d870-4cce-952b-c60823e38ee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:43:14.122024 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ae66e-d870-4cce-952b-c60823e38ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:43:14.122302 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ae66e-d870-4cce-952b-c60823e38ee3 admin admin] PATH_INFO: `/v3/users/99fa0359b50640fa83d01b9c6bae8175` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:43:14.123519 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ae66e-d870-4cce-952b-c60823e38ee3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99fa0359b50640fa83d01b9c6bae8175)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:43:14.124593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: WARNING py.warnings [None req-7f3ae66e-d870-4cce-952b-c60823e38ee3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 08:43:14.124593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: warnings.warn(msg) Sep 11 08:43:14.124593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: Sep 11 08:43:14.125771 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ae66e-d870-4cce-952b-c60823e38ee3 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:43:14.347838 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7f3ae66e-d870-4cce-952b-c60823e38ee3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99fa0359b50640fa83d01b9c6bae8175'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:43:14.348573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7f3ae66e-d870-4cce-952b-c60823e38ee3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99fa0359b50640fa83d01b9c6bae8175'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:43:14.364519 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7f3ae66e-d870-4cce-952b-c60823e38ee3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99fa0359b50640fa83d01b9c6bae8175'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:43:14.365242 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7f3ae66e-d870-4cce-952b-c60823e38ee3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99fa0359b50640fa83d01b9c6bae8175'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:43:14.462573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7f3ae66e-d870-4cce-952b-c60823e38ee3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99fa0359b50640fa83d01b9c6bae8175'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:43:14.486417 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:43:14.495357 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 749/1507] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:43:14 2022] DELETE /identity/v3/users/99fa0359b50640fa83d01b9c6bae8175 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:43:14.499882 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c0244-7211-4deb-b4fe-3a1c676970e1 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:43:14.500172 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c0244-7211-4deb-b4fe-3a1c676970e1 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:43:14.500451 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c0244-7211-4deb-b4fe-3a1c676970e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:43:14.520643 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-b15c0244-7211-4deb-b4fe-3a1c676970e1 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:43:14.522585 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b15c0244-7211-4deb-b4fe-3a1c676970e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:43:14.532251 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:43:14.581932 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 759/1508] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:43:14.592465 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ae66e-d870-4cce-952b-c60823e38ee3 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:43:14.593975 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7f3ae66e-d870-4cce-952b-c60823e38ee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:43:14.702350 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ae66e-d870-4cce-952b-c60823e38ee3 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:43:14.706749 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7ab00-4d6c-4638-8c98-e1a13e64b161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:43:14.707421 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7ab00-4d6c-4638-8c98-e1a13e64b161 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:43:14.707704 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7ab00-4d6c-4638-8c98-e1a13e64b161 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:43:14.707977 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7ab00-4d6c-4638-8c98-e1a13e64b161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:43:14.720377 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7ab00-4d6c-4638-8c98-e1a13e64b161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:43:14.721762 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7ab00-4d6c-4638-8c98-e1a13e64b161 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:43:14.732060 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 750/1509] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:43:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:43:15.374170 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c0244-7211-4deb-b4fe-3a1c676970e1 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:43:15.375782 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b15c0244-7211-4deb-b4fe-3a1c676970e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:43:15.391812 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c0244-7211-4deb-b4fe-3a1c676970e1 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:43:15.398055 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc560f03-67c9-4842-bf23-5a2d26a5c963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:43:15.398951 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc560f03-67c9-4842-bf23-5a2d26a5c963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:43:15.399331 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc560f03-67c9-4842-bf23-5a2d26a5c963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:43:15.399802 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc560f03-67c9-4842-bf23-5a2d26a5c963 admin admin] PATH_INFO: `/v3/projects/817578bd9de54111b918a6e0419aa181` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:43:15.401276 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc560f03-67c9-4842-bf23-5a2d26a5c963 admin admin] RBAC: Authorizing `identity:delete_project(project_id=817578bd9de54111b918a6e0419aa181)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:43:15.402955 dv-cinder-856941-2-smb devstack@keystone.service[81644]: WARNING py.warnings [None req-dc560f03-67c9-4842-bf23-5a2d26a5c963 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 08:43:15.402955 dv-cinder-856941-2-smb devstack@keystone.service[81644]: warnings.warn(msg) Sep 11 08:43:15.402955 dv-cinder-856941-2-smb devstack@keystone.service[81644]: Sep 11 08:43:15.405336 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc560f03-67c9-4842-bf23-5a2d26a5c963 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:43:15.560669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-dc560f03-67c9-4842-bf23-5a2d26a5c963 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '817578bd9de54111b918a6e0419aa181', 'request_id': 'req-dc560f03-67c9-4842-bf23-5a2d26a5c963'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:43:15.569925 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-dc560f03-67c9-4842-bf23-5a2d26a5c963 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '817578bd9de54111b918a6e0419aa181', 'request_id': 'req-dc560f03-67c9-4842-bf23-5a2d26a5c963'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:43:15.651307 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-dc560f03-67c9-4842-bf23-5a2d26a5c963 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '817578bd9de54111b918a6e0419aa181', 'request_id': 'req-dc560f03-67c9-4842-bf23-5a2d26a5c963'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:43:15.670566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-dc560f03-67c9-4842-bf23-5a2d26a5c963 admin admin] The token cache is being invalidate because project 817578bd9de54111b918a6e0419aa181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:43:15.670868 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-dc560f03-67c9-4842-bf23-5a2d26a5c963 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:43:15.671548 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-dc560f03-67c9-4842-bf23-5a2d26a5c963 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:43:15.673596 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 760/1510] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:43:15 2022] DELETE /identity/v3/projects/817578bd9de54111b918a6e0419aa181 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:43:24.727459 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:43:25.667446 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:44:51.126643 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fa742-2d6c-41ee-a942-e3fb3f02fb24 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:44:51.127338 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fa742-2d6c-41ee-a942-e3fb3f02fb24 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:44:51.127338 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fa742-2d6c-41ee-a942-e3fb3f02fb24 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:44:51.128575 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 751/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 08:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:44:51.133794 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdace7-7334-4045-82d5-2052e04ffee7 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:44:51.134255 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdace7-7334-4045-82d5-2052e04ffee7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:44:51.134367 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdace7-7334-4045-82d5-2052e04ffee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:44:51.156985 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-82bdace7-7334-4045-82d5-2052e04ffee7 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:44:51.158203 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-82bdace7-7334-4045-82d5-2052e04ffee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:44:51.215986 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 761/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 08:44:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:44:51.369899 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904fa742-2d6c-41ee-a942-e3fb3f02fb24 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:44:51.371664 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-904fa742-2d6c-41ee-a942-e3fb3f02fb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:44:51.472962 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904fa742-2d6c-41ee-a942-e3fb3f02fb24 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:44:51.479101 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497080e-5a0d-4bd6-a664-2c5f85674bde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:44:51.479739 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497080e-5a0d-4bd6-a664-2c5f85674bde service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:44:51.480023 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497080e-5a0d-4bd6-a664-2c5f85674bde service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:44:51.480303 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497080e-5a0d-4bd6-a664-2c5f85674bde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:44:51.488355 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497080e-5a0d-4bd6-a664-2c5f85674bde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:44:51.490574 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497080e-5a0d-4bd6-a664-2c5f85674bde service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:44:51.499970 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 752/1513] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:44:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:44:52.597246 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71abef8-1650-4afb-b145-26411e5c3dd6 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:44:52.597830 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71abef8-1650-4afb-b145-26411e5c3dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:44:52.597830 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71abef8-1650-4afb-b145-26411e5c3dd6 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:44:52.599179 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 762/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 08:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:44:52.605868 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa6070-f5fa-4f6e-989e-24fbec4e93cb None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:44:52.606349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa6070-f5fa-4f6e-989e-24fbec4e93cb None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:44:52.606428 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa6070-f5fa-4f6e-989e-24fbec4e93cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:44:52.626758 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-00aa6070-f5fa-4f6e-989e-24fbec4e93cb None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:44:52.627987 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-00aa6070-f5fa-4f6e-989e-24fbec4e93cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:44:52.636444 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 753/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 08:44:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:44:52.656408 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1436cb-34cd-4a01-b38a-f23eceb936e6 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:44:52.656703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1436cb-34cd-4a01-b38a-f23eceb936e6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:44:52.656985 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1436cb-34cd-4a01-b38a-f23eceb936e6 None None] PATH_INFO: `/v3` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:44:52.658246 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 763/1516] 10.222.0.50 () {54 vars in 925 bytes} [Sun Sep 11 08:44:52 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:44:52.665741 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8e9b2-3999-4ebd-a89c-7e45788ba756 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:44:52.666028 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8e9b2-3999-4ebd-a89c-7e45788ba756 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:44:52.666305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8e9b2-3999-4ebd-a89c-7e45788ba756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:44:52.718451 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-34d8e9b2-3999-4ebd-a89c-7e45788ba756 None None] MFA Rules not processed for user `a48c49f7a9f44cef89dd024fecea422f`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:44:52.719712 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-34d8e9b2-3999-4ebd-a89c-7e45788ba756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:44:52.788316 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1436cb-34cd-4a01-b38a-f23eceb936e6 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:44:52.793000 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 754/1517] 10.222.0.50 () {58 vars in 1015 bytes} [Sun Sep 11 08:44:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:44:52.803399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1436cb-34cd-4a01-b38a-f23eceb936e6 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:44:52.808850 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e90c24-384c-46b9-a6ff-b573ff0aabcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:44:52.809447 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e90c24-384c-46b9-a6ff-b573ff0aabcf service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:44:52.809725 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e90c24-384c-46b9-a6ff-b573ff0aabcf service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:44:52.809999 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e90c24-384c-46b9-a6ff-b573ff0aabcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:44:52.819701 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e90c24-384c-46b9-a6ff-b573ff0aabcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:44:52.821313 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e90c24-384c-46b9-a6ff-b573ff0aabcf service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:44:52.831480 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 764/1518] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:44:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:45:01.726655 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a1cdd-e95b-4369-b116-25b7d4203a95 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:45:01.727192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a1cdd-e95b-4369-b116-25b7d4203a95 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:45:01.727192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a1cdd-e95b-4369-b116-25b7d4203a95 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:45:01.728586 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 755/1519] 10.222.0.26 () {54 vars in 961 bytes} [Sun Sep 11 08:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:45:01.733624 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c187c2-c1d6-43c0-8d97-aa501bb5c923 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:45:01.734096 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c187c2-c1d6-43c0-8d97-aa501bb5c923 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:45:01.734210 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c187c2-c1d6-43c0-8d97-aa501bb5c923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:45:01.754031 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-01c187c2-c1d6-43c0-8d97-aa501bb5c923 None None] MFA Rules not processed for user `a48c49f7a9f44cef89dd024fecea422f`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:45:01.755798 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-01c187c2-c1d6-43c0-8d97-aa501bb5c923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:45:01.764412 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 765/1520] 10.222.0.26 () {58 vars in 1058 bytes} [Sun Sep 11 08:45:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:45:01.773586 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a1cdd-e95b-4369-b116-25b7d4203a95 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:45:01.787314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a1cdd-e95b-4369-b116-25b7d4203a95 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:45:01.793295 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08c957-c8e5-4f04-b44e-c6b79561ab0e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a48c49f7a9f44cef89dd024fecea422f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:45:01.794030 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08c957-c8e5-4f04-b44e-c6b79561ab0e service placement] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:45:01.794308 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08c957-c8e5-4f04-b44e-c6b79561ab0e service placement] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:45:01.794507 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08c957-c8e5-4f04-b44e-c6b79561ab0e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:45:01.803900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08c957-c8e5-4f04-b44e-c6b79561ab0e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:45:01.805528 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08c957-c8e5-4f04-b44e-c6b79561ab0e service placement] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:45:01.815921 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 756/1521] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:45:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:45:04.361516 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15771ca-998f-43bb-886d-284037c6cd8c None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:45:04.362086 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15771ca-998f-43bb-886d-284037c6cd8c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:45:04.362086 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15771ca-998f-43bb-886d-284037c6cd8c None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:45:04.363437 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 766/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 08:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:45:04.369969 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84c7e4-339b-4067-b3ed-89e09394b541 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:45:04.370451 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84c7e4-339b-4067-b3ed-89e09394b541 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:45:04.370550 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84c7e4-339b-4067-b3ed-89e09394b541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:45:04.378327 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:45:04.390304 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-8f84c7e4-339b-4067-b3ed-89e09394b541 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:45:04.391548 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-8f84c7e4-339b-4067-b3ed-89e09394b541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:45:04.399877 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 757/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 08:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:45:04.555137 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15771ca-998f-43bb-886d-284037c6cd8c None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:45:04.569486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15771ca-998f-43bb-886d-284037c6cd8c None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:45:04.574893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9d4b7-ee01-40fe-b1e9-b37a8bab13a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:45:04.575513 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9d4b7-ee01-40fe-b1e9-b37a8bab13a7 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:45:04.575790 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9d4b7-ee01-40fe-b1e9-b37a8bab13a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:45:04.576067 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9d4b7-ee01-40fe-b1e9-b37a8bab13a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:45:04.585025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9d4b7-ee01-40fe-b1e9-b37a8bab13a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:45:04.586619 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9d4b7-ee01-40fe-b1e9-b37a8bab13a7 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:45:04.596087 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 767/1524] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:45:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:45:05.728066 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98351f81-9f4d-4079-8239-511134deb2ba None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:45:05.728628 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98351f81-9f4d-4079-8239-511134deb2ba None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:45:05.728628 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98351f81-9f4d-4079-8239-511134deb2ba None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:45:05.730021 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 758/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 08:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:45:05.736390 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50856e-4625-492c-b010-ab522f6d5a61 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:45:05.736840 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50856e-4625-492c-b010-ab522f6d5a61 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:45:05.736950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50856e-4625-492c-b010-ab522f6d5a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:45:05.757498 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-6f50856e-4625-492c-b010-ab522f6d5a61 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:45:05.758721 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6f50856e-4625-492c-b010-ab522f6d5a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:45:05.766626 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 768/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 08:45:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:45:05.920079 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98351f81-9f4d-4079-8239-511134deb2ba None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:45:05.934846 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98351f81-9f4d-4079-8239-511134deb2ba None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:45:05.940430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1593ee-f28f-4557-b450-dadeae2071e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:45:05.941033 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1593ee-f28f-4557-b450-dadeae2071e0 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:45:05.941317 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1593ee-f28f-4557-b450-dadeae2071e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:45:05.941601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1593ee-f28f-4557-b450-dadeae2071e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:45:05.950363 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1593ee-f28f-4557-b450-dadeae2071e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:45:05.951995 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1593ee-f28f-4557-b450-dadeae2071e0 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:45:05.967206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 759/1527] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:45:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:45:09.922798 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c91011-6565-4730-9c9f-efbbf8644790 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:45:09.923348 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c91011-6565-4730-9c9f-efbbf8644790 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:45:09.923348 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c91011-6565-4730-9c9f-efbbf8644790 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:45:09.924769 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 769/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 08:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:45:09.931014 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40db84-d6ec-41c5-b05b-1a4b76223e44 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:45:09.931473 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40db84-d6ec-41c5-b05b-1a4b76223e44 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:45:09.931605 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40db84-d6ec-41c5-b05b-1a4b76223e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:45:09.950894 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-bc40db84-d6ec-41c5-b05b-1a4b76223e44 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:45:09.952126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-bc40db84-d6ec-41c5-b05b-1a4b76223e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:45:09.960340 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 760/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 08:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:45:10.260357 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c91011-6565-4730-9c9f-efbbf8644790 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:45:10.262161 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-61c91011-6565-4730-9c9f-efbbf8644790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:45:10.321982 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c91011-6565-4730-9c9f-efbbf8644790 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:45:10.325474 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e49018-9951-4f0d-9856-a108bdd6b563 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:45:10.326078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e49018-9951-4f0d-9856-a108bdd6b563 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:45:10.326360 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e49018-9951-4f0d-9856-a108bdd6b563 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:45:10.326636 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e49018-9951-4f0d-9856-a108bdd6b563 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:45:10.337001 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e49018-9951-4f0d-9856-a108bdd6b563 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:45:10.338507 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e49018-9951-4f0d-9856-a108bdd6b563 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:45:10.348487 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 770/1530] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:45:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:45:12.517913 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412771ce-c7b0-4f35-b62c-c62ff1a7ac1e None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:45:12.518498 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412771ce-c7b0-4f35-b62c-c62ff1a7ac1e None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:45:12.518498 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412771ce-c7b0-4f35-b62c-c62ff1a7ac1e None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:45:12.519948 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 761/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 08:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:45:12.525413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ee826-dd1a-4970-bb7b-802d2f945d89 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:45:12.525836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ee826-dd1a-4970-bb7b-802d2f945d89 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:45:12.526250 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ee826-dd1a-4970-bb7b-802d2f945d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:45:12.545771 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f40ee826-dd1a-4970-bb7b-802d2f945d89 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:45:12.548061 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f40ee826-dd1a-4970-bb7b-802d2f945d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:45:12.556190 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 771/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 08:45:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:45:12.848761 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412771ce-c7b0-4f35-b62c-c62ff1a7ac1e None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:45:12.859599 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412771ce-c7b0-4f35-b62c-c62ff1a7ac1e None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:45:12.863112 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e19570-5edd-4ea0-a446-9a01fe89de4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:45:12.864382 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e19570-5edd-4ea0-a446-9a01fe89de4d service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:45:12.864657 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e19570-5edd-4ea0-a446-9a01fe89de4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:45:12.864933 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e19570-5edd-4ea0-a446-9a01fe89de4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:45:12.873724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e19570-5edd-4ea0-a446-9a01fe89de4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:45:12.875143 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e19570-5edd-4ea0-a446-9a01fe89de4d service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:45:12.884752 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 762/1533] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:45:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:45:16.403561 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ce607-81d7-4103-915a-ee118a59ded6 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:45:16.404133 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ce607-81d7-4103-915a-ee118a59ded6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:45:16.404133 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ce607-81d7-4103-915a-ee118a59ded6 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:45:16.405472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 772/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 08:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:45:16.410960 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fa5d8-e02c-4c4d-9984-33d70e656fb0 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:45:16.411451 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fa5d8-e02c-4c4d-9984-33d70e656fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:45:16.411549 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fa5d8-e02c-4c4d-9984-33d70e656fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:45:16.431829 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-f07fa5d8-e02c-4c4d-9984-33d70e656fb0 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:45:16.433087 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f07fa5d8-e02c-4c4d-9984-33d70e656fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:45:16.440924 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 763/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 08:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:45:16.746212 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ce607-81d7-4103-915a-ee118a59ded6 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:45:16.747959 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b85ce607-81d7-4103-915a-ee118a59ded6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:45:16.754590 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=75 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:45:16.808484 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ce607-81d7-4103-915a-ee118a59ded6 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:45:16.812130 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cddf1-6841-4d1e-9345-92ec96ac26a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:45:16.812751 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cddf1-6841-4d1e-9345-92ec96ac26a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:45:16.813035 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cddf1-6841-4d1e-9345-92ec96ac26a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:45:16.813311 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cddf1-6841-4d1e-9345-92ec96ac26a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:45:16.823597 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9cddf1-6841-4d1e-9345-92ec96ac26a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:45:16.825048 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9cddf1-6841-4d1e-9345-92ec96ac26a8 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:45:16.836340 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 773/1536] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:45:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:45:18.967722 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952ddda-d592-4f30-9dbb-20d95ce11f9e None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:45:18.968285 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952ddda-d592-4f30-9dbb-20d95ce11f9e None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:45:18.968285 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952ddda-d592-4f30-9dbb-20d95ce11f9e None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:45:18.969611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 764/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 08:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:45:18.974801 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accb133-ef99-4810-86cc-14071cd257bd None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:45:18.975218 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accb133-ef99-4810-86cc-14071cd257bd None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:45:18.975428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accb133-ef99-4810-86cc-14071cd257bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:45:18.994792 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-5accb133-ef99-4810-86cc-14071cd257bd None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:45:18.996049 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5accb133-ef99-4810-86cc-14071cd257bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:45:19.004512 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 774/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 08:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:45:19.314525 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952ddda-d592-4f30-9dbb-20d95ce11f9e None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:45:19.316859 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f952ddda-d592-4f30-9dbb-20d95ce11f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:45:19.329910 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952ddda-d592-4f30-9dbb-20d95ce11f9e None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:45:19.334384 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f01a8-290e-4ec0-8f01-01822feeef14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:45:19.334987 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f01a8-290e-4ec0-8f01-01822feeef14 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:45:19.335290 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f01a8-290e-4ec0-8f01-01822feeef14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:45:19.335569 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f01a8-290e-4ec0-8f01-01822feeef14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:45:19.344869 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f01a8-290e-4ec0-8f01-01822feeef14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:45:19.346311 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f01a8-290e-4ec0-8f01-01822feeef14 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:45:19.356546 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 765/1539] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:45:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:45:28.989345 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=28 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:45:29.352400 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=26 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:46:49.585583 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3271aa-b4c3-4f3f-81cd-e7e5232b9b12 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:49.586276 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3271aa-b4c3-4f3f-81cd-e7e5232b9b12 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:49.586534 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3271aa-b4c3-4f3f-81cd-e7e5232b9b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:49.632187 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-bf3271aa-b4c3-4f3f-81cd-e7e5232b9b12 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:46:49.634310 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-bf3271aa-b4c3-4f3f-81cd-e7e5232b9b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:46:49.651983 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 775/1540] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:46:49.693758 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0afcc-f39d-41bd-af08-cfc02373b3f3 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:49.695135 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0afcc-f39d-41bd-af08-cfc02373b3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:49.695675 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0afcc-f39d-41bd-af08-cfc02373b3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:49.727650 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c109111-9808-4ed3-b52f-e2b7488a3dba None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:49.728303 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c109111-9808-4ed3-b52f-e2b7488a3dba None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:49.728823 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c109111-9808-4ed3-b52f-e2b7488a3dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:49.761188 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-0bb0afcc-f39d-41bd-af08-cfc02373b3f3 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:46:49.763575 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-0bb0afcc-f39d-41bd-af08-cfc02373b3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:46:49.767884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-0c109111-9808-4ed3-b52f-e2b7488a3dba None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:46:49.769727 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0c109111-9808-4ed3-b52f-e2b7488a3dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:46:49.785070 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 776/1541] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:46:49.791789 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 766/1542] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:46:49.795664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e192f9f-6072-447d-b148-7c40053c1100 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:49.796309 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e192f9f-6072-447d-b148-7c40053c1100 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:49.796884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e192f9f-6072-447d-b148-7c40053c1100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:49.800088 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0afcc-f39d-41bd-af08-cfc02373b3f3 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:49.821985 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0afcc-f39d-41bd-af08-cfc02373b3f3 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:49.834173 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-4e192f9f-6072-447d-b148-7c40053c1100 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:46:49.836269 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4e192f9f-6072-447d-b148-7c40053c1100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:46:49.841391 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7384e-cace-45ad-8252-678aebf4998a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:49.842628 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7384e-cace-45ad-8252-678aebf4998a admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:49.843236 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7384e-cace-45ad-8252-678aebf4998a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:49.843794 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7384e-cace-45ad-8252-678aebf4998a admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:49.845132 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd7384e-cace-45ad-8252-678aebf4998a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:46:49.845675 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd7384e-cace-45ad-8252-678aebf4998a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:49.851926 dv-cinder-856941-2-smb devstack@keystone.service[81645]: WARNING py.warnings [None req-6bd7384e-cace-45ad-8252-678aebf4998a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 08:46:49.851926 dv-cinder-856941-2-smb devstack@keystone.service[81645]: warnings.warn(msg) Sep 11 08:46:49.851926 dv-cinder-856941-2-smb devstack@keystone.service[81645]: Sep 11 08:46:49.853966 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd7384e-cace-45ad-8252-678aebf4998a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:49.858889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 777/1543] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:46:49.864475 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e192f9f-6072-447d-b148-7c40053c1100 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:49.884474 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e192f9f-6072-447d-b148-7c40053c1100 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:49.889529 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 767/1544] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:46:49.898513 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17321a1-b5a0-428e-b543-92f008b78a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:49.899581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17321a1-b5a0-428e-b543-92f008b78a2d admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:49.900487 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17321a1-b5a0-428e-b543-92f008b78a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:49.901221 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17321a1-b5a0-428e-b543-92f008b78a2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:49.902256 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17321a1-b5a0-428e-b543-92f008b78a2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:46:49.902814 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17321a1-b5a0-428e-b543-92f008b78a2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:49.904962 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17321a1-b5a0-428e-b543-92f008b78a2d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:49.910966 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7384e-cace-45ad-8252-678aebf4998a admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:49.932883 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 778/1545] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:46:49.936826 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7384e-cace-45ad-8252-678aebf4998a admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:49.943873 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17321a1-b5a0-428e-b543-92f008b78a2d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:49.969532 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17321a1-b5a0-428e-b543-92f008b78a2d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:49.971028 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab07fb-2dea-4d23-ad86-acd74be562eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:49.975283 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab07fb-2dea-4d23-ad86-acd74be562eb admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:49.975283 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab07fb-2dea-4d23-ad86-acd74be562eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:49.975283 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab07fb-2dea-4d23-ad86-acd74be562eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:49.975283 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab07fb-2dea-4d23-ad86-acd74be562eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:49.978104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab07fb-2dea-4d23-ad86-acd74be562eb admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:49.980769 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456c468-f135-420f-8da7-12f93be2c4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:49.981709 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456c468-f135-420f-8da7-12f93be2c4ef admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:49.982206 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456c468-f135-420f-8da7-12f93be2c4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:49.982694 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456c468-f135-420f-8da7-12f93be2c4ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:49.983658 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456c468-f135-420f-8da7-12f93be2c4ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:49.985593 dv-cinder-856941-2-smb devstack@keystone.service[81644]: WARNING py.warnings [None req-4456c468-f135-420f-8da7-12f93be2c4ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 08:46:49.985593 dv-cinder-856941-2-smb devstack@keystone.service[81644]: warnings.warn(msg) Sep 11 08:46:49.985593 dv-cinder-856941-2-smb devstack@keystone.service[81644]: Sep 11 08:46:49.987447 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456c468-f135-420f-8da7-12f93be2c4ef admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:50.143075 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 779/1546] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:46:49 2022] POST /identity/v3/projects => generated 387 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:46:50.148236 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456c468-f135-420f-8da7-12f93be2c4ef admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:50.179626 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 768/1547] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:46:49 2022] POST /identity/v3/projects => generated 403 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:46:50.182026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d415d07-54e6-4506-8452-586ee3044da0 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:50.182514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d415d07-54e6-4506-8452-586ee3044da0 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:50.182994 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d415d07-54e6-4506-8452-586ee3044da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:50.239653 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-7d415d07-54e6-4506-8452-586ee3044da0 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:46:50.241794 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7d415d07-54e6-4506-8452-586ee3044da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:46:50.304116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456c468-f135-420f-8da7-12f93be2c4ef admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:50.549326 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 769/1548] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:46:50.554809 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d415d07-54e6-4506-8452-586ee3044da0 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:50.588166 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d415d07-54e6-4506-8452-586ee3044da0 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:50.594274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55369bd2-289d-4559-9e35-007fe47248a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:50.595459 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55369bd2-289d-4559-9e35-007fe47248a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:50.596016 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55369bd2-289d-4559-9e35-007fe47248a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:50.597114 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55369bd2-289d-4559-9e35-007fe47248a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:50.598444 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55369bd2-289d-4559-9e35-007fe47248a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:50.607180 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b765e3-c2eb-499e-81c9-407b3dede0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:50.614847 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55369bd2-289d-4559-9e35-007fe47248a7 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:50.615094 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b765e3-c2eb-499e-81c9-407b3dede0ff admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:50.615094 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b765e3-c2eb-499e-81c9-407b3dede0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:50.615094 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b765e3-c2eb-499e-81c9-407b3dede0ff admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:50.615094 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b765e3-c2eb-499e-81c9-407b3dede0ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:50.615094 dv-cinder-856941-2-smb devstack@keystone.service[81645]: WARNING py.warnings [None req-f9b765e3-c2eb-499e-81c9-407b3dede0ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 08:46:50.615094 dv-cinder-856941-2-smb devstack@keystone.service[81645]: warnings.warn(msg) Sep 11 08:46:50.615094 dv-cinder-856941-2-smb devstack@keystone.service[81645]: Sep 11 08:46:50.616739 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b765e3-c2eb-499e-81c9-407b3dede0ff admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:50.756589 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 780/1549] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:46:50 2022] POST /identity/v3/users => generated 294 bytes in 609 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:46:50.760625 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d074b-3053-4940-85f3-e0417da0be0c None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:50.761130 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d074b-3053-4940-85f3-e0417da0be0c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:50.761572 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d074b-3053-4940-85f3-e0417da0be0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:50.787222 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 770/1550] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:46:50 2022] POST /identity/v3/users => generated 302 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:46:50.793675 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3398e-7602-4e02-9135-13942ac40e81 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:50.794834 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3398e-7602-4e02-9135-13942ac40e81 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:50.795516 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3398e-7602-4e02-9135-13942ac40e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:50.802364 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-1b3d074b-3053-4940-85f3-e0417da0be0c None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:46:50.804584 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1b3d074b-3053-4940-85f3-e0417da0be0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:46:50.826363 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 781/1551] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:46:50.826598 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-b7d3398e-7602-4e02-9135-13942ac40e81 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:46:50.826702 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff083c8b-2704-44a2-8093-9b12ae9815ba None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:50.826702 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff083c8b-2704-44a2-8093-9b12ae9815ba None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:50.827057 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff083c8b-2704-44a2-8093-9b12ae9815ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:50.829528 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b7d3398e-7602-4e02-9135-13942ac40e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:46:50.839959 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 771/1552] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:46:50.841778 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a7d49-46fa-4836-87f4-b854ad43ac27 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:50.842332 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a7d49-46fa-4836-87f4-b854ad43ac27 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:50.842920 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a7d49-46fa-4836-87f4-b854ad43ac27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:50.867365 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-cc4a7d49-46fa-4836-87f4-b854ad43ac27 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:46:50.869366 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-ff083c8b-2704-44a2-8093-9b12ae9815ba None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:46:50.870350 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-cc4a7d49-46fa-4836-87f4-b854ad43ac27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:46:50.873785 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ff083c8b-2704-44a2-8093-9b12ae9815ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:46:50.888882 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 772/1553] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:46:50.890271 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a7d49-46fa-4836-87f4-b854ad43ac27 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:50.895208 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 782/1554] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:46:50.896861 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff083c8b-2704-44a2-8093-9b12ae9815ba None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:50.902952 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a7d49-46fa-4836-87f4-b854ad43ac27 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:50.909891 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e067b-6527-4d0f-9890-d3df93014656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:50.910956 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e067b-6527-4d0f-9890-d3df93014656 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:50.911518 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e067b-6527-4d0f-9890-d3df93014656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:50.912822 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e067b-6527-4d0f-9890-d3df93014656 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:50.913760 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e067b-6527-4d0f-9890-d3df93014656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:50.916271 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e067b-6527-4d0f-9890-d3df93014656 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:50.921472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff083c8b-2704-44a2-8093-9b12ae9815ba None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:50.930807 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 773/1555] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:46:50.935010 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e067b-6527-4d0f-9890-d3df93014656 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:50.936705 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b90a88-a901-4332-bdf1-8e14058c0a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:50.939240 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b90a88-a901-4332-bdf1-8e14058c0a52 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:50.939736 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b90a88-a901-4332-bdf1-8e14058c0a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:50.940204 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b90a88-a901-4332-bdf1-8e14058c0a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:50.941789 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b90a88-a901-4332-bdf1-8e14058c0a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:50.945813 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b90a88-a901-4332-bdf1-8e14058c0a52 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:50.949716 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e067b-6527-4d0f-9890-d3df93014656 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:50.956405 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a438c4-25e7-49f0-8efc-efb397a535a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:50.957395 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a438c4-25e7-49f0-8efc-efb397a535a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:50.957885 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a438c4-25e7-49f0-8efc-efb397a535a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:50.958364 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a438c4-25e7-49f0-8efc-efb397a535a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:50.959312 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a438c4-25e7-49f0-8efc-efb397a535a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:46:50.959715 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a438c4-25e7-49f0-8efc-efb397a535a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:50.961513 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a438c4-25e7-49f0-8efc-efb397a535a3 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:50.968566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 783/1556] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:46:50.971523 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2921a55-69e3-4d0b-ab5d-bb9e9bed1240 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:50.972300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2921a55-69e3-4d0b-ab5d-bb9e9bed1240 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:50.972859 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2921a55-69e3-4d0b-ab5d-bb9e9bed1240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:50.985039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 774/1557] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:46:50.986466 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5e085-028b-4627-8332-5a227017adea None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:50.986927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5e085-028b-4627-8332-5a227017adea None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:50.987204 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5e085-028b-4627-8332-5a227017adea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:51.005036 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-a2921a55-69e3-4d0b-ab5d-bb9e9bed1240 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:46:51.006327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a2921a55-69e3-4d0b-ab5d-bb9e9bed1240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:46:51.010773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-48e5e085-028b-4627-8332-5a227017adea None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:46:51.012355 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-48e5e085-028b-4627-8332-5a227017adea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:46:51.018896 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 784/1558] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:46:51.018896 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5962b-5def-42f1-8a04-490eb524bb1f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:51.018896 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5962b-5def-42f1-8a04-490eb524bb1f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:51.018896 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5962b-5def-42f1-8a04-490eb524bb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:51.026376 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 775/1559] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:46:51.028059 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5e085-028b-4627-8332-5a227017adea None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:51.040055 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c7b5962b-5def-42f1-8a04-490eb524bb1f None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:46:51.041304 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c7b5962b-5def-42f1-8a04-490eb524bb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:46:51.045881 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5e085-028b-4627-8332-5a227017adea None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:51.049669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 785/1560] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:46:51.050562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5962b-5def-42f1-8a04-490eb524bb1f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:51.055780 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a421b-52b0-44b9-84e2-401ae60c636e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:51.056489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a421b-52b0-44b9-84e2-401ae60c636e admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:51.056779 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a421b-52b0-44b9-84e2-401ae60c636e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:51.057075 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a421b-52b0-44b9-84e2-401ae60c636e admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:51.057714 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:46:51.057926 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a421b-52b0-44b9-84e2-401ae60c636e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:51.059701 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a421b-52b0-44b9-84e2-401ae60c636e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:51.061903 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5962b-5def-42f1-8a04-490eb524bb1f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:51.067985 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003933cf-5a57-4d3f-be3d-5047e39eadeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:51.072003 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003933cf-5a57-4d3f-be3d-5047e39eadeb admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:51.072003 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003933cf-5a57-4d3f-be3d-5047e39eadeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:51.072003 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003933cf-5a57-4d3f-be3d-5047e39eadeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:51.072003 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003933cf-5a57-4d3f-be3d-5047e39eadeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:51.072003 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003933cf-5a57-4d3f-be3d-5047e39eadeb admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:51.079943 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 776/1561] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:46:51.079943 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de9d1b-f498-47f7-a59c-dbc11b3716df None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:51.079943 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de9d1b-f498-47f7-a59c-dbc11b3716df None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:51.079943 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de9d1b-f498-47f7-a59c-dbc11b3716df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:51.084265 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 786/1562] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:46:51.085213 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003933cf-5a57-4d3f-be3d-5047e39eadeb admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:51.096969 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003933cf-5a57-4d3f-be3d-5047e39eadeb admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:51.103172 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-52de9d1b-f498-47f7-a59c-dbc11b3716df None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:46:51.103537 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a929d-9117-4416-8d0f-a0c10dcd0df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:51.104050 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a929d-9117-4416-8d0f-a0c10dcd0df4 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:51.104332 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a929d-9117-4416-8d0f-a0c10dcd0df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:51.104498 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-52de9d1b-f498-47f7-a59c-dbc11b3716df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:46:51.104658 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a929d-9117-4416-8d0f-a0c10dcd0df4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:51.105261 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84a929d-9117-4416-8d0f-a0c10dcd0df4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:51.107362 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84a929d-9117-4416-8d0f-a0c10dcd0df4 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:51.113434 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 777/1563] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:46:51.114531 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8512c0c-8820-436f-9756-c0c6571cc08c None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:51.114811 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8512c0c-8820-436f-9756-c0c6571cc08c None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:51.115137 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8512c0c-8820-436f-9756-c0c6571cc08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:51.139464 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-f8512c0c-8820-436f-9756-c0c6571cc08c None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:46:51.141306 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f8512c0c-8820-436f-9756-c0c6571cc08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:46:51.149740 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 778/1564] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:46:51.150891 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8512c0c-8820-436f-9756-c0c6571cc08c None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:51.163174 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8512c0c-8820-436f-9756-c0c6571cc08c None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:51.168259 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50687c-37c3-43e9-979b-e8be4535e8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:51.168892 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50687c-37c3-43e9-979b-e8be4535e8ef admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:51.169176 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50687c-37c3-43e9-979b-e8be4535e8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:51.169488 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50687c-37c3-43e9-979b-e8be4535e8ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:51.170153 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50687c-37c3-43e9-979b-e8be4535e8ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:46:51.170459 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50687c-37c3-43e9-979b-e8be4535e8ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:51.172246 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50687c-37c3-43e9-979b-e8be4535e8ef admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:51.188656 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 779/1565] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:46:51.189725 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50687c-37c3-43e9-979b-e8be4535e8ef admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:51.201251 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50687c-37c3-43e9-979b-e8be4535e8ef admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:51.214940 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b2d6a-e5f3-4461-b4b1-66874e75520f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:51.215718 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b2d6a-e5f3-4461-b4b1-66874e75520f admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:51.216093 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b2d6a-e5f3-4461-b4b1-66874e75520f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:51.216479 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b2d6a-e5f3-4461-b4b1-66874e75520f admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:51.217299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b2d6a-e5f3-4461-b4b1-66874e75520f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:46:51.217715 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b2d6a-e5f3-4461-b4b1-66874e75520f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:51.219730 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b2d6a-e5f3-4461-b4b1-66874e75520f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:51.245377 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 780/1566] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:46:51.245377 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b2d6a-e5f3-4461-b4b1-66874e75520f admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:51.245847 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 787/1567] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:46:51 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:46:51.245847 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a929d-9117-4416-8d0f-a0c10dcd0df4 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:51.246515 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b2d6a-e5f3-4461-b4b1-66874e75520f admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:51.252133 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:46:51.316062 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91f602-0c92-4777-a764-3c3907d18658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:51.316597 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91f602-0c92-4777-a764-3c3907d18658 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:51.316872 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91f602-0c92-4777-a764-3c3907d18658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:51.317213 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91f602-0c92-4777-a764-3c3907d18658 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:51.317938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f91f602-0c92-4777-a764-3c3907d18658 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:46:51.318264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f91f602-0c92-4777-a764-3c3907d18658 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:51.319963 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f91f602-0c92-4777-a764-3c3907d18658 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:51.321022 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a929d-9117-4416-8d0f-a0c10dcd0df4 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:51.326184 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a165b-b277-477c-9f44-0b8c47dbd535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:51.326875 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a165b-b277-477c-9f44-0b8c47dbd535 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:51.327155 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a165b-b277-477c-9f44-0b8c47dbd535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:51.327467 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a165b-b277-477c-9f44-0b8c47dbd535 admin admin] PATH_INFO: `/v3/projects/ade8a06e18214ac08056c3743fed0132/users/b0b04eae45014585a0fb2205adf946c8/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:51.337343 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 781/1568] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:46:51.338299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91f602-0c92-4777-a764-3c3907d18658 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:51.351922 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91f602-0c92-4777-a764-3c3907d18658 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:51.353267 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a165b-b277-477c-9f44-0b8c47dbd535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ade8a06e18214ac08056c3743fed0132, user_id=b0b04eae45014585a0fb2205adf946c8, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:51.354533 dv-cinder-856941-2-smb devstack@keystone.service[81644]: WARNING py.warnings [None req-282a165b-b277-477c-9f44-0b8c47dbd535 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 08:46:51.354533 dv-cinder-856941-2-smb devstack@keystone.service[81644]: warnings.warn(msg) Sep 11 08:46:51.354533 dv-cinder-856941-2-smb devstack@keystone.service[81644]: Sep 11 08:46:51.357271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a165b-b277-477c-9f44-0b8c47dbd535 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:51.357503 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee471eab-fbed-4513-8f17-5fe13966409a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:51.358163 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee471eab-fbed-4513-8f17-5fe13966409a admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:51.358450 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee471eab-fbed-4513-8f17-5fe13966409a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:51.358731 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee471eab-fbed-4513-8f17-5fe13966409a admin admin] PATH_INFO: `/v3/projects/c81233e4f35945fb8c15540b49467cb5/users/6941aca70b38449e89a0057eefd7355f/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:51.378791 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee471eab-fbed-4513-8f17-5fe13966409a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c81233e4f35945fb8c15540b49467cb5, user_id=6941aca70b38449e89a0057eefd7355f, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:51.381674 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee471eab-fbed-4513-8f17-5fe13966409a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:51.435692 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 788/1569] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:46:51 2022] PUT /identity/v3/projects/ade8a06e18214ac08056c3743fed0132/users/b0b04eae45014585a0fb2205adf946c8/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:46:51.440257 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dbfc8-adb5-4dc5-b290-026dc01bd413 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:51.440257 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dbfc8-adb5-4dc5-b290-026dc01bd413 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:51.440257 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dbfc8-adb5-4dc5-b290-026dc01bd413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:51.459839 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-946dbfc8-adb5-4dc5-b290-026dc01bd413 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:46:51.461097 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-946dbfc8-adb5-4dc5-b290-026dc01bd413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:46:51.475208 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 782/1570] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:46:51 2022] PUT /identity/v3/projects/c81233e4f35945fb8c15540b49467cb5/users/6941aca70b38449e89a0057eefd7355f/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:46:51.476948 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4dc46-c179-4deb-923d-bef502f5bbde None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:51.476948 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4dc46-c179-4deb-923d-bef502f5bbde None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:51.477280 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4dc46-c179-4deb-923d-bef502f5bbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:51.499572 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-9ba4dc46-c179-4deb-923d-bef502f5bbde None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:46:51.501518 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9ba4dc46-c179-4deb-923d-bef502f5bbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:46:51.537213 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 789/1571] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:46:51.538579 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946dbfc8-adb5-4dc5-b290-026dc01bd413 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:51.556663 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946dbfc8-adb5-4dc5-b290-026dc01bd413 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:51.592762 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 783/1572] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:46:51.597508 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4dc46-c179-4deb-923d-bef502f5bbde None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:51.608580 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4dc46-c179-4deb-923d-bef502f5bbde None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:51.614376 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dff60d-6269-4e29-87ef-78b27607d0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:51.617814 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dff60d-6269-4e29-87ef-78b27607d0f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:51.617814 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dff60d-6269-4e29-87ef-78b27607d0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:51.617814 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dff60d-6269-4e29-87ef-78b27607d0f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:51.617814 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dff60d-6269-4e29-87ef-78b27607d0f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:51.618377 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dff60d-6269-4e29-87ef-78b27607d0f2 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:51.626600 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:46:51.634730 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634723ea-c052-4e18-b82e-5bf6bd85f767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:51.635553 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634723ea-c052-4e18-b82e-5bf6bd85f767 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:51.635876 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634723ea-c052-4e18-b82e-5bf6bd85f767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:51.636161 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634723ea-c052-4e18-b82e-5bf6bd85f767 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:51.636823 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634723ea-c052-4e18-b82e-5bf6bd85f767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:51.638823 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634723ea-c052-4e18-b82e-5bf6bd85f767 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:51.731465 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 784/1573] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:46:51 2022] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:46:51.732345 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dff60d-6269-4e29-87ef-78b27607d0f2 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:51.743494 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dff60d-6269-4e29-87ef-78b27607d0f2 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:51.749082 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af75d70-9dbd-4107-b521-4d365f80c404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:51.749718 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af75d70-9dbd-4107-b521-4d365f80c404 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:51.750586 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af75d70-9dbd-4107-b521-4d365f80c404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:51.750803 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af75d70-9dbd-4107-b521-4d365f80c404 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:51.751486 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af75d70-9dbd-4107-b521-4d365f80c404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:51.761433 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af75d70-9dbd-4107-b521-4d365f80c404 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:51.761610 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 790/1574] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:46:51 2022] POST /identity/v3/projects => generated 365 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:46:51.761610 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634723ea-c052-4e18-b82e-5bf6bd85f767 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:51.829774 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634723ea-c052-4e18-b82e-5bf6bd85f767 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:51.835729 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b72f96-7ea6-47bd-a8a6-56ed422fdf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:51.836409 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b72f96-7ea6-47bd-a8a6-56ed422fdf69 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:51.836735 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b72f96-7ea6-47bd-a8a6-56ed422fdf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:51.837055 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b72f96-7ea6-47bd-a8a6-56ed422fdf69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:51.837804 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b72f96-7ea6-47bd-a8a6-56ed422fdf69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:51.840448 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b72f96-7ea6-47bd-a8a6-56ed422fdf69 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:51.876655 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 785/1575] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:46:51 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:46:51.877975 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c73d1a-21a8-4407-bdbc-2807246481cb None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:51.878234 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c73d1a-21a8-4407-bdbc-2807246481cb None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:51.878513 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c73d1a-21a8-4407-bdbc-2807246481cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:51.899530 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-c7c73d1a-21a8-4407-bdbc-2807246481cb None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:46:51.900867 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c7c73d1a-21a8-4407-bdbc-2807246481cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:46:51.938518 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:46:51.949890 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 791/1576] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:46:51 2022] POST /identity/v3/projects => generated 377 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:46:51.953675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a35e2-4497-434e-a254-4575fced8afa None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:51.953675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a35e2-4497-434e-a254-4575fced8afa None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:51.953675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a35e2-4497-434e-a254-4575fced8afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:51.972636 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 786/1577] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:46:51.976620 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c73d1a-21a8-4407-bdbc-2807246481cb None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:51.979640 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f75a35e2-4497-434e-a254-4575fced8afa None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:46:51.981777 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f75a35e2-4497-434e-a254-4575fced8afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:46:51.985403 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c73d1a-21a8-4407-bdbc-2807246481cb None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:52.052823 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f981794-6961-4178-9632-0f02cbdcbd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:52.053464 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f981794-6961-4178-9632-0f02cbdcbd70 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:52.053751 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f981794-6961-4178-9632-0f02cbdcbd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:52.054045 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f981794-6961-4178-9632-0f02cbdcbd70 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:52.054707 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f981794-6961-4178-9632-0f02cbdcbd70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:46:52.055007 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f981794-6961-4178-9632-0f02cbdcbd70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:52.056763 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f981794-6961-4178-9632-0f02cbdcbd70 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:52.059257 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 792/1578] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:46:52.063123 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a35e2-4497-434e-a254-4575fced8afa None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:52.076822 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 787/1579] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:46:52.078748 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f981794-6961-4178-9632-0f02cbdcbd70 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:52.080235 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a35e2-4497-434e-a254-4575fced8afa None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:52.086025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fcded-c8f2-4798-8f8d-75441ad598f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:52.086755 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fcded-c8f2-4798-8f8d-75441ad598f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:52.087043 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fcded-c8f2-4798-8f8d-75441ad598f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:52.087363 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fcded-c8f2-4798-8f8d-75441ad598f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:52.088047 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66fcded-c8f2-4798-8f8d-75441ad598f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:46:52.088354 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66fcded-c8f2-4798-8f8d-75441ad598f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:52.090017 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66fcded-c8f2-4798-8f8d-75441ad598f2 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:52.093157 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f981794-6961-4178-9632-0f02cbdcbd70 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:52.098544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44522d-d227-42bf-8d72-884155858050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:52.099181 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44522d-d227-42bf-8d72-884155858050 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:52.099636 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44522d-d227-42bf-8d72-884155858050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:52.099915 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44522d-d227-42bf-8d72-884155858050 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:52.100580 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44522d-d227-42bf-8d72-884155858050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:52.102293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44522d-d227-42bf-8d72-884155858050 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:52.103115 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 793/1580] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:46:52.104083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fcded-c8f2-4798-8f8d-75441ad598f2 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:52.114283 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 788/1581] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:46:52.115198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44522d-d227-42bf-8d72-884155858050 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:52.115788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fcded-c8f2-4798-8f8d-75441ad598f2 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:52.121171 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a4a18-82ce-4c23-8399-f14be5578a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:52.121838 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a4a18-82ce-4c23-8399-f14be5578a51 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:52.122123 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a4a18-82ce-4c23-8399-f14be5578a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:52.122398 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a4a18-82ce-4c23-8399-f14be5578a51 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:52.123062 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a4a18-82ce-4c23-8399-f14be5578a51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:52.125664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a4a18-82ce-4c23-8399-f14be5578a51 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:52.126753 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44522d-d227-42bf-8d72-884155858050 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:52.131523 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd1e82-4131-4d23-b448-c6ee0bd21e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:52.132286 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd1e82-4131-4d23-b448-c6ee0bd21e12 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:52.132569 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd1e82-4131-4d23-b448-c6ee0bd21e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:52.132844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd1e82-4131-4d23-b448-c6ee0bd21e12 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:52.133517 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd1e82-4131-4d23-b448-c6ee0bd21e12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:52.135566 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd1e82-4131-4d23-b448-c6ee0bd21e12 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:52.230034 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 794/1582] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:46:52 2022] POST /identity/v3/users => generated 283 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:46:52.230966 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a4a18-82ce-4c23-8399-f14be5578a51 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:52.242440 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 789/1583] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:46:52 2022] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:46:52.242440 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd1e82-4131-4d23-b448-c6ee0bd21e12 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:52.247027 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a4a18-82ce-4c23-8399-f14be5578a51 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:52.253004 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cec80f-e677-4e4b-aadb-797e4124a438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:52.253759 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cec80f-e677-4e4b-aadb-797e4124a438 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:52.254027 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cec80f-e677-4e4b-aadb-797e4124a438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:52.254307 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cec80f-e677-4e4b-aadb-797e4124a438 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:52.255018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cec80f-e677-4e4b-aadb-797e4124a438 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:52.257644 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cec80f-e677-4e4b-aadb-797e4124a438 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:52.317276 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd1e82-4131-4d23-b448-c6ee0bd21e12 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:52.321473 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59270a61-566a-4000-9b39-8104c393cacb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:52.322107 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59270a61-566a-4000-9b39-8104c393cacb service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:52.322392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59270a61-566a-4000-9b39-8104c393cacb service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:52.322669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59270a61-566a-4000-9b39-8104c393cacb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:52.334086 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59270a61-566a-4000-9b39-8104c393cacb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:52.335638 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59270a61-566a-4000-9b39-8104c393cacb service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:52.347394 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 790/1584] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:46:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:46:52.348359 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59270a61-566a-4000-9b39-8104c393cacb service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:52.357353 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59270a61-566a-4000-9b39-8104c393cacb service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:52.362066 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73b919-18e4-4ba3-9391-7e756aa20eb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:52.371935 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73b919-18e4-4ba3-9391-7e756aa20eb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:52.371935 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73b919-18e4-4ba3-9391-7e756aa20eb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:52.371935 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73b919-18e4-4ba3-9391-7e756aa20eb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:52.372452 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 795/1585] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:46:52 2022] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:46:52.372452 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cec80f-e677-4e4b-aadb-797e4124a438 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:52.380588 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cec80f-e677-4e4b-aadb-797e4124a438 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:52.381184 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73b919-18e4-4ba3-9391-7e756aa20eb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:52.382652 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73b919-18e4-4ba3-9391-7e756aa20eb0 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:52.385501 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28b518-90f5-4241-a323-34b13cb78466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:52.386419 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28b518-90f5-4241-a323-34b13cb78466 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:52.386720 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28b518-90f5-4241-a323-34b13cb78466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:52.386999 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28b518-90f5-4241-a323-34b13cb78466 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:52.387698 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28b518-90f5-4241-a323-34b13cb78466 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:52.389685 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28b518-90f5-4241-a323-34b13cb78466 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:52.394762 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 791/1586] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:46:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:46:52.395719 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73b919-18e4-4ba3-9391-7e756aa20eb0 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:52.408649 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73b919-18e4-4ba3-9391-7e756aa20eb0 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:52.410446 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:46:52.413459 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231ffe6-ca20-4ae5-895d-55687e09050a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:52.414194 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231ffe6-ca20-4ae5-895d-55687e09050a admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:52.414555 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231ffe6-ca20-4ae5-895d-55687e09050a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:52.414883 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231ffe6-ca20-4ae5-895d-55687e09050a admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:52.415724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231ffe6-ca20-4ae5-895d-55687e09050a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:52.417802 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231ffe6-ca20-4ae5-895d-55687e09050a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:52.490343 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 796/1587] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:46:52 2022] POST /identity/v3/projects => generated 391 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:46:52.491229 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28b518-90f5-4241-a323-34b13cb78466 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:52.516940 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 792/1588] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:46:52 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:46:52.518315 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231ffe6-ca20-4ae5-895d-55687e09050a admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:52.536330 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:46:52.615082 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28b518-90f5-4241-a323-34b13cb78466 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:52.646691 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231ffe6-ca20-4ae5-895d-55687e09050a admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:52.655416 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba749b4-fea0-4bc5-911c-0d836b798991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:52.663557 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba749b4-fea0-4bc5-911c-0d836b798991 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:52.663557 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba749b4-fea0-4bc5-911c-0d836b798991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:52.663557 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba749b4-fea0-4bc5-911c-0d836b798991 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:52.663557 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba749b4-fea0-4bc5-911c-0d836b798991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:52.663557 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba749b4-fea0-4bc5-911c-0d836b798991 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:52.682979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 793/1589] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:46:52.684729 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba749b4-fea0-4bc5-911c-0d836b798991 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:52.702805 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd821b-1dc4-4ffc-84ed-8f357e42b1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:52.702805 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd821b-1dc4-4ffc-84ed-8f357e42b1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:52.702805 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd821b-1dc4-4ffc-84ed-8f357e42b1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:52.702805 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd821b-1dc4-4ffc-84ed-8f357e42b1c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:52.704655 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd821b-1dc4-4ffc-84ed-8f357e42b1c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:52.704655 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd821b-1dc4-4ffc-84ed-8f357e42b1c7 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:52.708417 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba749b4-fea0-4bc5-911c-0d836b798991 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:52.727990 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0973d13-0281-4e10-86dd-28a22e2ee6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:52.728293 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 797/1590] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:46:52.728465 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0973d13-0281-4e10-86dd-28a22e2ee6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:52.728465 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0973d13-0281-4e10-86dd-28a22e2ee6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:52.728465 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0973d13-0281-4e10-86dd-28a22e2ee6c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:52.731749 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd821b-1dc4-4ffc-84ed-8f357e42b1c7 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:52.731910 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0973d13-0281-4e10-86dd-28a22e2ee6c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:52.731910 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0973d13-0281-4e10-86dd-28a22e2ee6c9 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:52.741771 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 794/1591] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:46:52.743171 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd821b-1dc4-4ffc-84ed-8f357e42b1c7 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:52.746297 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0973d13-0281-4e10-86dd-28a22e2ee6c9 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:52.751296 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfc9a6-c575-4d33-91da-62034f21e808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:52.752233 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfc9a6-c575-4d33-91da-62034f21e808 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:52.752447 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfc9a6-c575-4d33-91da-62034f21e808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:52.752629 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfc9a6-c575-4d33-91da-62034f21e808 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:52.753461 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acfc9a6-c575-4d33-91da-62034f21e808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:52.755390 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acfc9a6-c575-4d33-91da-62034f21e808 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:52.760585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0973d13-0281-4e10-86dd-28a22e2ee6c9 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:52.768481 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 798/1592] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:46:52.769664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfc9a6-c575-4d33-91da-62034f21e808 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:52.774732 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd20e4-a98c-4342-9cef-2f18cabbf2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:52.775800 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd20e4-a98c-4342-9cef-2f18cabbf2f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:52.776202 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd20e4-a98c-4342-9cef-2f18cabbf2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:52.776581 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd20e4-a98c-4342-9cef-2f18cabbf2f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:52.777700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd20e4-a98c-4342-9cef-2f18cabbf2f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:52.780575 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd20e4-a98c-4342-9cef-2f18cabbf2f6 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:52.782845 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfc9a6-c575-4d33-91da-62034f21e808 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:52.789248 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841e2d6-affe-47e0-88a3-fda533664d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:52.790846 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841e2d6-affe-47e0-88a3-fda533664d14 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:52.790846 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841e2d6-affe-47e0-88a3-fda533664d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:52.791209 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841e2d6-affe-47e0-88a3-fda533664d14 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:52.792327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d841e2d6-affe-47e0-88a3-fda533664d14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:52.795492 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d841e2d6-affe-47e0-88a3-fda533664d14 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:52.907228 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 795/1593] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:46:52 2022] POST /identity/v3/users => generated 296 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:46:52.907228 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd20e4-a98c-4342-9cef-2f18cabbf2f6 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:52.908469 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd20e4-a98c-4342-9cef-2f18cabbf2f6 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:52.914579 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fd0cc-b528-4f34-ab22-c60a5161d161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:52.915606 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fd0cc-b528-4f34-ab22-c60a5161d161 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:52.916069 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fd0cc-b528-4f34-ab22-c60a5161d161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:52.916493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fd0cc-b528-4f34-ab22-c60a5161d161 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:52.917560 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0fd0cc-b528-4f34-ab22-c60a5161d161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:52.920444 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0fd0cc-b528-4f34-ab22-c60a5161d161 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:52.933833 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 796/1594] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:46:52.934774 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fd0cc-b528-4f34-ab22-c60a5161d161 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:52.947012 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fd0cc-b528-4f34-ab22-c60a5161d161 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:52.952524 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8ecbb-1c5c-4ee4-b669-54c3276578fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:52.954139 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8ecbb-1c5c-4ee4-b669-54c3276578fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:52.954448 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8ecbb-1c5c-4ee4-b669-54c3276578fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:52.954729 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8ecbb-1c5c-4ee4-b669-54c3276578fd admin admin] PATH_INFO: `/v3/projects/853424302e384abf9e4b188c5850a321/users/64ee405803044ca2af45c63149184891/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:52.978979 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 799/1595] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:46:52 2022] POST /identity/v3/users => generated 290 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:46:52.981594 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841e2d6-affe-47e0-88a3-fda533664d14 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:52.983600 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8ecbb-1c5c-4ee4-b669-54c3276578fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=853424302e384abf9e4b188c5850a321, user_id=64ee405803044ca2af45c63149184891, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:52.989728 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8ecbb-1c5c-4ee4-b669-54c3276578fd admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:53.001312 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841e2d6-affe-47e0-88a3-fda533664d14 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:53.009708 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d6a5b-16f6-4e5f-b5c3-5e95ffd3a3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:53.010793 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d6a5b-16f6-4e5f-b5c3-5e95ffd3a3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:53.011277 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d6a5b-16f6-4e5f-b5c3-5e95ffd3a3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:53.011774 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d6a5b-16f6-4e5f-b5c3-5e95ffd3a3b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:53.012886 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d6a5b-16f6-4e5f-b5c3-5e95ffd3a3b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:53.016598 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d6a5b-16f6-4e5f-b5c3-5e95ffd3a3b7 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:53.038871 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 800/1596] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:46:53.039642 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d6a5b-16f6-4e5f-b5c3-5e95ffd3a3b7 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:53.057951 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d6a5b-16f6-4e5f-b5c3-5e95ffd3a3b7 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:53.066494 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3bd153-cdd0-4010-9327-13aa306c0325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:53.067611 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bd153-cdd0-4010-9327-13aa306c0325 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:53.068184 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bd153-cdd0-4010-9327-13aa306c0325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:53.068667 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bd153-cdd0-4010-9327-13aa306c0325 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:53.069880 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3bd153-cdd0-4010-9327-13aa306c0325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:53.073075 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3bd153-cdd0-4010-9327-13aa306c0325 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:53.074563 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 797/1597] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:46:52 2022] PUT /identity/v3/projects/853424302e384abf9e4b188c5850a321/users/64ee405803044ca2af45c63149184891/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:46:53.081600 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8ecbb-1c5c-4ee4-b669-54c3276578fd admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:53.097351 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 801/1598] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:46:53.099106 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3bd153-cdd0-4010-9327-13aa306c0325 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:53.120659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3bd153-cdd0-4010-9327-13aa306c0325 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:53.185183 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8ecbb-1c5c-4ee4-b669-54c3276578fd admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:53.190883 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba39fda-c8c6-4e5a-83b1-c120dfc51069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:53.191835 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba39fda-c8c6-4e5a-83b1-c120dfc51069 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:53.192402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba39fda-c8c6-4e5a-83b1-c120dfc51069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:53.192784 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba39fda-c8c6-4e5a-83b1-c120dfc51069 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:53.193874 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba39fda-c8c6-4e5a-83b1-c120dfc51069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:53.195951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba39fda-c8c6-4e5a-83b1-c120dfc51069 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:53.215970 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 798/1599] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:46:53.215970 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba39fda-c8c6-4e5a-83b1-c120dfc51069 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:53.226173 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:46:53.232834 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba39fda-c8c6-4e5a-83b1-c120dfc51069 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:53.248116 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf6bf2-143b-4497-88ca-2ba176164ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:53.256216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf6bf2-143b-4497-88ca-2ba176164ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:53.256216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf6bf2-143b-4497-88ca-2ba176164ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:53.256216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf6bf2-143b-4497-88ca-2ba176164ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:53.256216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf6bf2-143b-4497-88ca-2ba176164ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:53.256216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf6bf2-143b-4497-88ca-2ba176164ba6 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:53.264532 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4628d-a14f-408b-8564-7c1bfb0faccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:53.265474 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4628d-a14f-408b-8564-7c1bfb0faccf admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:53.269365 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4628d-a14f-408b-8564-7c1bfb0faccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:53.269365 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4628d-a14f-408b-8564-7c1bfb0faccf admin admin] PATH_INFO: `/v3/projects/7f0811772bbe44f78e833775f286eab1/users/c6d4dcb905ae4aeaad881c3f1c6e5d53/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:53.288505 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 799/1600] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:46:53.289628 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf6bf2-143b-4497-88ca-2ba176164ba6 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:53.300003 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4628d-a14f-408b-8564-7c1bfb0faccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f0811772bbe44f78e833775f286eab1, user_id=c6d4dcb905ae4aeaad881c3f1c6e5d53, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:53.306300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4628d-a14f-408b-8564-7c1bfb0faccf admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:53.308484 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf6bf2-143b-4497-88ca-2ba176164ba6 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:53.320296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf260cb-3be2-48d3-b4be-abcfe62c6c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:53.321144 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf260cb-3be2-48d3-b4be-abcfe62c6c31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:53.321432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf260cb-3be2-48d3-b4be-abcfe62c6c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:53.321715 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf260cb-3be2-48d3-b4be-abcfe62c6c31 admin admin] PATH_INFO: `/v3/projects/288b2db8b48248f88945a838d4c35e55/users/3dc26d44a618490c8419ec7cf03beee7/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:53.351008 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf260cb-3be2-48d3-b4be-abcfe62c6c31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=288b2db8b48248f88945a838d4c35e55, user_id=3dc26d44a618490c8419ec7cf03beee7, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:53.353985 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf260cb-3be2-48d3-b4be-abcfe62c6c31 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:53.395454 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 802/1601] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:46:53 2022] PUT /identity/v3/projects/7f0811772bbe44f78e833775f286eab1/users/c6d4dcb905ae4aeaad881c3f1c6e5d53/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:46:53.397105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345164c-7b89-449d-b3c3-7eee4b90960c None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:53.397397 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345164c-7b89-449d-b3c3-7eee4b90960c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:53.397681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345164c-7b89-449d-b3c3-7eee4b90960c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:53.421097 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-7345164c-7b89-449d-b3c3-7eee4b90960c None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:46:53.422626 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7345164c-7b89-449d-b3c3-7eee4b90960c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:46:53.499593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 800/1602] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:46:53 2022] PUT /identity/v3/projects/288b2db8b48248f88945a838d4c35e55/users/3dc26d44a618490c8419ec7cf03beee7/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:46:53.503590 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf260cb-3be2-48d3-b4be-abcfe62c6c31 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:53.513268 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:46:53.545538 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 803/1603] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:46:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:46:53.548499 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345164c-7b89-449d-b3c3-7eee4b90960c None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:53.591121 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345164c-7b89-449d-b3c3-7eee4b90960c None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:53.693319 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf260cb-3be2-48d3-b4be-abcfe62c6c31 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:53.704293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99af2a5-2a34-4903-9557-c4ded30145c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:53.704293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99af2a5-2a34-4903-9557-c4ded30145c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:53.704293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99af2a5-2a34-4903-9557-c4ded30145c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:53.704293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99af2a5-2a34-4903-9557-c4ded30145c7 admin admin] PATH_INFO: `/v3/projects/6a9dc48ca18740828d0757eafb227500/users/cf1cba65d61e45179dcc3aa3ba8391e6/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:53.739643 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99af2a5-2a34-4903-9557-c4ded30145c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a9dc48ca18740828d0757eafb227500, user_id=cf1cba65d61e45179dcc3aa3ba8391e6, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:53.744953 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99af2a5-2a34-4903-9557-c4ded30145c7 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:53.765717 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc9b0f-7efb-4f0b-9f06-7c06ebbfbcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:53.767729 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc9b0f-7efb-4f0b-9f06-7c06ebbfbcf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:53.767729 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc9b0f-7efb-4f0b-9f06-7c06ebbfbcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:53.768210 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc9b0f-7efb-4f0b-9f06-7c06ebbfbcf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:53.769373 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc9b0f-7efb-4f0b-9f06-7c06ebbfbcf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:53.772386 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc9b0f-7efb-4f0b-9f06-7c06ebbfbcf6 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:53.793324 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 804/1604] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:46:53.795065 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc9b0f-7efb-4f0b-9f06-7c06ebbfbcf6 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:53.815930 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc9b0f-7efb-4f0b-9f06-7c06ebbfbcf6 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:53.825109 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28379eec-e605-42ea-b933-35ff251d16cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:53.827450 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28379eec-e605-42ea-b933-35ff251d16cf admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:53.827450 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28379eec-e605-42ea-b933-35ff251d16cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:53.827450 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28379eec-e605-42ea-b933-35ff251d16cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:53.828492 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28379eec-e605-42ea-b933-35ff251d16cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:53.831929 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28379eec-e605-42ea-b933-35ff251d16cf admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:53.835047 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 801/1605] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:46:53 2022] PUT /identity/v3/projects/6a9dc48ca18740828d0757eafb227500/users/cf1cba65d61e45179dcc3aa3ba8391e6/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:46:53.843234 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0cd65-2750-4937-bb61-600e1ad79ffb None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:53.844450 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0cd65-2750-4937-bb61-600e1ad79ffb None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:53.844888 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0cd65-2750-4937-bb61-600e1ad79ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:53.855476 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 805/1606] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:46:53.858217 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d699d5-e554-476a-8cb0-7be811c4a9e3 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:53.858692 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d699d5-e554-476a-8cb0-7be811c4a9e3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:53.860070 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d699d5-e554-476a-8cb0-7be811c4a9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:53.891824 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-61e0cd65-2750-4937-bb61-600e1ad79ffb None None] MFA Rules not processed for user `c6d4dcb905ae4aeaad881c3f1c6e5d53`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:46:53.893338 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-61e0cd65-2750-4937-bb61-600e1ad79ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:46:53.900306 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-98d699d5-e554-476a-8cb0-7be811c4a9e3 None None] MFA Rules not processed for user `3dc26d44a618490c8419ec7cf03beee7`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:46:53.903196 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-98d699d5-e554-476a-8cb0-7be811c4a9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:46:53.999864 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:46:54.010253 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 802/1607] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:46:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:46:54.010253 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0cd65-2750-4937-bb61-600e1ad79ffb None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:54.048181 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 806/1608] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:46:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:46:54.050142 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d699d5-e554-476a-8cb0-7be811c4a9e3 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:54.129401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0cd65-2750-4937-bb61-600e1ad79ffb None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:54.136165 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6abf2e-8f0a-4acd-877f-1b3020898f7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:54.137110 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6abf2e-8f0a-4acd-877f-1b3020898f7f service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:54.137574 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6abf2e-8f0a-4acd-877f-1b3020898f7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:54.138031 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6abf2e-8f0a-4acd-877f-1b3020898f7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:54.202152 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d699d5-e554-476a-8cb0-7be811c4a9e3 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:54.212723 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:46:54.214383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e2ac9-39ac-40c2-b7f1-9d386a200afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:54.215780 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e2ac9-39ac-40c2-b7f1-9d386a200afd admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:54.216478 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e2ac9-39ac-40c2-b7f1-9d386a200afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:54.216977 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e2ac9-39ac-40c2-b7f1-9d386a200afd admin admin] PATH_INFO: `/v3/projects/5d3dc5f94d2048268514f90c903ccfb2/users/0c035b3b70c340bf9f52df64449adf5e/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:54.245131 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e2ac9-39ac-40c2-b7f1-9d386a200afd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d3dc5f94d2048268514f90c903ccfb2, user_id=0c035b3b70c340bf9f52df64449adf5e, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:54.250288 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e2ac9-39ac-40c2-b7f1-9d386a200afd admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:54.273613 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6abf2e-8f0a-4acd-877f-1b3020898f7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:54.276624 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6abf2e-8f0a-4acd-877f-1b3020898f7f service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:54.291866 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 803/1609] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:46:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:46:54.293088 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe13ae5-1e59-4c35-9ca4-a779f73bb6af None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:54.293478 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe13ae5-1e59-4c35-9ca4-a779f73bb6af None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:54.293656 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe13ae5-1e59-4c35-9ca4-a779f73bb6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:54.315044 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-afe13ae5-1e59-4c35-9ca4-a779f73bb6af None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:46:54.316371 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-afe13ae5-1e59-4c35-9ca4-a779f73bb6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:46:54.324822 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 804/1610] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:46:54.325728 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe13ae5-1e59-4c35-9ca4-a779f73bb6af None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:54.339935 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe13ae5-1e59-4c35-9ca4-a779f73bb6af None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:54.346059 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cb8a6-38ba-446e-a80e-ae27b7b592ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:54.346477 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cb8a6-38ba-446e-a80e-ae27b7b592ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:54.346767 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cb8a6-38ba-446e-a80e-ae27b7b592ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:54.347047 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cb8a6-38ba-446e-a80e-ae27b7b592ea admin admin] PATH_INFO: `/v3/projects/a2c90cf35e6840fc800f9d8674649bba/users/6ce02d906be24e7aa459f360a3e0d9c8/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:54.366051 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360cb8a6-38ba-446e-a80e-ae27b7b592ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2c90cf35e6840fc800f9d8674649bba, user_id=6ce02d906be24e7aa459f360a3e0d9c8, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:54.369162 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360cb8a6-38ba-446e-a80e-ae27b7b592ea admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:54.419329 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 807/1611] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:46:54 2022] PUT /identity/v3/projects/5d3dc5f94d2048268514f90c903ccfb2/users/0c035b3b70c340bf9f52df64449adf5e/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:46:54.420238 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e2ac9-39ac-40c2-b7f1-9d386a200afd admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:54.489396 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e2ac9-39ac-40c2-b7f1-9d386a200afd admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:54.495980 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3242123-a737-4664-8fd9-118ef17015ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:54.495980 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3242123-a737-4664-8fd9-118ef17015ea service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:54.495980 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3242123-a737-4664-8fd9-118ef17015ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:54.495980 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3242123-a737-4664-8fd9-118ef17015ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:54.576260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 805/1612] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:46:54 2022] PUT /identity/v3/projects/a2c90cf35e6840fc800f9d8674649bba/users/6ce02d906be24e7aa459f360a3e0d9c8/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:46:54.583292 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ee595-8cdb-4e1d-bfc7-5e0c443881e5 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:54.583835 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ee595-8cdb-4e1d-bfc7-5e0c443881e5 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:54.584318 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ee595-8cdb-4e1d-bfc7-5e0c443881e5 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:54.596768 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 806/1613] 10.222.0.26 () {54 vars in 962 bytes} [Sun Sep 11 08:46:54 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:46:54.596768 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ee595-8cdb-4e1d-bfc7-5e0c443881e5 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:54.598887 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-853ee595-8cdb-4e1d-bfc7-5e0c443881e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:46:54.680507 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3242123-a737-4664-8fd9-118ef17015ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:54.694132 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3242123-a737-4664-8fd9-118ef17015ea service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:54.736536 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 808/1614] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:46:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:46:54.743013 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd56fe-5322-4525-acdd-19266b681f38 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:54.743013 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd56fe-5322-4525-acdd-19266b681f38 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:54.743013 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd56fe-5322-4525-acdd-19266b681f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:54.799457 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ee595-8cdb-4e1d-bfc7-5e0c443881e5 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:54.804493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94b57d-bd03-487c-a512-f6c81ba24e75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:54.805676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94b57d-bd03-487c-a512-f6c81ba24e75 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:54.806026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94b57d-bd03-487c-a512-f6c81ba24e75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:54.806381 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94b57d-bd03-487c-a512-f6c81ba24e75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:54.808029 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-93dd56fe-5322-4525-acdd-19266b681f38 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:46:54.811205 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-93dd56fe-5322-4525-acdd-19266b681f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:46:54.875748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:46:54.903014 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94b57d-bd03-487c-a512-f6c81ba24e75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:54.904919 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94b57d-bd03-487c-a512-f6c81ba24e75 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:54.919841 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 807/1615] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:46:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:46:54.922354 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7ce26-8ab7-4d8f-9d11-b0eaccd7599e None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:54.922668 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7ce26-8ab7-4d8f-9d11-b0eaccd7599e None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:54.923207 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7ce26-8ab7-4d8f-9d11-b0eaccd7599e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:54.981095 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-7ad7ce26-8ab7-4d8f-9d11-b0eaccd7599e None None] MFA Rules not processed for user `e62bb9d2e13649b5af239bb56001ce16`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:46:54.982453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7ad7ce26-8ab7-4d8f-9d11-b0eaccd7599e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:46:55.036917 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:46:55.103403 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 809/1616] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:46:55.109954 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 808/1617] 10.222.0.26 () {58 vars in 1059 bytes} [Sun Sep 11 08:46:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:46:55.114025 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a7859-371c-473c-a740-b86d29d20697 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:55.114363 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a7859-371c-473c-a740-b86d29d20697 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:55.114470 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3dcd3-650e-40a9-bebc-0bc9166cb6ba None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:55.114570 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a7859-371c-473c-a740-b86d29d20697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:55.114924 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3dcd3-650e-40a9-bebc-0bc9166cb6ba None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:55.115444 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3dcd3-650e-40a9-bebc-0bc9166cb6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:55.177910 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-138a7859-371c-473c-a740-b86d29d20697 None None] MFA Rules not processed for user `6941aca70b38449e89a0057eefd7355f`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:46:55.179485 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-138a7859-371c-473c-a740-b86d29d20697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:46:55.196880 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-71b3dcd3-650e-40a9-bebc-0bc9166cb6ba None None] MFA Rules not processed for user `6ce02d906be24e7aa459f360a3e0d9c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:46:55.199193 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-71b3dcd3-650e-40a9-bebc-0bc9166cb6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:46:55.282627 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 809/1618] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:46:55 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:46:55.284220 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a7859-371c-473c-a740-b86d29d20697 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:55.300210 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a7859-371c-473c-a740-b86d29d20697 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:55.308272 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d241451-23d6-4175-bd6e-139133a40e81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:55.309260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d241451-23d6-4175-bd6e-139133a40e81 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:55.309417 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d241451-23d6-4175-bd6e-139133a40e81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:55.309728 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d241451-23d6-4175-bd6e-139133a40e81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:55.344842 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d241451-23d6-4175-bd6e-139133a40e81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:55.347582 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d241451-23d6-4175-bd6e-139133a40e81 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:55.363787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 810/1619] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:46:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:46:55.365246 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d241451-23d6-4175-bd6e-139133a40e81 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:55.415801 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d241451-23d6-4175-bd6e-139133a40e81 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:55.427225 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf679f6-43b3-4b8d-ae2d-70ba56e6d5f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:55.428708 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf679f6-43b3-4b8d-ae2d-70ba56e6d5f4 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:55.429006 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf679f6-43b3-4b8d-ae2d-70ba56e6d5f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:55.429291 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf679f6-43b3-4b8d-ae2d-70ba56e6d5f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:55.458287 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 810/1620] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:46:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:46:55.460092 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3dcd3-650e-40a9-bebc-0bc9166cb6ba None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:55.509579 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3dcd3-650e-40a9-bebc-0bc9166cb6ba None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:55.535837 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7b763-b3e2-4769-bcca-d6438d27fdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:55.536830 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7b763-b3e2-4769-bcca-d6438d27fdc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:55.537314 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7b763-b3e2-4769-bcca-d6438d27fdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:55.537793 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7b763-b3e2-4769-bcca-d6438d27fdc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:55.540055 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7b763-b3e2-4769-bcca-d6438d27fdc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:55.551907 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7b763-b3e2-4769-bcca-d6438d27fdc3 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:55.616157 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf679f6-43b3-4b8d-ae2d-70ba56e6d5f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:55.626062 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf679f6-43b3-4b8d-ae2d-70ba56e6d5f4 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:55.654782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 811/1621] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:46:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:46:55.657705 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf679f6-43b3-4b8d-ae2d-70ba56e6d5f4 service nova] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:55.692551 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf679f6-43b3-4b8d-ae2d-70ba56e6d5f4 service nova] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:55.705874 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b39a6-67c8-49ac-b81f-d7bfa04078fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:55.707440 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b39a6-67c8-49ac-b81f-d7bfa04078fc admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:55.708552 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b39a6-67c8-49ac-b81f-d7bfa04078fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:55.709224 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b39a6-67c8-49ac-b81f-d7bfa04078fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:55.710422 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b39a6-67c8-49ac-b81f-d7bfa04078fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:55.714528 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b39a6-67c8-49ac-b81f-d7bfa04078fc admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:55.740649 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 811/1622] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:46:55 2022] POST /identity/v3/projects => generated 403 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:46:55.746707 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7b763-b3e2-4769-bcca-d6438d27fdc3 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:55.917556 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7b763-b3e2-4769-bcca-d6438d27fdc3 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:55.951832 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 812/1623] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:46:55 2022] POST /identity/v3/projects => generated 379 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:46:55.958037 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730fdbeb-2be4-4093-9d26-f95cd029c1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:55.962836 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b39a6-67c8-49ac-b81f-d7bfa04078fc admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:55.963062 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fdbeb-2be4-4093-9d26-f95cd029c1e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:55.966353 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fdbeb-2be4-4093-9d26-f95cd029c1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:55.966871 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fdbeb-2be4-4093-9d26-f95cd029c1e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:55.972792 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730fdbeb-2be4-4093-9d26-f95cd029c1e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:55.990469 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730fdbeb-2be4-4093-9d26-f95cd029c1e1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:56.036898 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:46:56.189864 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 812/1624] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:46:55 2022] POST /identity/v3/users => generated 308 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:46:56.483926 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730fdbeb-2be4-4093-9d26-f95cd029c1e1 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:56.486922 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b39a6-67c8-49ac-b81f-d7bfa04078fc admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:56.488346 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730fdbeb-2be4-4093-9d26-f95cd029c1e1 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:56.490995 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5a910-9611-4c40-838b-f09b94b949a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:56.490995 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5a910-9611-4c40-838b-f09b94b949a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:56.490995 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5a910-9611-4c40-838b-f09b94b949a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:56.490995 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5a910-9611-4c40-838b-f09b94b949a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:56.491959 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5a910-9611-4c40-838b-f09b94b949a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:56.491959 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5a910-9611-4c40-838b-f09b94b949a4 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:56.492429 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83b8b9-c0d5-4e2a-9d7e-4ce4e6a80283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:56.492429 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83b8b9-c0d5-4e2a-9d7e-4ce4e6a80283 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:56.492429 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83b8b9-c0d5-4e2a-9d7e-4ce4e6a80283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:56.492429 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83b8b9-c0d5-4e2a-9d7e-4ce4e6a80283 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:56.493087 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a83b8b9-c0d5-4e2a-9d7e-4ce4e6a80283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:56.493087 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a83b8b9-c0d5-4e2a-9d7e-4ce4e6a80283 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:56.493087 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 813/1625] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:46:56.493087 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83b8b9-c0d5-4e2a-9d7e-4ce4e6a80283 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:56.493087 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83b8b9-c0d5-4e2a-9d7e-4ce4e6a80283 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:56.493814 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d86e57-b2d4-4920-9501-0e8fe8877e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:56.493814 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d86e57-b2d4-4920-9501-0e8fe8877e94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:56.493814 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d86e57-b2d4-4920-9501-0e8fe8877e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:56.493814 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d86e57-b2d4-4920-9501-0e8fe8877e94 admin admin] PATH_INFO: `/v3/projects/d4ffb8a09ecd44e0a70b21c5e6d80c21/users/353d46868c134a9198846f8a64518eb7/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:56.494297 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 813/1626] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:46:55 2022] POST /identity/v3/users => generated 296 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:46:56.494297 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5a910-9611-4c40-838b-f09b94b949a4 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:56.495056 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:46:56.495056 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d86e57-b2d4-4920-9501-0e8fe8877e94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4ffb8a09ecd44e0a70b21c5e6d80c21, user_id=353d46868c134a9198846f8a64518eb7, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:56.495056 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d86e57-b2d4-4920-9501-0e8fe8877e94 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:56.495430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5a910-9611-4c40-838b-f09b94b949a4 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:56.495430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32f961-28a2-49a2-a061-0c27e54ab157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:56.495430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32f961-28a2-49a2-a061-0c27e54ab157 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:56.495430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32f961-28a2-49a2-a061-0c27e54ab157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:56.496029 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32f961-28a2-49a2-a061-0c27e54ab157 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:56.496029 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32f961-28a2-49a2-a061-0c27e54ab157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:56.496029 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32f961-28a2-49a2-a061-0c27e54ab157 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:56.496029 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 814/1627] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:46:56.496029 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51093a2-1ff5-4674-a09f-cf7f2e50f61a None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:56.496029 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51093a2-1ff5-4674-a09f-cf7f2e50f61a None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:56.497743 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51093a2-1ff5-4674-a09f-cf7f2e50f61a None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:56.497743 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 815/1628] 10.222.0.26 () {54 vars in 912 bytes} [Sun Sep 11 08:46:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:46:56.497743 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51093a2-1ff5-4674-a09f-cf7f2e50f61a None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:56.524122 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51093a2-1ff5-4674-a09f-cf7f2e50f61a None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:56.542963 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f4713-306a-40a8-bef7-fe6b7748cd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:56.543772 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f4713-306a-40a8-bef7-fe6b7748cd5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:56.544088 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f4713-306a-40a8-bef7-fe6b7748cd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:56.544494 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f4713-306a-40a8-bef7-fe6b7748cd5f admin admin] PATH_INFO: `/v3/projects/13cd336c57524040af2c3c4f98ff784e/users/230936a0e17b4652b0ac44741e48a76e/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:56.552305 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 814/1629] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:46:56 2022] PUT /identity/v3/projects/d4ffb8a09ecd44e0a70b21c5e6d80c21/users/353d46868c134a9198846f8a64518eb7/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:46:56.556248 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b2deb-44ee-4883-99d1-2d2b90b16be6 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:56.556732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b2deb-44ee-4883-99d1-2d2b90b16be6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:56.558942 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b2deb-44ee-4883-99d1-2d2b90b16be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:56.625667 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f4713-306a-40a8-bef7-fe6b7748cd5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=13cd336c57524040af2c3c4f98ff784e, user_id=230936a0e17b4652b0ac44741e48a76e, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:56.634185 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f4713-306a-40a8-bef7-fe6b7748cd5f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:56.647811 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-cb4b2deb-44ee-4883-99d1-2d2b90b16be6 None None] MFA Rules not processed for user `e62bb9d2e13649b5af239bb56001ce16`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:46:56.649577 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-cb4b2deb-44ee-4883-99d1-2d2b90b16be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:46:56.768523 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 816/1630] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:46:56 2022] PUT /identity/v3/projects/13cd336c57524040af2c3c4f98ff784e/users/230936a0e17b4652b0ac44741e48a76e/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:46:56.771892 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 815/1631] 10.222.0.26 () {58 vars in 1009 bytes} [Sun Sep 11 08:46:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:46:56.773441 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b2deb-44ee-4883-99d1-2d2b90b16be6 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:56.776612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f4713-306a-40a8-bef7-fe6b7748cd5f admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:56.884263 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b2deb-44ee-4883-99d1-2d2b90b16be6 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:56.938821 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f4713-306a-40a8-bef7-fe6b7748cd5f admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:56.958252 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80906c5-a1f1-4772-bcc2-4a4587a68295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:56.958906 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80906c5-a1f1-4772-bcc2-4a4587a68295 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:56.959193 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80906c5-a1f1-4772-bcc2-4a4587a68295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:56.959502 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80906c5-a1f1-4772-bcc2-4a4587a68295 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:56.960176 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80906c5-a1f1-4772-bcc2-4a4587a68295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:56.962563 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80906c5-a1f1-4772-bcc2-4a4587a68295 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:56.991687 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 817/1632] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:46:56.992439 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80906c5-a1f1-4772-bcc2-4a4587a68295 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:57.054039 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ca1fa-fb99-444a-8f94-44ea3bef6080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:57.054876 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ca1fa-fb99-444a-8f94-44ea3bef6080 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:57.054986 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ca1fa-fb99-444a-8f94-44ea3bef6080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:57.056653 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ca1fa-fb99-444a-8f94-44ea3bef6080 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:57.057378 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ca1fa-fb99-444a-8f94-44ea3bef6080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:57.062085 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ca1fa-fb99-444a-8f94-44ea3bef6080 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:57.091511 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 816/1633] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:46:57.094877 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ca1fa-fb99-444a-8f94-44ea3bef6080 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:57.132285 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80906c5-a1f1-4772-bcc2-4a4587a68295 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:57.137004 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ca1fa-fb99-444a-8f94-44ea3bef6080 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:57.137404 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8177c8a-c1e0-450f-b825-7f20605c7efd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:57.138066 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8177c8a-c1e0-450f-b825-7f20605c7efd service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:57.138352 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8177c8a-c1e0-450f-b825-7f20605c7efd service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:57.138636 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8177c8a-c1e0-450f-b825-7f20605c7efd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:57.150460 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6740664-a453-4c0b-a5f9-3e10d1ea78de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:57.151586 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6740664-a453-4c0b-a5f9-3e10d1ea78de admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:57.153409 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6740664-a453-4c0b-a5f9-3e10d1ea78de admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:57.155198 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6740664-a453-4c0b-a5f9-3e10d1ea78de admin admin] PATH_INFO: `/v3/projects/d4ffb8a09ecd44e0a70b21c5e6d80c21/users/353d46868c134a9198846f8a64518eb7/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:57.162193 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6740664-a453-4c0b-a5f9-3e10d1ea78de admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4ffb8a09ecd44e0a70b21c5e6d80c21, user_id=353d46868c134a9198846f8a64518eb7, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:57.171067 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6740664-a453-4c0b-a5f9-3e10d1ea78de admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:57.175840 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:46:57.193976 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 817/1634] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:46:57 2022] PUT /identity/v3/projects/d4ffb8a09ecd44e0a70b21c5e6d80c21/users/353d46868c134a9198846f8a64518eb7/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:46:57.195103 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6740664-a453-4c0b-a5f9-3e10d1ea78de admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:57.257720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8177c8a-c1e0-450f-b825-7f20605c7efd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:57.259680 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8177c8a-c1e0-450f-b825-7f20605c7efd service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:57.274652 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 818/1635] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:46:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:46:57.378610 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6740664-a453-4c0b-a5f9-3e10d1ea78de admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:57.384977 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248dfa11-df95-46bc-880d-2cf0095da94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:57.386248 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248dfa11-df95-46bc-880d-2cf0095da94a admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:57.387100 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248dfa11-df95-46bc-880d-2cf0095da94a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:57.387748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248dfa11-df95-46bc-880d-2cf0095da94a admin admin] PATH_INFO: `/v3/projects/13cd336c57524040af2c3c4f98ff784e/users/230936a0e17b4652b0ac44741e48a76e/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:57.392654 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248dfa11-df95-46bc-880d-2cf0095da94a admin admin] RBAC: Authorizing `identity:create_grant(project_id=13cd336c57524040af2c3c4f98ff784e, user_id=230936a0e17b4652b0ac44741e48a76e, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:57.400255 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248dfa11-df95-46bc-880d-2cf0095da94a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:57.420807 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 818/1636] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:46:57 2022] PUT /identity/v3/projects/13cd336c57524040af2c3c4f98ff784e/users/230936a0e17b4652b0ac44741e48a76e/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:46:57.422179 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6352ce-7759-4257-b091-54f924127a08 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:57.422475 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6352ce-7759-4257-b091-54f924127a08 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:57.422768 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6352ce-7759-4257-b091-54f924127a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:57.481407 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:46:57.495276 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-2b6352ce-7759-4257-b091-54f924127a08 None None] MFA Rules not processed for user `230936a0e17b4652b0ac44741e48a76e`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:46:57.497941 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2b6352ce-7759-4257-b091-54f924127a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:46:57.676012 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 819/1637] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:46:57 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:46:57.737939 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248dfa11-df95-46bc-880d-2cf0095da94a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:57.850085 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248dfa11-df95-46bc-880d-2cf0095da94a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:57.863007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c132a-4bc3-4ba5-951c-3306406e5f94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:57.864405 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c132a-4bc3-4ba5-951c-3306406e5f94 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:57.864908 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c132a-4bc3-4ba5-951c-3306406e5f94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:57.865358 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c132a-4bc3-4ba5-951c-3306406e5f94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:57.892610 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c132a-4bc3-4ba5-951c-3306406e5f94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:57.909371 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c132a-4bc3-4ba5-951c-3306406e5f94 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:57.923271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 819/1638] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:46:57 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:46:58.524491 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6352ce-7759-4257-b091-54f924127a08 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:58.552975 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6352ce-7759-4257-b091-54f924127a08 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:58.559361 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a2762-bf23-445c-862d-f7e4bb38910d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:58.561347 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a2762-bf23-445c-862d-f7e4bb38910d service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:58.561793 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a2762-bf23-445c-862d-f7e4bb38910d service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:58.562230 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a2762-bf23-445c-862d-f7e4bb38910d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:58.776760 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a2762-bf23-445c-862d-f7e4bb38910d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:46:58.781394 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a2762-bf23-445c-862d-f7e4bb38910d service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:46:58.845359 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 820/1639] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:46:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:46:59.138836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f4bf4-0431-40f0-aa18-d12492ad8149 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:59.139675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f4bf4-0431-40f0-aa18-d12492ad8149 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:59.139675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f4bf4-0431-40f0-aa18-d12492ad8149 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:59.141419 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 820/1640] 10.222.0.26 () {54 vars in 962 bytes} [Sun Sep 11 08:46:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:46:59.155212 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6f76b-c44c-4834-939e-81563ee66dab None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:59.155776 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6f76b-c44c-4834-939e-81563ee66dab None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:59.163845 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6f76b-c44c-4834-939e-81563ee66dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:59.233941 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-88c6f76b-c44c-4834-939e-81563ee66dab None None] MFA Rules not processed for user `e62bb9d2e13649b5af239bb56001ce16`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:46:59.237911 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-88c6f76b-c44c-4834-939e-81563ee66dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:46:59.307395 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:46:59.484243 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 821/1641] 10.222.0.26 () {58 vars in 1059 bytes} [Sun Sep 11 08:46:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:46:59.487093 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782b221-255b-4e6e-bccd-b8c232f91750 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:59.487455 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782b221-255b-4e6e-bccd-b8c232f91750 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:59.487939 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782b221-255b-4e6e-bccd-b8c232f91750 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:59.489637 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 821/1642] 10.222.0.26 () {54 vars in 912 bytes} [Sun Sep 11 08:46:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:46:59.500142 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10a530-f23f-4ebb-a129-f391acdfbdcd None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:59.500983 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10a530-f23f-4ebb-a129-f391acdfbdcd None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:59.501599 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10a530-f23f-4ebb-a129-f391acdfbdcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:59.528407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-2e10a530-f23f-4ebb-a129-f391acdfbdcd None None] MFA Rules not processed for user `e62bb9d2e13649b5af239bb56001ce16`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:46:59.530232 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2e10a530-f23f-4ebb-a129-f391acdfbdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:46:59.548529 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 822/1643] 10.222.0.26 () {58 vars in 1009 bytes} [Sun Sep 11 08:46:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:46:59.905270 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0782b221-255b-4e6e-bccd-b8c232f91750 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:46:59.945100 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0782b221-255b-4e6e-bccd-b8c232f91750 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:46:59.956525 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5efe32-24bd-4dc3-91b9-b5d4a2d04949 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:46:59.957186 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5efe32-24bd-4dc3-91b9-b5d4a2d04949 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:46:59.959773 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5efe32-24bd-4dc3-91b9-b5d4a2d04949 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:46:59.960122 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5efe32-24bd-4dc3-91b9-b5d4a2d04949 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:46:59.999355 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5efe32-24bd-4dc3-91b9-b5d4a2d04949 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:00.001999 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5efe32-24bd-4dc3-91b9-b5d4a2d04949 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:00.030034 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 822/1644] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:46:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:47:01.696687 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884a444-ca85-4e02-b8ab-43f49990e3b8 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:01.697199 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884a444-ca85-4e02-b8ab-43f49990e3b8 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:01.697272 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884a444-ca85-4e02-b8ab-43f49990e3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:01.849783 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-2884a444-ca85-4e02-b8ab-43f49990e3b8 None None] MFA Rules not processed for user `353d46868c134a9198846f8a64518eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:01.851131 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2884a444-ca85-4e02-b8ab-43f49990e3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:02.096553 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 823/1645] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:01 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:47:02.929978 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5efe32-24bd-4dc3-91b9-b5d4a2d04949 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:03.156912 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5efe32-24bd-4dc3-91b9-b5d4a2d04949 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:03.164904 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a63b50-095e-40b4-a8c9-8c1ea4e5409e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:03.165831 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a63b50-095e-40b4-a8c9-8c1ea4e5409e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:03.166271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a63b50-095e-40b4-a8c9-8c1ea4e5409e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:03.168431 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a63b50-095e-40b4-a8c9-8c1ea4e5409e admin admin] PATH_INFO: `/v3/users/3dc26d44a618490c8419ec7cf03beee7` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:03.170115 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a63b50-095e-40b4-a8c9-8c1ea4e5409e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dc26d44a618490c8419ec7cf03beee7)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:03.172143 dv-cinder-856941-2-smb devstack@keystone.service[81644]: WARNING py.warnings [None req-10a63b50-095e-40b4-a8c9-8c1ea4e5409e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 08:47:03.172143 dv-cinder-856941-2-smb devstack@keystone.service[81644]: warnings.warn(msg) Sep 11 08:47:03.172143 dv-cinder-856941-2-smb devstack@keystone.service[81644]: Sep 11 08:47:03.174209 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a63b50-095e-40b4-a8c9-8c1ea4e5409e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:03.504599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:03.533332 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-10a63b50-095e-40b4-a8c9-8c1ea4e5409e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dc26d44a618490c8419ec7cf03beee7'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:03.678807 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-10a63b50-095e-40b4-a8c9-8c1ea4e5409e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dc26d44a618490c8419ec7cf03beee7'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:03.679842 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-10a63b50-095e-40b4-a8c9-8c1ea4e5409e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dc26d44a618490c8419ec7cf03beee7'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:03.680608 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-10a63b50-095e-40b4-a8c9-8c1ea4e5409e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dc26d44a618490c8419ec7cf03beee7'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:03.706352 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-10a63b50-095e-40b4-a8c9-8c1ea4e5409e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dc26d44a618490c8419ec7cf03beee7'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:03.780630 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 823/1646] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:47:02 2022] DELETE /identity/v3/users/3dc26d44a618490c8419ec7cf03beee7 => generated 0 bytes in 852 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:03.787146 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038019ea-cffa-4068-b891-4a4b23eba23d None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:03.787978 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038019ea-cffa-4068-b891-4a4b23eba23d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:03.787978 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038019ea-cffa-4068-b891-4a4b23eba23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:03.841507 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-038019ea-cffa-4068-b891-4a4b23eba23d None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:03.845742 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-038019ea-cffa-4068-b891-4a4b23eba23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:04.009220 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 824/1647] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:47:04.048328 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a63b50-095e-40b4-a8c9-8c1ea4e5409e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:04.050083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-10a63b50-095e-40b4-a8c9-8c1ea4e5409e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:04.204618 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a63b50-095e-40b4-a8c9-8c1ea4e5409e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:04.209132 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a099e8-5757-411c-b348-59927afac2bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:04.210157 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a099e8-5757-411c-b348-59927afac2bc service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:04.210456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a099e8-5757-411c-b348-59927afac2bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:04.210740 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a099e8-5757-411c-b348-59927afac2bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:04.268950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a099e8-5757-411c-b348-59927afac2bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:04.282230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a099e8-5757-411c-b348-59927afac2bc service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:04.316633 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 824/1648] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:47:05.478517 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af15e6-d491-41cb-867c-b852b2a61caa None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:05.480104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af15e6-d491-41cb-867c-b852b2a61caa None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:05.480795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af15e6-d491-41cb-867c-b852b2a61caa None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:05.483715 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 825/1649] 10.222.0.26 () {54 vars in 921 bytes} [Sun Sep 11 08:47:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:47:05.526784 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c809d-a157-4e39-a12e-8452ec90cdc8 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:05.528077 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c809d-a157-4e39-a12e-8452ec90cdc8 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:05.528585 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c809d-a157-4e39-a12e-8452ec90cdc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:05.641459 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-089c809d-a157-4e39-a12e-8452ec90cdc8 None None] MFA Rules not processed for user `a48c49f7a9f44cef89dd024fecea422f`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:05.668315 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-089c809d-a157-4e39-a12e-8452ec90cdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:05.992693 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 825/1650] 10.222.0.26 () {58 vars in 1018 bytes} [Sun Sep 11 08:47:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:06.041886 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af15e6-d491-41cb-867c-b852b2a61caa None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:06.045717 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-27af15e6-d491-41cb-867c-b852b2a61caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:06.129773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af15e6-d491-41cb-867c-b852b2a61caa None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:06.179364 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c582efd-34ae-4b3f-bd8f-c2758a283a3c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a48c49f7a9f44cef89dd024fecea422f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:06.183416 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c582efd-34ae-4b3f-bd8f-c2758a283a3c service placement] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:06.184321 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c582efd-34ae-4b3f-bd8f-c2758a283a3c service placement] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:06.185004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c582efd-34ae-4b3f-bd8f-c2758a283a3c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:06.207420 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c582efd-34ae-4b3f-bd8f-c2758a283a3c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:06.213121 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c582efd-34ae-4b3f-bd8f-c2758a283a3c service placement] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:06.242766 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 826/1651] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:47:08.361366 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809f7e7-df70-4aca-8f42-5a97ad948e67 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:08.362884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809f7e7-df70-4aca-8f42-5a97ad948e67 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:08.364096 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809f7e7-df70-4aca-8f42-5a97ad948e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:08.449520 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-0809f7e7-df70-4aca-8f42-5a97ad948e67 None None] MFA Rules not processed for user `b0b04eae45014585a0fb2205adf946c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:08.454285 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0809f7e7-df70-4aca-8f42-5a97ad948e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:08.550350 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c582efd-34ae-4b3f-bd8f-c2758a283a3c service placement] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:08.553845 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9c582efd-34ae-4b3f-bd8f-c2758a283a3c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:08.645254 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c582efd-34ae-4b3f-bd8f-c2758a283a3c service placement] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:08.682851 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70473e21-1f9f-4760-8f64-54d79fae6232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:08.695583 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70473e21-1f9f-4760-8f64-54d79fae6232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:08.701156 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70473e21-1f9f-4760-8f64-54d79fae6232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:08.702086 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70473e21-1f9f-4760-8f64-54d79fae6232 admin admin] PATH_INFO: `/v3/projects/288b2db8b48248f88945a838d4c35e55` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:08.708737 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70473e21-1f9f-4760-8f64-54d79fae6232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=288b2db8b48248f88945a838d4c35e55)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:08.714490 dv-cinder-856941-2-smb devstack@keystone.service[81645]: WARNING py.warnings [None req-70473e21-1f9f-4760-8f64-54d79fae6232 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 08:47:08.714490 dv-cinder-856941-2-smb devstack@keystone.service[81645]: warnings.warn(msg) Sep 11 08:47:08.714490 dv-cinder-856941-2-smb devstack@keystone.service[81645]: Sep 11 08:47:08.724054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70473e21-1f9f-4760-8f64-54d79fae6232 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:08.737411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:08.814734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 826/1652] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:08.832781 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809f7e7-df70-4aca-8f42-5a97ad948e67 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:08.837830 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0809f7e7-df70-4aca-8f42-5a97ad948e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:08.916687 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:09.026578 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809f7e7-df70-4aca-8f42-5a97ad948e67 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:09.076579 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-70473e21-1f9f-4760-8f64-54d79fae6232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '288b2db8b48248f88945a838d4c35e55', 'request_id': 'req-70473e21-1f9f-4760-8f64-54d79fae6232'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:09.127051 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-70473e21-1f9f-4760-8f64-54d79fae6232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '288b2db8b48248f88945a838d4c35e55', 'request_id': 'req-70473e21-1f9f-4760-8f64-54d79fae6232'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:09.241681 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-70473e21-1f9f-4760-8f64-54d79fae6232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '288b2db8b48248f88945a838d4c35e55', 'request_id': 'req-70473e21-1f9f-4760-8f64-54d79fae6232'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:09.292561 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372944f-ab6c-49e7-8f21-78fa9925bcb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:09.293488 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372944f-ab6c-49e7-8f21-78fa9925bcb6 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:09.293912 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372944f-ab6c-49e7-8f21-78fa9925bcb6 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:09.294329 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372944f-ab6c-49e7-8f21-78fa9925bcb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:09.361068 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-70473e21-1f9f-4760-8f64-54d79fae6232 admin admin] The token cache is being invalidate because project 288b2db8b48248f88945a838d4c35e55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:47:09.361611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-70473e21-1f9f-4760-8f64-54d79fae6232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:09.365325 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-70473e21-1f9f-4760-8f64-54d79fae6232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:09.374377 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 827/1653] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:47:08 2022] DELETE /identity/v3/projects/288b2db8b48248f88945a838d4c35e55 => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:47:09.380597 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4882e02-d02a-45e2-83e4-210495e919e0 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:09.381601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4882e02-d02a-45e2-83e4-210495e919e0 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:09.382116 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4882e02-d02a-45e2-83e4-210495e919e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:09.473178 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-c4882e02-d02a-45e2-83e4-210495e919e0 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:09.478914 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c4882e02-d02a-45e2-83e4-210495e919e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:09.520583 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372944f-ab6c-49e7-8f21-78fa9925bcb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:09.530268 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372944f-ab6c-49e7-8f21-78fa9925bcb6 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:09.560554 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 827/1654] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:08 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 728 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:47:09.636523 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 828/1655] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:47:09.641277 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21278ea-5b06-40ef-919b-d21e30298a4c None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:09.641786 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21278ea-5b06-40ef-919b-d21e30298a4c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:09.641921 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21278ea-5b06-40ef-919b-d21e30298a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:09.704624 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f21278ea-5b06-40ef-919b-d21e30298a4c None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:09.706591 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f21278ea-5b06-40ef-919b-d21e30298a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:09.744114 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 828/1656] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:09.751629 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4882e02-d02a-45e2-83e4-210495e919e0 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:09.765202 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4882e02-d02a-45e2-83e4-210495e919e0 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:09.781128 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc7061-5a69-4e24-80ea-a5e4c124499c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:09.781930 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc7061-5a69-4e24-80ea-a5e4c124499c admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:09.783887 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc7061-5a69-4e24-80ea-a5e4c124499c admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:09.784312 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc7061-5a69-4e24-80ea-a5e4c124499c admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:09.788194 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc7061-5a69-4e24-80ea-a5e4c124499c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:47:09.789873 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc7061-5a69-4e24-80ea-a5e4c124499c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:09.792225 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc7061-5a69-4e24-80ea-a5e4c124499c admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:09.830076 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 829/1657] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:47:09.856234 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21278ea-5b06-40ef-919b-d21e30298a4c None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:09.878938 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21278ea-5b06-40ef-919b-d21e30298a4c None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:09.908514 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248301e8-40d3-4077-9312-d2317fdd99c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:09.913668 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248301e8-40d3-4077-9312-d2317fdd99c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:09.914321 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248301e8-40d3-4077-9312-d2317fdd99c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:09.914821 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248301e8-40d3-4077-9312-d2317fdd99c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:09.919104 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248301e8-40d3-4077-9312-d2317fdd99c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:09.927810 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248301e8-40d3-4077-9312-d2317fdd99c2 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:10.143815 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc7061-5a69-4e24-80ea-a5e4c124499c admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:10.149761 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 829/1658] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:47:09 2022] POST /identity/v3/projects => generated 363 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:47:10.166513 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc7061-5a69-4e24-80ea-a5e4c124499c admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:10.283683 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec981f-a2ac-4a4f-b428-8cf351be2aa3 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:10.284181 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec981f-a2ac-4a4f-b428-8cf351be2aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:10.284944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec981f-a2ac-4a4f-b428-8cf351be2aa3 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:10.288055 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 830/1659] 10.222.0.26 () {54 vars in 921 bytes} [Sun Sep 11 08:47:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:47:10.332298 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7572a-55b2-4550-a62b-3464807aa672 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:10.333262 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7572a-55b2-4550-a62b-3464807aa672 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:10.333955 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7572a-55b2-4550-a62b-3464807aa672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:10.365800 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04aadd-ea06-4143-87c0-465bf16272e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:10.366467 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04aadd-ea06-4143-87c0-465bf16272e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:10.367501 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04aadd-ea06-4143-87c0-465bf16272e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:10.367804 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04aadd-ea06-4143-87c0-465bf16272e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:10.368494 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac04aadd-ea06-4143-87c0-465bf16272e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:10.380332 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac04aadd-ea06-4143-87c0-465bf16272e2 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:10.410751 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f3f7572a-55b2-4550-a62b-3464807aa672 None None] MFA Rules not processed for user `a48c49f7a9f44cef89dd024fecea422f`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:10.425792 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f3f7572a-55b2-4550-a62b-3464807aa672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:10.510638 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:10.562692 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 830/1660] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:47:10 2022] POST /identity/v3/users => generated 282 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:47:10.564206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04aadd-ea06-4143-87c0-465bf16272e2 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:10.566846 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ac04aadd-ea06-4143-87c0-465bf16272e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:10.599030 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 831/1661] 10.222.0.26 () {58 vars in 1018 bytes} [Sun Sep 11 08:47:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:10.606689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7572a-55b2-4550-a62b-3464807aa672 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:10.624138 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04aadd-ea06-4143-87c0-465bf16272e2 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:10.635654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34059cfc-d5d8-4435-8816-3dc7418bf0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:10.636670 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34059cfc-d5d8-4435-8816-3dc7418bf0b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:10.637800 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34059cfc-d5d8-4435-8816-3dc7418bf0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:10.638252 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34059cfc-d5d8-4435-8816-3dc7418bf0b4 admin admin] PATH_INFO: `/v3/users/6941aca70b38449e89a0057eefd7355f` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:10.642088 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34059cfc-d5d8-4435-8816-3dc7418bf0b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6941aca70b38449e89a0057eefd7355f)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:10.647632 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34059cfc-d5d8-4435-8816-3dc7418bf0b4 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:10.656038 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7572a-55b2-4550-a62b-3464807aa672 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:10.667697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e8079-58e6-497e-a54b-c9193078c835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:10.669289 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e8079-58e6-497e-a54b-c9193078c835 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:10.670091 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e8079-58e6-497e-a54b-c9193078c835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:10.670742 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e8079-58e6-497e-a54b-c9193078c835 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:10.672303 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e8079-58e6-497e-a54b-c9193078c835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:10.680025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e8079-58e6-497e-a54b-c9193078c835 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:10.717286 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 832/1662] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:47:10.721221 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e8079-58e6-497e-a54b-c9193078c835 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:10.726067 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-fd7e8079-58e6-497e-a54b-c9193078c835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:10.774141 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e8079-58e6-497e-a54b-c9193078c835 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:10.792932 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f14cb6-91f1-41f4-b1a6-5f082179d143 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a48c49f7a9f44cef89dd024fecea422f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:10.794314 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f14cb6-91f1-41f4-b1a6-5f082179d143 service placement] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:10.795192 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f14cb6-91f1-41f4-b1a6-5f082179d143 service placement] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:10.795949 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f14cb6-91f1-41f4-b1a6-5f082179d143 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:10.814733 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:10.855029 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f14cb6-91f1-41f4-b1a6-5f082179d143 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:10.869074 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f14cb6-91f1-41f4-b1a6-5f082179d143 service placement] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:10.932509 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 833/1663] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:47:10.935925 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f14cb6-91f1-41f4-b1a6-5f082179d143 service placement] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:10.985017 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f14cb6-91f1-41f4-b1a6-5f082179d143 service placement] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:11.009944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97890f4b-9b45-4026-b85e-b6ef6ec00808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:11.009944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97890f4b-9b45-4026-b85e-b6ef6ec00808 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:11.009944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97890f4b-9b45-4026-b85e-b6ef6ec00808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:11.009944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97890f4b-9b45-4026-b85e-b6ef6ec00808 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:11.011031 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97890f4b-9b45-4026-b85e-b6ef6ec00808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:11.019650 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97890f4b-9b45-4026-b85e-b6ef6ec00808 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:11.049964 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 834/1664] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:47:11.054910 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97890f4b-9b45-4026-b85e-b6ef6ec00808 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:11.059292 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-34059cfc-d5d8-4435-8816-3dc7418bf0b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6941aca70b38449e89a0057eefd7355f'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:11.063178 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-34059cfc-d5d8-4435-8816-3dc7418bf0b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6941aca70b38449e89a0057eefd7355f'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:11.078963 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97890f4b-9b45-4026-b85e-b6ef6ec00808 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:11.093273 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-34059cfc-d5d8-4435-8816-3dc7418bf0b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6941aca70b38449e89a0057eefd7355f'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:11.094292 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f235f98-4588-4837-9ee2-7f1222499085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:11.095055 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-34059cfc-d5d8-4435-8816-3dc7418bf0b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6941aca70b38449e89a0057eefd7355f'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:11.095365 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f235f98-4588-4837-9ee2-7f1222499085 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:11.095795 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f235f98-4588-4837-9ee2-7f1222499085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:11.096315 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f235f98-4588-4837-9ee2-7f1222499085 admin admin] PATH_INFO: `/v3/projects/5118ed5f23c94888a875a89de77c86c7/users/73efbbe378464a138d5fe39ecd3715b1/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:11.139636 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f235f98-4588-4837-9ee2-7f1222499085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5118ed5f23c94888a875a89de77c86c7, user_id=73efbbe378464a138d5fe39ecd3715b1, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:11.150450 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f235f98-4588-4837-9ee2-7f1222499085 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:11.232480 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-34059cfc-d5d8-4435-8816-3dc7418bf0b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6941aca70b38449e89a0057eefd7355f'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:11.304460 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 835/1665] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:47:11 2022] PUT /identity/v3/projects/5118ed5f23c94888a875a89de77c86c7/users/73efbbe378464a138d5fe39ecd3715b1/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:47:11.324466 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 831/1666] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:47:10 2022] DELETE /identity/v3/users/6941aca70b38449e89a0057eefd7355f => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:11.324727 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d0523-43fe-434c-8b68-1f6a0c11da8c None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:11.324727 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d0523-43fe-434c-8b68-1f6a0c11da8c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:11.324727 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d0523-43fe-434c-8b68-1f6a0c11da8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:11.404730 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-b71d0523-43fe-434c-8b68-1f6a0c11da8c None None] MFA Rules not processed for user `73efbbe378464a138d5fe39ecd3715b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:11.406629 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b71d0523-43fe-434c-8b68-1f6a0c11da8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:11.594843 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 836/1667] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:47:11.599971 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34059cfc-d5d8-4435-8816-3dc7418bf0b4 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:11.601782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-34059cfc-d5d8-4435-8816-3dc7418bf0b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:11.763404 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34059cfc-d5d8-4435-8816-3dc7418bf0b4 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:11.778830 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d4a9f-e7d6-4d52-8c4b-0d08e473bf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:11.782359 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d4a9f-e7d6-4d52-8c4b-0d08e473bf0a admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:11.783020 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d4a9f-e7d6-4d52-8c4b-0d08e473bf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:11.783623 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d4a9f-e7d6-4d52-8c4b-0d08e473bf0a admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:11.784974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d4a9f-e7d6-4d52-8c4b-0d08e473bf0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:11.793760 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d4a9f-e7d6-4d52-8c4b-0d08e473bf0a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:11.981955 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 832/1668] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:47:11 2022] POST /identity/v3/projects => generated 365 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:47:11.988469 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d0523-43fe-434c-8b68-1f6a0c11da8c None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:12.009641 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d0523-43fe-434c-8b68-1f6a0c11da8c None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:12.029500 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:12.192958 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124384c2-0f31-4080-af75-310dcb54033b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:12.196806 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124384c2-0f31-4080-af75-310dcb54033b admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:12.199116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124384c2-0f31-4080-af75-310dcb54033b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:12.199916 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124384c2-0f31-4080-af75-310dcb54033b admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:12.201549 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124384c2-0f31-4080-af75-310dcb54033b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:12.220935 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124384c2-0f31-4080-af75-310dcb54033b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:12.388616 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d4a9f-e7d6-4d52-8c4b-0d08e473bf0a admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:12.403329 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 837/1669] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:47:11 2022] POST /identity/v3/users => generated 289 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:47:12.417847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d4a9f-e7d6-4d52-8c4b-0d08e473bf0a admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:12.434770 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c2f56-3677-449f-a36c-1468f59dd4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:12.439362 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c2f56-3677-449f-a36c-1468f59dd4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:12.441552 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c2f56-3677-449f-a36c-1468f59dd4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:12.442751 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c2f56-3677-449f-a36c-1468f59dd4b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:12.448178 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c2f56-3677-449f-a36c-1468f59dd4b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:12.453857 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c2f56-3677-449f-a36c-1468f59dd4b3 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:12.503623 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 833/1670] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:47:12.510889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124384c2-0f31-4080-af75-310dcb54033b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:12.545292 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124384c2-0f31-4080-af75-310dcb54033b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:12.573480 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab988e94-3bbd-4cad-a1a0-522c00fb5617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:12.576684 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab988e94-3bbd-4cad-a1a0-522c00fb5617 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:12.582892 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab988e94-3bbd-4cad-a1a0-522c00fb5617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:12.585123 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab988e94-3bbd-4cad-a1a0-522c00fb5617 admin admin] PATH_INFO: `/v3/projects/127ca2b1443c4fd288caa851b135a3e3/users/957ce61a2d8d43899f55ac10ec3f02cd/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:12.653864 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab988e94-3bbd-4cad-a1a0-522c00fb5617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=127ca2b1443c4fd288caa851b135a3e3, user_id=957ce61a2d8d43899f55ac10ec3f02cd, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:12.659810 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab988e94-3bbd-4cad-a1a0-522c00fb5617 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:12.857950 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c2f56-3677-449f-a36c-1468f59dd4b3 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:12.861107 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-cd6c2f56-3677-449f-a36c-1468f59dd4b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:12.908010 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c2f56-3677-449f-a36c-1468f59dd4b3 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:12.922178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 838/1671] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:47:12 2022] PUT /identity/v3/projects/127ca2b1443c4fd288caa851b135a3e3/users/957ce61a2d8d43899f55ac10ec3f02cd/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:12.923799 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab988e94-3bbd-4cad-a1a0-522c00fb5617 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:13.046824 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561b283-53a7-4fa1-84ef-fdd17f550cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:13.047634 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561b283-53a7-4fa1-84ef-fdd17f550cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:13.047923 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561b283-53a7-4fa1-84ef-fdd17f550cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:13.048272 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561b283-53a7-4fa1-84ef-fdd17f550cd1 admin admin] PATH_INFO: `/v3/projects/c81233e4f35945fb8c15540b49467cb5` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:13.049783 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561b283-53a7-4fa1-84ef-fdd17f550cd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c81233e4f35945fb8c15540b49467cb5)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:13.052010 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561b283-53a7-4fa1-84ef-fdd17f550cd1 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:13.177314 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab988e94-3bbd-4cad-a1a0-522c00fb5617 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:13.208386 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552be829-9fb6-462a-baa5-7a3eaa329a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:13.209489 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552be829-9fb6-462a-baa5-7a3eaa329a99 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:13.209992 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552be829-9fb6-462a-baa5-7a3eaa329a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:13.210898 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552be829-9fb6-462a-baa5-7a3eaa329a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:13.212373 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552be829-9fb6-462a-baa5-7a3eaa329a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:13.215821 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552be829-9fb6-462a-baa5-7a3eaa329a99 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:13.242949 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2561b283-53a7-4fa1-84ef-fdd17f550cd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c81233e4f35945fb8c15540b49467cb5', 'request_id': 'req-2561b283-53a7-4fa1-84ef-fdd17f550cd1'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:13.260987 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2561b283-53a7-4fa1-84ef-fdd17f550cd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c81233e4f35945fb8c15540b49467cb5', 'request_id': 'req-2561b283-53a7-4fa1-84ef-fdd17f550cd1'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:13.271814 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 839/1672] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:47:13.273452 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552be829-9fb6-462a-baa5-7a3eaa329a99 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:13.320391 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552be829-9fb6-462a-baa5-7a3eaa329a99 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:13.404880 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2561b283-53a7-4fa1-84ef-fdd17f550cd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c81233e4f35945fb8c15540b49467cb5', 'request_id': 'req-2561b283-53a7-4fa1-84ef-fdd17f550cd1'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:13.430012 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:13.433059 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2561b283-53a7-4fa1-84ef-fdd17f550cd1 admin admin] The token cache is being invalidate because project c81233e4f35945fb8c15540b49467cb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:47:13.442073 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2561b283-53a7-4fa1-84ef-fdd17f550cd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:13.442073 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2561b283-53a7-4fa1-84ef-fdd17f550cd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:13.442073 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 834/1673] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:47:12 2022] DELETE /identity/v3/projects/c81233e4f35945fb8c15540b49467cb5 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:47:13.443794 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561b283-53a7-4fa1-84ef-fdd17f550cd1 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:13.447141 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2561b283-53a7-4fa1-84ef-fdd17f550cd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:13.482610 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0f66a-b8de-4eab-8084-93116f9e1345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:13.484042 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0f66a-b8de-4eab-8084-93116f9e1345 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:13.484777 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0f66a-b8de-4eab-8084-93116f9e1345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:13.485292 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0f66a-b8de-4eab-8084-93116f9e1345 admin admin] PATH_INFO: `/v3/projects/127ca2b1443c4fd288caa851b135a3e3/users/957ce61a2d8d43899f55ac10ec3f02cd/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:13.491289 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0f66a-b8de-4eab-8084-93116f9e1345 admin admin] RBAC: Authorizing `identity:create_grant(project_id=127ca2b1443c4fd288caa851b135a3e3, user_id=957ce61a2d8d43899f55ac10ec3f02cd, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:13.496635 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0f66a-b8de-4eab-8084-93116f9e1345 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:13.559943 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 840/1674] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:47:13 2022] PUT /identity/v3/projects/127ca2b1443c4fd288caa851b135a3e3/users/957ce61a2d8d43899f55ac10ec3f02cd/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:13.572763 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6820d-5f53-4c89-b14e-1e233d1badfc None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:13.579389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6820d-5f53-4c89-b14e-1e233d1badfc None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:13.579389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6820d-5f53-4c89-b14e-1e233d1badfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:13.638914 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-62c6820d-5f53-4c89-b14e-1e233d1badfc None None] MFA Rules not processed for user `957ce61a2d8d43899f55ac10ec3f02cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:13.641787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-62c6820d-5f53-4c89-b14e-1e233d1badfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:13.701009 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561b283-53a7-4fa1-84ef-fdd17f550cd1 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:13.913477 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 841/1675] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:13 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:13.919011 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6820d-5f53-4c89-b14e-1e233d1badfc None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:13.920536 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-62c6820d-5f53-4c89-b14e-1e233d1badfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:14.072863 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:14.090446 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6820d-5f53-4c89-b14e-1e233d1badfc None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:14.133539 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f4378-d87d-406b-8bd4-8860fed7d598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:14.135274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f4378-d87d-406b-8bd4-8860fed7d598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:14.137959 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f4378-d87d-406b-8bd4-8860fed7d598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:14.138897 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f4378-d87d-406b-8bd4-8860fed7d598 admin admin] PATH_INFO: `/v3/users/c6d4dcb905ae4aeaad881c3f1c6e5d53` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:14.145497 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ce854-47a4-4c6f-95d4-df8cbe613280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:14.146230 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ce854-47a4-4c6f-95d4-df8cbe613280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:14.153061 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ce854-47a4-4c6f-95d4-df8cbe613280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:14.153061 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ce854-47a4-4c6f-95d4-df8cbe613280 admin admin] PATH_INFO: `/v3/users/353d46868c134a9198846f8a64518eb7` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:14.153236 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f4378-d87d-406b-8bd4-8860fed7d598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6d4dcb905ae4aeaad881c3f1c6e5d53)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:14.153319 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ce854-47a4-4c6f-95d4-df8cbe613280 admin admin] RBAC: Authorizing `identity:delete_user(user_id=353d46868c134a9198846f8a64518eb7)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:14.158511 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ce854-47a4-4c6f-95d4-df8cbe613280 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:14.164932 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f4378-d87d-406b-8bd4-8860fed7d598 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:14.439480 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ff4ce854-47a4-4c6f-95d4-df8cbe613280 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '353d46868c134a9198846f8a64518eb7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:14.441687 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ff4ce854-47a4-4c6f-95d4-df8cbe613280 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '353d46868c134a9198846f8a64518eb7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:14.473181 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ff4ce854-47a4-4c6f-95d4-df8cbe613280 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '353d46868c134a9198846f8a64518eb7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:14.473898 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ff4ce854-47a4-4c6f-95d4-df8cbe613280 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '353d46868c134a9198846f8a64518eb7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:14.561026 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-466f4378-d87d-406b-8bd4-8860fed7d598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6d4dcb905ae4aeaad881c3f1c6e5d53'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:14.631359 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ff4ce854-47a4-4c6f-95d4-df8cbe613280 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '353d46868c134a9198846f8a64518eb7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:14.701539 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 835/1676] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:47:13 2022] DELETE /identity/v3/users/353d46868c134a9198846f8a64518eb7 => generated 0 bytes in 1256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:47:14.704499 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ce854-47a4-4c6f-95d4-df8cbe613280 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:14.715586 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ff4ce854-47a4-4c6f-95d4-df8cbe613280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:14.743200 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-466f4378-d87d-406b-8bd4-8860fed7d598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6d4dcb905ae4aeaad881c3f1c6e5d53'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:14.744228 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-466f4378-d87d-406b-8bd4-8860fed7d598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6d4dcb905ae4aeaad881c3f1c6e5d53'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:14.745557 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-466f4378-d87d-406b-8bd4-8860fed7d598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6d4dcb905ae4aeaad881c3f1c6e5d53'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:14.784522 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-466f4378-d87d-406b-8bd4-8860fed7d598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6d4dcb905ae4aeaad881c3f1c6e5d53'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:14.884288 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 842/1677] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:47:13 2022] DELETE /identity/v3/users/c6d4dcb905ae4aeaad881c3f1c6e5d53 => generated 0 bytes in 970 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:14.886400 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f4378-d87d-406b-8bd4-8860fed7d598 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:14.901798 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-466f4378-d87d-406b-8bd4-8860fed7d598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:15.118804 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ce854-47a4-4c6f-95d4-df8cbe613280 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:15.223514 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f4378-d87d-406b-8bd4-8860fed7d598 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:15.240930 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265dd3cf-aecd-49b7-8434-74ddee8d983d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:15.241954 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dd3cf-aecd-49b7-8434-74ddee8d983d service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:15.242391 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dd3cf-aecd-49b7-8434-74ddee8d983d service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:15.242837 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dd3cf-aecd-49b7-8434-74ddee8d983d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:15.246680 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-265dd3cf-aecd-49b7-8434-74ddee8d983d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:15.282345 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0960f-a2e8-4a4b-9b1a-670bfe95287a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:15.283667 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0960f-a2e8-4a4b-9b1a-670bfe95287a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:15.284222 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0960f-a2e8-4a4b-9b1a-670bfe95287a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:15.284640 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0960f-a2e8-4a4b-9b1a-670bfe95287a admin admin] PATH_INFO: `/v3/users/6ce02d906be24e7aa459f360a3e0d9c8` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:15.286804 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0960f-a2e8-4a4b-9b1a-670bfe95287a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ce02d906be24e7aa459f360a3e0d9c8)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:15.289612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0960f-a2e8-4a4b-9b1a-670bfe95287a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:15.417928 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:15.435044 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265dd3cf-aecd-49b7-8434-74ddee8d983d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:15.437485 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265dd3cf-aecd-49b7-8434-74ddee8d983d service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:15.456855 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 843/1678] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:14 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:47:15.458875 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aef2e3-bee7-4486-82dc-e47df75ba91e None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:15.459206 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aef2e3-bee7-4486-82dc-e47df75ba91e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:15.459725 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aef2e3-bee7-4486-82dc-e47df75ba91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:15.488495 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-22aef2e3-bee7-4486-82dc-e47df75ba91e None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:15.490388 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-22aef2e3-bee7-4486-82dc-e47df75ba91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:15.502984 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 844/1679] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:15.505136 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994950d8-ec48-4890-bfdd-6d85fb343636 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:15.506084 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994950d8-ec48-4890-bfdd-6d85fb343636 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:15.506930 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994950d8-ec48-4890-bfdd-6d85fb343636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:15.564119 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-994950d8-ec48-4890-bfdd-6d85fb343636 None None] MFA Rules not processed for user `64ee405803044ca2af45c63149184891`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:15.567399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-994950d8-ec48-4890-bfdd-6d85fb343636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:15.575089 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2db0960f-a2e8-4a4b-9b1a-670bfe95287a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ce02d906be24e7aa459f360a3e0d9c8'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:15.576940 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2db0960f-a2e8-4a4b-9b1a-670bfe95287a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ce02d906be24e7aa459f360a3e0d9c8'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:15.605065 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2db0960f-a2e8-4a4b-9b1a-670bfe95287a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ce02d906be24e7aa459f360a3e0d9c8'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:15.618427 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2db0960f-a2e8-4a4b-9b1a-670bfe95287a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ce02d906be24e7aa459f360a3e0d9c8'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:15.676529 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:15.703573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2db0960f-a2e8-4a4b-9b1a-670bfe95287a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ce02d906be24e7aa459f360a3e0d9c8'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:15.741282 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 836/1680] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:47:14 2022] DELETE /identity/v3/users/6ce02d906be24e7aa459f360a3e0d9c8 => generated 0 bytes in 1042 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:15.742901 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0960f-a2e8-4a4b-9b1a-670bfe95287a admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:15.761527 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2db0960f-a2e8-4a4b-9b1a-670bfe95287a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:15.838167 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 845/1681] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:15.839876 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d39e9-75ed-421e-bde6-39ed4e6c0aa8 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:15.840170 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d39e9-75ed-421e-bde6-39ed4e6c0aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:15.840450 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d39e9-75ed-421e-bde6-39ed4e6c0aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:15.919159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-1e4d39e9-75ed-421e-bde6-39ed4e6c0aa8 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:15.922530 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0960f-a2e8-4a4b-9b1a-670bfe95287a admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:15.922766 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1e4d39e9-75ed-421e-bde6-39ed4e6c0aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:15.954331 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec1a9e-1972-4fe9-b3ea-a220aaa52a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:15.955161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec1a9e-1972-4fe9-b3ea-a220aaa52a05 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:15.955621 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec1a9e-1972-4fe9-b3ea-a220aaa52a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:15.956000 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec1a9e-1972-4fe9-b3ea-a220aaa52a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:15.963083 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d8ec1a9e-1972-4fe9-b3ea-a220aaa52a05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:16.057118 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 846/1682] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:16.059273 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd1499-2fc4-40fc-a1cd-cf14f5b20ac7 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:16.059566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd1499-2fc4-40fc-a1cd-cf14f5b20ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:16.059848 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd1499-2fc4-40fc-a1cd-cf14f5b20ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:16.135476 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-6afd1499-2fc4-40fc-a1cd-cf14f5b20ac7 None None] MFA Rules not processed for user `64ee405803044ca2af45c63149184891`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:16.145754 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6afd1499-2fc4-40fc-a1cd-cf14f5b20ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:16.220814 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec1a9e-1972-4fe9-b3ea-a220aaa52a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:16.224270 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec1a9e-1972-4fe9-b3ea-a220aaa52a05 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:16.248774 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 837/1683] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:47:16.251437 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec1a9e-1972-4fe9-b3ea-a220aaa52a05 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:16.271029 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec1a9e-1972-4fe9-b3ea-a220aaa52a05 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:16.289318 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e398142-9fe7-4567-87e1-409e0549dfd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:16.289318 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e398142-9fe7-4567-87e1-409e0549dfd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:16.289318 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e398142-9fe7-4567-87e1-409e0549dfd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:16.289318 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e398142-9fe7-4567-87e1-409e0549dfd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:16.303658 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 847/1684] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:16.317526 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e398142-9fe7-4567-87e1-409e0549dfd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:16.319015 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e398142-9fe7-4567-87e1-409e0549dfd6 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:16.339042 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 838/1685] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:47:16.388228 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd1499-2fc4-40fc-a1cd-cf14f5b20ac7 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:16.390090 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6afd1499-2fc4-40fc-a1cd-cf14f5b20ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:16.625695 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd1499-2fc4-40fc-a1cd-cf14f5b20ac7 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:16.657974 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1894523-073e-4e94-b3e0-17f4a66638f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:16.659048 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1894523-073e-4e94-b3e0-17f4a66638f8 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:16.659844 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1894523-073e-4e94-b3e0-17f4a66638f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:16.660411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1894523-073e-4e94-b3e0-17f4a66638f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:16.740605 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1894523-073e-4e94-b3e0-17f4a66638f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:16.748546 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1894523-073e-4e94-b3e0-17f4a66638f8 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:16.817232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 848/1686] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:47:17.268563 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e398142-9fe7-4567-87e1-409e0549dfd6 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:17.270721 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-0e398142-9fe7-4567-87e1-409e0549dfd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:17.286276 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:17.298960 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e398142-9fe7-4567-87e1-409e0549dfd6 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:17.308563 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d08d51-d802-4769-9c83-480d18e880e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:17.310605 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d08d51-d802-4769-9c83-480d18e880e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:17.310605 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d08d51-d802-4769-9c83-480d18e880e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:17.310605 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d08d51-d802-4769-9c83-480d18e880e8 admin admin] PATH_INFO: `/v3/projects/d4ffb8a09ecd44e0a70b21c5e6d80c21` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:17.313011 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d08d51-d802-4769-9c83-480d18e880e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4ffb8a09ecd44e0a70b21c5e6d80c21)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:17.316143 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d08d51-d802-4769-9c83-480d18e880e8 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:17.573505 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-52d08d51-d802-4769-9c83-480d18e880e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4ffb8a09ecd44e0a70b21c5e6d80c21', 'request_id': 'req-52d08d51-d802-4769-9c83-480d18e880e8'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:17.592283 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-52d08d51-d802-4769-9c83-480d18e880e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4ffb8a09ecd44e0a70b21c5e6d80c21', 'request_id': 'req-52d08d51-d802-4769-9c83-480d18e880e8'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:17.680749 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1894523-073e-4e94-b3e0-17f4a66638f8 service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:17.682922 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b1894523-073e-4e94-b3e0-17f4a66638f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:17.741176 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-52d08d51-d802-4769-9c83-480d18e880e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4ffb8a09ecd44e0a70b21c5e6d80c21', 'request_id': 'req-52d08d51-d802-4769-9c83-480d18e880e8'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:17.751583 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1894523-073e-4e94-b3e0-17f4a66638f8 service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:17.777969 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-52d08d51-d802-4769-9c83-480d18e880e8 admin admin] The token cache is being invalidate because project d4ffb8a09ecd44e0a70b21c5e6d80c21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:47:17.783013 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:17.783906 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-52d08d51-d802-4769-9c83-480d18e880e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:17.786278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-52d08d51-d802-4769-9c83-480d18e880e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:17.788094 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 839/1687] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:47:17 2022] DELETE /identity/v3/projects/d4ffb8a09ecd44e0a70b21c5e6d80c21 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:17.794221 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e200fb-4ec3-403c-aa1c-6585a518a987 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:17.794675 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e200fb-4ec3-403c-aa1c-6585a518a987 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:17.795508 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e200fb-4ec3-403c-aa1c-6585a518a987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:17.877471 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-d1e200fb-4ec3-403c-aa1c-6585a518a987 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:17.879573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d1e200fb-4ec3-403c-aa1c-6585a518a987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:18.005377 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985f1cb-bbd3-4b1f-a276-e0c9391d7088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:18.007307 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985f1cb-bbd3-4b1f-a276-e0c9391d7088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:18.008023 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985f1cb-bbd3-4b1f-a276-e0c9391d7088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:18.008800 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985f1cb-bbd3-4b1f-a276-e0c9391d7088 admin admin] PATH_INFO: `/v3/users/73efbbe378464a138d5fe39ecd3715b1` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:18.014096 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985f1cb-bbd3-4b1f-a276-e0c9391d7088 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73efbbe378464a138d5fe39ecd3715b1)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:18.016504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985f1cb-bbd3-4b1f-a276-e0c9391d7088 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:18.094647 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:18.126429 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 840/1688] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:18.135924 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559d244-e4be-4da3-86b6-7f676ef191ed None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:18.136606 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559d244-e4be-4da3-86b6-7f676ef191ed None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:18.137038 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559d244-e4be-4da3-86b6-7f676ef191ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:18.176758 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-7559d244-e4be-4da3-86b6-7f676ef191ed None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:18.181397 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7559d244-e4be-4da3-86b6-7f676ef191ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:18.212517 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 841/1689] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:47:18.218034 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559d244-e4be-4da3-86b6-7f676ef191ed None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:18.255399 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559d244-e4be-4da3-86b6-7f676ef191ed None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:18.289431 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde45a1b-ff7e-49a8-94e1-64bdc2494b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:18.293994 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde45a1b-ff7e-49a8-94e1-64bdc2494b63 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:18.294294 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde45a1b-ff7e-49a8-94e1-64bdc2494b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:18.294580 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde45a1b-ff7e-49a8-94e1-64bdc2494b63 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:18.295337 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde45a1b-ff7e-49a8-94e1-64bdc2494b63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:47:18.295653 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde45a1b-ff7e-49a8-94e1-64bdc2494b63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:18.298547 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde45a1b-ff7e-49a8-94e1-64bdc2494b63 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:18.328504 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 842/1690] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:47:18.336647 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2985f1cb-bbd3-4b1f-a276-e0c9391d7088 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73efbbe378464a138d5fe39ecd3715b1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:18.337913 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde45a1b-ff7e-49a8-94e1-64bdc2494b63 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:18.370068 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde45a1b-ff7e-49a8-94e1-64bdc2494b63 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:18.386025 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2f621-5484-4f77-b3e3-32d0b4fc5754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:18.386743 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2f621-5484-4f77-b3e3-32d0b4fc5754 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:18.387032 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2f621-5484-4f77-b3e3-32d0b4fc5754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:18.387408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2f621-5484-4f77-b3e3-32d0b4fc5754 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:18.388153 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2f621-5484-4f77-b3e3-32d0b4fc5754 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:18.393520 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2f621-5484-4f77-b3e3-32d0b4fc5754 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:18.429439 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2985f1cb-bbd3-4b1f-a276-e0c9391d7088 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73efbbe378464a138d5fe39ecd3715b1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:18.430851 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2985f1cb-bbd3-4b1f-a276-e0c9391d7088 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73efbbe378464a138d5fe39ecd3715b1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:18.432377 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2985f1cb-bbd3-4b1f-a276-e0c9391d7088 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73efbbe378464a138d5fe39ecd3715b1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:18.481777 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2985f1cb-bbd3-4b1f-a276-e0c9391d7088 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73efbbe378464a138d5fe39ecd3715b1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:18.540410 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 849/1691] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:47:17 2022] DELETE /identity/v3/users/73efbbe378464a138d5fe39ecd3715b1 => generated 0 bytes in 856 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:18.545742 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097c3e5-41e0-4339-9db6-7306263a7972 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:18.546924 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097c3e5-41e0-4339-9db6-7306263a7972 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:18.547381 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097c3e5-41e0-4339-9db6-7306263a7972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:18.574229 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 843/1692] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:47:18 2022] POST /identity/v3/projects => generated 371 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:47:18.582094 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa82a9d-8c74-4a61-98ff-96f6f61772ab None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:18.582653 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa82a9d-8c74-4a61-98ff-96f6f61772ab None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:18.583474 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa82a9d-8c74-4a61-98ff-96f6f61772ab None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:18.585811 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 844/1693] 10.222.0.26 () {54 vars in 912 bytes} [Sun Sep 11 08:47:18 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:47:18.587172 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa82a9d-8c74-4a61-98ff-96f6f61772ab None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:18.589916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3fa82a9d-8c74-4a61-98ff-96f6f61772ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:18.612639 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e097c3e5-41e0-4339-9db6-7306263a7972 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:18.622298 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e097c3e5-41e0-4339-9db6-7306263a7972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:18.825045 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa82a9d-8c74-4a61-98ff-96f6f61772ab None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:18.840569 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab04672-a409-4afd-836f-dd1e96ba0bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:18.841621 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab04672-a409-4afd-836f-dd1e96ba0bcb admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:18.842109 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab04672-a409-4afd-836f-dd1e96ba0bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:18.842582 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab04672-a409-4afd-836f-dd1e96ba0bcb admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:18.843814 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab04672-a409-4afd-836f-dd1e96ba0bcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:18.847071 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab04672-a409-4afd-836f-dd1e96ba0bcb admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:18.908403 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 850/1694] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:18.912925 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c96d6-549b-44b3-b8ac-e73bd715075a None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:18.913636 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c96d6-549b-44b3-b8ac-e73bd715075a None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:18.914300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c96d6-549b-44b3-b8ac-e73bd715075a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:19.063897 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-bd6c96d6-549b-44b3-b8ac-e73bd715075a None None] MFA Rules not processed for user `7c86ca1e378c4042a1807c7a45aaab99`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:19.081730 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-bd6c96d6-549b-44b3-b8ac-e73bd715075a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:19.115962 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 845/1695] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:47:18 2022] POST /identity/v3/users => generated 286 bytes in 529 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:47:19.125858 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab04672-a409-4afd-836f-dd1e96ba0bcb admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:19.125858 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7ab04672-a409-4afd-836f-dd1e96ba0bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:19.285201 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab04672-a409-4afd-836f-dd1e96ba0bcb admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:19.291464 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 851/1696] 10.222.0.26 () {58 vars in 1009 bytes} [Sun Sep 11 08:47:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:19.292686 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c96d6-549b-44b3-b8ac-e73bd715075a None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:19.296331 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f3554-3981-4225-a917-2c3e22a33e63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:19.297893 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f3554-3981-4225-a917-2c3e22a33e63 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:19.298376 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f3554-3981-4225-a917-2c3e22a33e63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:19.298837 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f3554-3981-4225-a917-2c3e22a33e63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:19.321753 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f3554-3981-4225-a917-2c3e22a33e63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:19.323309 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f3554-3981-4225-a917-2c3e22a33e63 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:19.326212 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c96d6-549b-44b3-b8ac-e73bd715075a None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:19.335860 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac42ae-55c8-4a8c-8666-5fb76a999f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:19.336213 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac42ae-55c8-4a8c-8666-5fb76a999f6f admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:19.336592 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac42ae-55c8-4a8c-8666-5fb76a999f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:19.336741 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac42ae-55c8-4a8c-8666-5fb76a999f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:19.337353 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac42ae-55c8-4a8c-8666-5fb76a999f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:19.339100 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac42ae-55c8-4a8c-8666-5fb76a999f6f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:19.363759 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 852/1697] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:47:19.365063 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac42ae-55c8-4a8c-8666-5fb76a999f6f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:19.370169 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6eac42ae-55c8-4a8c-8666-5fb76a999f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:19.388150 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac42ae-55c8-4a8c-8666-5fb76a999f6f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:19.397223 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 846/1698] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:47:19.400936 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979dd160-d134-4c8f-a51a-830b1040cac3 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:19.402046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979dd160-d134-4c8f-a51a-830b1040cac3 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:19.402832 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979dd160-d134-4c8f-a51a-830b1040cac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:19.407928 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b96bf9-6e11-47f8-b8ec-9e78ae970e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:19.408949 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b96bf9-6e11-47f8-b8ec-9e78ae970e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:19.409504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b96bf9-6e11-47f8-b8ec-9e78ae970e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:19.410011 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b96bf9-6e11-47f8-b8ec-9e78ae970e8d admin admin] PATH_INFO: `/v3/projects/7f0811772bbe44f78e833775f286eab1` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:19.412316 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b96bf9-6e11-47f8-b8ec-9e78ae970e8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f0811772bbe44f78e833775f286eab1)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:19.419497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b96bf9-6e11-47f8-b8ec-9e78ae970e8d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:19.469659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:19.493816 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-979dd160-d134-4c8f-a51a-830b1040cac3 None None] MFA Rules not processed for user `0c035b3b70c340bf9f52df64449adf5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:19.497366 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-979dd160-d134-4c8f-a51a-830b1040cac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:19.624804 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a4b96bf9-6e11-47f8-b8ec-9e78ae970e8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f0811772bbe44f78e833775f286eab1', 'request_id': 'req-a4b96bf9-6e11-47f8-b8ec-9e78ae970e8d'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:19.645471 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:19.655416 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a4b96bf9-6e11-47f8-b8ec-9e78ae970e8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f0811772bbe44f78e833775f286eab1', 'request_id': 'req-a4b96bf9-6e11-47f8-b8ec-9e78ae970e8d'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:19.753254 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 847/1699] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:19.754692 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979dd160-d134-4c8f-a51a-830b1040cac3 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:19.756760 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-979dd160-d134-4c8f-a51a-830b1040cac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:19.787868 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979dd160-d134-4c8f-a51a-830b1040cac3 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:19.795538 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a4b96bf9-6e11-47f8-b8ec-9e78ae970e8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f0811772bbe44f78e833775f286eab1', 'request_id': 'req-a4b96bf9-6e11-47f8-b8ec-9e78ae970e8d'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:19.825462 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a4b96bf9-6e11-47f8-b8ec-9e78ae970e8d admin admin] The token cache is being invalidate because project 7f0811772bbe44f78e833775f286eab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:47:19.825759 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a4b96bf9-6e11-47f8-b8ec-9e78ae970e8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:19.827048 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a4b96bf9-6e11-47f8-b8ec-9e78ae970e8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:19.851332 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 853/1700] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:47:19 2022] DELETE /identity/v3/projects/7f0811772bbe44f78e833775f286eab1 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:19.852905 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b96bf9-6e11-47f8-b8ec-9e78ae970e8d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:19.861244 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a4b96bf9-6e11-47f8-b8ec-9e78ae970e8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:19.919537 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd95e4-64b3-45b7-ada2-0cbc0f43d025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:19.926558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd95e4-64b3-45b7-ada2-0cbc0f43d025 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:19.935528 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd95e4-64b3-45b7-ada2-0cbc0f43d025 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:19.941654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd95e4-64b3-45b7-ada2-0cbc0f43d025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:19.951606 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-56fd95e4-64b3-45b7-ada2-0cbc0f43d025 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:20.007683 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd95e4-64b3-45b7-ada2-0cbc0f43d025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:20.021543 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd95e4-64b3-45b7-ada2-0cbc0f43d025 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:20.051360 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 848/1701] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:47:20.053361 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd95e4-64b3-45b7-ada2-0cbc0f43d025 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:20.061619 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-56fd95e4-64b3-45b7-ada2-0cbc0f43d025 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:20.070169 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b96bf9-6e11-47f8-b8ec-9e78ae970e8d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:20.101633 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdffee7-0431-495a-9a4e-8ea473318bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:20.103364 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdffee7-0431-495a-9a4e-8ea473318bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:20.103925 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdffee7-0431-495a-9a4e-8ea473318bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:20.104390 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdffee7-0431-495a-9a4e-8ea473318bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:20.105308 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdffee7-0431-495a-9a4e-8ea473318bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:20.108826 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdffee7-0431-495a-9a4e-8ea473318bd8 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:20.125555 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd95e4-64b3-45b7-ada2-0cbc0f43d025 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:20.135885 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 854/1702] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:47:20.142669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f03070-9e1e-4e7a-8409-964038a0f37c None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:20.143036 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f03070-9e1e-4e7a-8409-964038a0f37c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:20.143469 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f03070-9e1e-4e7a-8409-964038a0f37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:20.151650 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133069fe-2309-400a-919c-6defe220a3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:20.153370 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133069fe-2309-400a-919c-6defe220a3a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:20.154171 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133069fe-2309-400a-919c-6defe220a3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:20.154984 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133069fe-2309-400a-919c-6defe220a3a2 admin admin] PATH_INFO: `/v3/projects/a2c90cf35e6840fc800f9d8674649bba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:20.160769 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133069fe-2309-400a-919c-6defe220a3a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2c90cf35e6840fc800f9d8674649bba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:20.166800 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133069fe-2309-400a-919c-6defe220a3a2 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:20.194159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-82f03070-9e1e-4e7a-8409-964038a0f37c None None] MFA Rules not processed for user `0c035b3b70c340bf9f52df64449adf5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:20.196063 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-82f03070-9e1e-4e7a-8409-964038a0f37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:20.452902 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-133069fe-2309-400a-919c-6defe220a3a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2c90cf35e6840fc800f9d8674649bba', 'request_id': 'req-133069fe-2309-400a-919c-6defe220a3a2'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:20.469443 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 855/1703] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:20.472598 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd07b92-a182-41cc-8e73-1514d4e6e8fe None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:20.473203 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd07b92-a182-41cc-8e73-1514d4e6e8fe None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:20.474233 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd07b92-a182-41cc-8e73-1514d4e6e8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:20.480264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-133069fe-2309-400a-919c-6defe220a3a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2c90cf35e6840fc800f9d8674649bba', 'request_id': 'req-133069fe-2309-400a-919c-6defe220a3a2'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:20.563094 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-1bd07b92-a182-41cc-8e73-1514d4e6e8fe None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:20.573821 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1bd07b92-a182-41cc-8e73-1514d4e6e8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:20.628199 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-133069fe-2309-400a-919c-6defe220a3a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2c90cf35e6840fc800f9d8674649bba', 'request_id': 'req-133069fe-2309-400a-919c-6defe220a3a2'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:20.647146 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-133069fe-2309-400a-919c-6defe220a3a2 admin admin] The token cache is being invalidate because project a2c90cf35e6840fc800f9d8674649bba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:47:20.647669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-133069fe-2309-400a-919c-6defe220a3a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:20.648876 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-133069fe-2309-400a-919c-6defe220a3a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:20.650794 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 849/1704] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:47:20 2022] DELETE /identity/v3/projects/a2c90cf35e6840fc800f9d8674649bba => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:20.651975 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133069fe-2309-400a-919c-6defe220a3a2 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:20.654037 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-133069fe-2309-400a-919c-6defe220a3a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:20.742485 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 856/1705] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:20.742485 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bbea5-f14b-4d45-a80c-11fde92b205b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:20.742485 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bbea5-f14b-4d45-a80c-11fde92b205b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:20.742485 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bbea5-f14b-4d45-a80c-11fde92b205b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:20.802430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133069fe-2309-400a-919c-6defe220a3a2 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:20.807836 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef6c45-21fc-4967-bce4-0e967568426a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:20.809353 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef6c45-21fc-4967-bce4-0e967568426a admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:20.809695 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef6c45-21fc-4967-bce4-0e967568426a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:20.810169 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef6c45-21fc-4967-bce4-0e967568426a admin admin] PATH_INFO: `/v3/projects/6af97c52aec644db9971a138c2142005/users/100695efc6a94e58ba270c7a81c26400/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:20.828989 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f48bbea5-f14b-4d45-a80c-11fde92b205b None None] MFA Rules not processed for user `cf1cba65d61e45179dcc3aa3ba8391e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:20.831145 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef6c45-21fc-4967-bce4-0e967568426a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af97c52aec644db9971a138c2142005, user_id=100695efc6a94e58ba270c7a81c26400, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:20.831690 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f48bbea5-f14b-4d45-a80c-11fde92b205b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:20.834587 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef6c45-21fc-4967-bce4-0e967568426a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:20.960890 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 850/1706] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:47:20 2022] PUT /identity/v3/projects/6af97c52aec644db9971a138c2142005/users/100695efc6a94e58ba270c7a81c26400/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:20.962262 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef6c45-21fc-4967-bce4-0e967568426a admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:20.972128 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e7ef6c45-21fc-4967-bce4-0e967568426a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:20.988904 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 857/1707] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:20.989958 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48bbea5-f14b-4d45-a80c-11fde92b205b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:20.993357 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f48bbea5-f14b-4d45-a80c-11fde92b205b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:21.027076 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48bbea5-f14b-4d45-a80c-11fde92b205b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:21.118923 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef6c45-21fc-4967-bce4-0e967568426a admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:21.127168 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a7104-89b3-4799-a5da-e89c1b4ce81f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:21.137292 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a7104-89b3-4799-a5da-e89c1b4ce81f service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:21.137782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a7104-89b3-4799-a5da-e89c1b4ce81f service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:21.138022 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a7104-89b3-4799-a5da-e89c1b4ce81f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:21.144587 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-986a7104-89b3-4799-a5da-e89c1b4ce81f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:21.173173 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd8398-4a50-43e1-9dd2-b22b01eea5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:21.174410 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd8398-4a50-43e1-9dd2-b22b01eea5db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:21.174888 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd8398-4a50-43e1-9dd2-b22b01eea5db admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:21.175426 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd8398-4a50-43e1-9dd2-b22b01eea5db admin admin] PATH_INFO: `/v3/users/230936a0e17b4652b0ac44741e48a76e` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:21.178077 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd8398-4a50-43e1-9dd2-b22b01eea5db admin admin] RBAC: Authorizing `identity:delete_user(user_id=230936a0e17b4652b0ac44741e48a76e)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:21.182544 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd8398-4a50-43e1-9dd2-b22b01eea5db admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:21.279703 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a7104-89b3-4799-a5da-e89c1b4ce81f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:21.282511 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a7104-89b3-4799-a5da-e89c1b4ce81f service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:21.298074 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 851/1708] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:20 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:47:21.299635 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98343bc-8149-40fe-82e7-5ef3df3d883b None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:21.299864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98343bc-8149-40fe-82e7-5ef3df3d883b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:21.300153 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98343bc-8149-40fe-82e7-5ef3df3d883b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:21.337576 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-a98343bc-8149-40fe-82e7-5ef3df3d883b None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:21.338879 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-a98343bc-8149-40fe-82e7-5ef3df3d883b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:21.364629 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 852/1709] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:21.365836 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98343bc-8149-40fe-82e7-5ef3df3d883b None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:21.367614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-a98343bc-8149-40fe-82e7-5ef3df3d883b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:21.402052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98343bc-8149-40fe-82e7-5ef3df3d883b None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:21.432086 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2220a-3dfb-4b92-993e-f8c9b9840165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:21.433233 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2220a-3dfb-4b92-993e-f8c9b9840165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:21.433738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2220a-3dfb-4b92-993e-f8c9b9840165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:21.434417 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2220a-3dfb-4b92-993e-f8c9b9840165 admin admin] PATH_INFO: `/v3/projects/5118ed5f23c94888a875a89de77c86c7` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:21.440295 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2220a-3dfb-4b92-993e-f8c9b9840165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5118ed5f23c94888a875a89de77c86c7)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:21.444442 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2220a-3dfb-4b92-993e-f8c9b9840165 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:21.450144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d0dd8398-4a50-43e1-9dd2-b22b01eea5db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '230936a0e17b4652b0ac44741e48a76e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:21.503354 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:21.526270 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d0dd8398-4a50-43e1-9dd2-b22b01eea5db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '230936a0e17b4652b0ac44741e48a76e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:21.527093 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d0dd8398-4a50-43e1-9dd2-b22b01eea5db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '230936a0e17b4652b0ac44741e48a76e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:21.528258 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d0dd8398-4a50-43e1-9dd2-b22b01eea5db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '230936a0e17b4652b0ac44741e48a76e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:21.543628 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d0dd8398-4a50-43e1-9dd2-b22b01eea5db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '230936a0e17b4652b0ac44741e48a76e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:21.588830 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 858/1710] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:47:20 2022] DELETE /identity/v3/users/230936a0e17b4652b0ac44741e48a76e => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:21.588830 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac416830-5d52-4f27-bec7-76348bae9662 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:21.588830 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac416830-5d52-4f27-bec7-76348bae9662 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:21.588830 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac416830-5d52-4f27-bec7-76348bae9662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:21.609544 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-ac416830-5d52-4f27-bec7-76348bae9662 None None] MFA Rules not processed for user `b0b04eae45014585a0fb2205adf946c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:21.610979 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ac416830-5d52-4f27-bec7-76348bae9662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:21.648581 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:21.756553 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c1e2220a-3dfb-4b92-993e-f8c9b9840165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5118ed5f23c94888a875a89de77c86c7', 'request_id': 'req-c1e2220a-3dfb-4b92-993e-f8c9b9840165'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:21.780003 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c1e2220a-3dfb-4b92-993e-f8c9b9840165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5118ed5f23c94888a875a89de77c86c7', 'request_id': 'req-c1e2220a-3dfb-4b92-993e-f8c9b9840165'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:21.825369 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 859/1711] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:21.831921 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5cb13-0116-4903-9702-9cd8edc9bd46 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:21.831921 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5cb13-0116-4903-9702-9cd8edc9bd46 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:21.831921 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5cb13-0116-4903-9702-9cd8edc9bd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:21.863178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c0a5cb13-0116-4903-9702-9cd8edc9bd46 None None] MFA Rules not processed for user `100695efc6a94e58ba270c7a81c26400`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:21.863899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c0a5cb13-0116-4903-9702-9cd8edc9bd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:21.936402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c1e2220a-3dfb-4b92-993e-f8c9b9840165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5118ed5f23c94888a875a89de77c86c7', 'request_id': 'req-c1e2220a-3dfb-4b92-993e-f8c9b9840165'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:21.977037 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c1e2220a-3dfb-4b92-993e-f8c9b9840165 admin admin] The token cache is being invalidate because project 5118ed5f23c94888a875a89de77c86c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:47:21.977478 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c1e2220a-3dfb-4b92-993e-f8c9b9840165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:21.979532 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c1e2220a-3dfb-4b92-993e-f8c9b9840165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:21.984966 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 853/1712] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:47:21 2022] DELETE /identity/v3/projects/5118ed5f23c94888a875a89de77c86c7 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:21.987466 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2220a-3dfb-4b92-993e-f8c9b9840165 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:21.988232 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c1e2220a-3dfb-4b92-993e-f8c9b9840165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:21.995196 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 860/1713] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:21.997922 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5cb13-0116-4903-9702-9cd8edc9bd46 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:21.999884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c0a5cb13-0116-4903-9702-9cd8edc9bd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:22.101151 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2220a-3dfb-4b92-993e-f8c9b9840165 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:22.118432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf4540-fcb2-4681-a2fd-6a7931ba38b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:22.119418 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf4540-fcb2-4681-a2fd-6a7931ba38b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:22.119762 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf4540-fcb2-4681-a2fd-6a7931ba38b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:22.120055 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf4540-fcb2-4681-a2fd-6a7931ba38b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:22.120776 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf4540-fcb2-4681-a2fd-6a7931ba38b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:47:22.121069 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf4540-fcb2-4681-a2fd-6a7931ba38b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:22.123861 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf4540-fcb2-4681-a2fd-6a7931ba38b9 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:22.140644 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 854/1714] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:47:22.141968 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf4540-fcb2-4681-a2fd-6a7931ba38b9 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:22.148020 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-aadf4540-fcb2-4681-a2fd-6a7931ba38b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:22.234677 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5cb13-0116-4903-9702-9cd8edc9bd46 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:22.242876 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b18d8-98f0-437a-976e-ecd8690e850f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:22.244706 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b18d8-98f0-437a-976e-ecd8690e850f service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:22.244975 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b18d8-98f0-437a-976e-ecd8690e850f service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:22.245496 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b18d8-98f0-437a-976e-ecd8690e850f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:22.249235 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a22b18d8-98f0-437a-976e-ecd8690e850f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:22.250307 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf4540-fcb2-4681-a2fd-6a7931ba38b9 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:22.262768 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e5024-ab2d-4422-8253-6d003540170a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a48c49f7a9f44cef89dd024fecea422f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:22.262768 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e5024-ab2d-4422-8253-6d003540170a service placement] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:22.262768 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e5024-ab2d-4422-8253-6d003540170a service placement] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:22.262768 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e5024-ab2d-4422-8253-6d003540170a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:22.263327 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-310e5024-ab2d-4422-8253-6d003540170a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:22.281526 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e5024-ab2d-4422-8253-6d003540170a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:22.283570 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e5024-ab2d-4422-8253-6d003540170a service placement] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:22.297481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 855/1715] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:47:22.300007 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6651561-2484-4510-821a-90647c86297d None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:22.300667 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6651561-2484-4510-821a-90647c86297d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:22.301102 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6651561-2484-4510-821a-90647c86297d None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:22.302802 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 856/1716] 10.222.0.26 () {54 vars in 912 bytes} [Sun Sep 11 08:47:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:47:22.303800 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6651561-2484-4510-821a-90647c86297d None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:22.306224 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b6651561-2484-4510-821a-90647c86297d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:22.331171 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6651561-2484-4510-821a-90647c86297d None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:22.338330 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803e79a-c3c5-4374-b143-95c18360692d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:22.339443 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803e79a-c3c5-4374-b143-95c18360692d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:22.344606 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803e79a-c3c5-4374-b143-95c18360692d admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:22.344606 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803e79a-c3c5-4374-b143-95c18360692d admin admin] PATH_INFO: `/v3/users/957ce61a2d8d43899f55ac10ec3f02cd` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:22.344606 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803e79a-c3c5-4374-b143-95c18360692d admin admin] RBAC: Authorizing `identity:delete_user(user_id=957ce61a2d8d43899f55ac10ec3f02cd)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:22.346886 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803e79a-c3c5-4374-b143-95c18360692d admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:22.407147 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b18d8-98f0-437a-976e-ecd8690e850f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:22.410172 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b18d8-98f0-437a-976e-ecd8690e850f service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:22.424832 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 861/1717] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:47:22.427227 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b18d8-98f0-437a-976e-ecd8690e850f service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:22.429449 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a22b18d8-98f0-437a-976e-ecd8690e850f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:22.449930 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b18d8-98f0-437a-976e-ecd8690e850f service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:22.460200 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb0286-c84d-4745-afc2-44c9ffa9208d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:22.460200 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb0286-c84d-4745-afc2-44c9ffa9208d admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:22.460497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb0286-c84d-4745-afc2-44c9ffa9208d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:22.461443 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb0286-c84d-4745-afc2-44c9ffa9208d admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:22.462737 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb0286-c84d-4745-afc2-44c9ffa9208d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:22.465121 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb0286-c84d-4745-afc2-44c9ffa9208d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:22.625630 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 862/1718] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:47:22 2022] POST /identity/v3/projects => generated 373 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:47:22.628449 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb0286-c84d-4745-afc2-44c9ffa9208d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:22.729458 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2803e79a-c3c5-4374-b143-95c18360692d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '957ce61a2d8d43899f55ac10ec3f02cd'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:22.730999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2803e79a-c3c5-4374-b143-95c18360692d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '957ce61a2d8d43899f55ac10ec3f02cd'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:22.768086 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2803e79a-c3c5-4374-b143-95c18360692d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '957ce61a2d8d43899f55ac10ec3f02cd'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:22.768967 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2803e79a-c3c5-4374-b143-95c18360692d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '957ce61a2d8d43899f55ac10ec3f02cd'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:22.839365 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb0286-c84d-4745-afc2-44c9ffa9208d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:22.845970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e39a1-27b3-4171-b28d-ae1862cd2304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:22.847920 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e39a1-27b3-4171-b28d-ae1862cd2304 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:22.847920 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e39a1-27b3-4171-b28d-ae1862cd2304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:22.847920 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e39a1-27b3-4171-b28d-ae1862cd2304 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:22.848300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6e39a1-27b3-4171-b28d-ae1862cd2304 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:22.850575 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6e39a1-27b3-4171-b28d-ae1862cd2304 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:22.869739 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2803e79a-c3c5-4374-b143-95c18360692d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '957ce61a2d8d43899f55ac10ec3f02cd'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:22.913238 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 857/1719] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:47:22 2022] DELETE /identity/v3/users/957ce61a2d8d43899f55ac10ec3f02cd => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:22.913952 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803e79a-c3c5-4374-b143-95c18360692d admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:22.923178 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2803e79a-c3c5-4374-b143-95c18360692d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:22.967594 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:23.083509 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 863/1720] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:47:22 2022] POST /identity/v3/projects => generated 355 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:47:23.090791 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd830c-a1e4-418d-a47c-8d455cf4d2ff None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:23.091160 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd830c-a1e4-418d-a47c-8d455cf4d2ff None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:23.091614 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd830c-a1e4-418d-a47c-8d455cf4d2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:23.132670 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803e79a-c3c5-4374-b143-95c18360692d admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:23.199855 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-02bd830c-a1e4-418d-a47c-8d455cf4d2ff None None] MFA Rules not processed for user `7c86ca1e378c4042a1807c7a45aaab99`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:23.201931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-02bd830c-a1e4-418d-a47c-8d455cf4d2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:23.329122 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d56057-f0cf-40ea-a5b3-5cf532680e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:23.329122 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d56057-f0cf-40ea-a5b3-5cf532680e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:23.329122 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d56057-f0cf-40ea-a5b3-5cf532680e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:23.329122 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d56057-f0cf-40ea-a5b3-5cf532680e88 admin admin] PATH_INFO: `/v3/projects/13cd336c57524040af2c3c4f98ff784e` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:23.331199 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d56057-f0cf-40ea-a5b3-5cf532680e88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13cd336c57524040af2c3c4f98ff784e)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:23.335634 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d56057-f0cf-40ea-a5b3-5cf532680e88 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:23.448379 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:23.454884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 864/1721] 10.222.0.26 () {58 vars in 1009 bytes} [Sun Sep 11 08:47:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:23.458322 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd830c-a1e4-418d-a47c-8d455cf4d2ff None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:23.458322 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-02bd830c-a1e4-418d-a47c-8d455cf4d2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:23.481892 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd830c-a1e4-418d-a47c-8d455cf4d2ff None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:23.498832 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b2f999-989c-418c-acdc-41f131e1c569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:23.502004 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2f999-989c-418c-acdc-41f131e1c569 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:23.502408 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2f999-989c-418c-acdc-41f131e1c569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:23.502846 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2f999-989c-418c-acdc-41f131e1c569 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:23.503967 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b2f999-989c-418c-acdc-41f131e1c569 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:23.508178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b2f999-989c-418c-acdc-41f131e1c569 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:23.633107 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-b2d56057-f0cf-40ea-a5b3-5cf532680e88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13cd336c57524040af2c3c4f98ff784e', 'request_id': 'req-b2d56057-f0cf-40ea-a5b3-5cf532680e88'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:23.659340 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-b2d56057-f0cf-40ea-a5b3-5cf532680e88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13cd336c57524040af2c3c4f98ff784e', 'request_id': 'req-b2d56057-f0cf-40ea-a5b3-5cf532680e88'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:23.697592 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 865/1722] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:47:23 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:47:23.699203 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b2f999-989c-418c-acdc-41f131e1c569 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:23.703104 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-83b2f999-989c-418c-acdc-41f131e1c569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:23.728018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b2f999-989c-418c-acdc-41f131e1c569 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:23.783531 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-b2d56057-f0cf-40ea-a5b3-5cf532680e88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13cd336c57524040af2c3c4f98ff784e', 'request_id': 'req-b2d56057-f0cf-40ea-a5b3-5cf532680e88'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:23.808456 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-b2d56057-f0cf-40ea-a5b3-5cf532680e88 admin admin] The token cache is being invalidate because project 13cd336c57524040af2c3c4f98ff784e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:47:23.809790 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-b2d56057-f0cf-40ea-a5b3-5cf532680e88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:23.811189 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-b2d56057-f0cf-40ea-a5b3-5cf532680e88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:23.813278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 858/1723] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:47:22 2022] DELETE /identity/v3/projects/13cd336c57524040af2c3c4f98ff784e => generated 0 bytes in 900 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:23.817299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d56057-f0cf-40ea-a5b3-5cf532680e88 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:23.837589 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b2d56057-f0cf-40ea-a5b3-5cf532680e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:23.910627 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480961c-a656-46e4-8e31-78ac3f38ed9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:23.911644 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480961c-a656-46e4-8e31-78ac3f38ed9b admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:23.912175 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480961c-a656-46e4-8e31-78ac3f38ed9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:23.912463 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480961c-a656-46e4-8e31-78ac3f38ed9b admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:23.913430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480961c-a656-46e4-8e31-78ac3f38ed9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:23.915286 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480961c-a656-46e4-8e31-78ac3f38ed9b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:24.008483 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d56057-f0cf-40ea-a5b3-5cf532680e88 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:24.018329 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a516ebb-6113-4c29-b0e3-2a35c6bbb51a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:24.018981 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a516ebb-6113-4c29-b0e3-2a35c6bbb51a service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:24.019306 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a516ebb-6113-4c29-b0e3-2a35c6bbb51a service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:24.019568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a516ebb-6113-4c29-b0e3-2a35c6bbb51a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:24.027124 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 866/1724] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:47:23 2022] POST /identity/v3/users => generated 278 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:47:24.028233 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480961c-a656-46e4-8e31-78ac3f38ed9b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:24.028969 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9a516ebb-6113-4c29-b0e3-2a35c6bbb51a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:24.034442 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7480961c-a656-46e4-8e31-78ac3f38ed9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:24.049708 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a516ebb-6113-4c29-b0e3-2a35c6bbb51a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:24.051638 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a516ebb-6113-4c29-b0e3-2a35c6bbb51a service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:24.063954 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480961c-a656-46e4-8e31-78ac3f38ed9b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:24.071046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 859/1725] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:47:24.075077 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99c8eb-83ff-45c6-8507-766c7ed40dc6 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:24.080582 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e7f59-007a-422f-a2f4-40f368e38ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:24.080582 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e7f59-007a-422f-a2f4-40f368e38ddf admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:24.080582 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e7f59-007a-422f-a2f4-40f368e38ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:24.080582 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e7f59-007a-422f-a2f4-40f368e38ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:24.080942 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99c8eb-83ff-45c6-8507-766c7ed40dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:24.080942 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99c8eb-83ff-45c6-8507-766c7ed40dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:24.081071 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e7f59-007a-422f-a2f4-40f368e38ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:24.084021 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e7f59-007a-422f-a2f4-40f368e38ddf admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:24.147463 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 867/1726] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:47:24.150438 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e7f59-007a-422f-a2f4-40f368e38ddf admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:24.157438 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9a0e7f59-007a-422f-a2f4-40f368e38ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:24.164044 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-aa99c8eb-83ff-45c6-8507-766c7ed40dc6 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:24.172711 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-aa99c8eb-83ff-45c6-8507-766c7ed40dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:24.212041 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 860/1727] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:24.216435 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99c8eb-83ff-45c6-8507-766c7ed40dc6 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:24.217696 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e7f59-007a-422f-a2f4-40f368e38ddf admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:24.222201 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-aa99c8eb-83ff-45c6-8507-766c7ed40dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:24.238411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21359742-d907-451a-a0d1-5c880a5d9933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:24.242729 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21359742-d907-451a-a0d1-5c880a5d9933 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:24.243353 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21359742-d907-451a-a0d1-5c880a5d9933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:24.243886 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21359742-d907-451a-a0d1-5c880a5d9933 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:24.245167 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21359742-d907-451a-a0d1-5c880a5d9933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:24.257889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21359742-d907-451a-a0d1-5c880a5d9933 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:24.282169 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99c8eb-83ff-45c6-8507-766c7ed40dc6 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:24.303669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee0602-c30e-42a1-bde8-81c066a9ea66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:24.304800 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee0602-c30e-42a1-bde8-81c066a9ea66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:24.305298 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee0602-c30e-42a1-bde8-81c066a9ea66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:24.305796 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee0602-c30e-42a1-bde8-81c066a9ea66 admin admin] PATH_INFO: `/v3/projects/127ca2b1443c4fd288caa851b135a3e3` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:24.307885 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 868/1728] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:47:24.315446 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21359742-d907-451a-a0d1-5c880a5d9933 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:24.317153 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee0602-c30e-42a1-bde8-81c066a9ea66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=127ca2b1443c4fd288caa851b135a3e3)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:24.334272 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee0602-c30e-42a1-bde8-81c066a9ea66 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:24.374871 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21359742-d907-451a-a0d1-5c880a5d9933 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:24.402668 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08856c98-4f1e-4105-8551-a23579390aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:24.406730 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08856c98-4f1e-4105-8551-a23579390aa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:24.407445 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08856c98-4f1e-4105-8551-a23579390aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:24.407874 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08856c98-4f1e-4105-8551-a23579390aa6 admin admin] PATH_INFO: `/v3/projects/eae65ac638b7457aa9cb35880d705ac5/users/1564d0e54c794cd8a4be68c4bd3da88e/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:24.479693 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08856c98-4f1e-4105-8551-a23579390aa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eae65ac638b7457aa9cb35880d705ac5, user_id=1564d0e54c794cd8a4be68c4bd3da88e, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:24.482550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08856c98-4f1e-4105-8551-a23579390aa6 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:24.689168 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 869/1729] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:47:24 2022] PUT /identity/v3/projects/eae65ac638b7457aa9cb35880d705ac5/users/1564d0e54c794cd8a4be68c4bd3da88e/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:24.698968 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c89c1-c24a-4bf8-8666-2320fc795a96 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:24.698968 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c89c1-c24a-4bf8-8666-2320fc795a96 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:24.698968 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c89c1-c24a-4bf8-8666-2320fc795a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:24.730479 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d1ee0602-c30e-42a1-bde8-81c066a9ea66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '127ca2b1443c4fd288caa851b135a3e3', 'request_id': 'req-d1ee0602-c30e-42a1-bde8-81c066a9ea66'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:24.765674 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d1ee0602-c30e-42a1-bde8-81c066a9ea66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '127ca2b1443c4fd288caa851b135a3e3', 'request_id': 'req-d1ee0602-c30e-42a1-bde8-81c066a9ea66'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:24.803635 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-1b0c89c1-c24a-4bf8-8666-2320fc795a96 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:24.806493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1b0c89c1-c24a-4bf8-8666-2320fc795a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:24.868820 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d1ee0602-c30e-42a1-bde8-81c066a9ea66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '127ca2b1443c4fd288caa851b135a3e3', 'request_id': 'req-d1ee0602-c30e-42a1-bde8-81c066a9ea66'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:24.919957 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d1ee0602-c30e-42a1-bde8-81c066a9ea66 admin admin] The token cache is being invalidate because project 127ca2b1443c4fd288caa851b135a3e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:47:24.920680 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d1ee0602-c30e-42a1-bde8-81c066a9ea66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:24.925226 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d1ee0602-c30e-42a1-bde8-81c066a9ea66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:24.936365 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 861/1730] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:47:24 2022] DELETE /identity/v3/projects/127ca2b1443c4fd288caa851b135a3e3 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:24.936365 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee0602-c30e-42a1-bde8-81c066a9ea66 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:24.945648 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d1ee0602-c30e-42a1-bde8-81c066a9ea66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:25.028433 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:25.042878 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 870/1731] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:25.066007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c89c1-c24a-4bf8-8666-2320fc795a96 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:25.073316 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1b0c89c1-c24a-4bf8-8666-2320fc795a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:25.116119 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c89c1-c24a-4bf8-8666-2320fc795a96 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:25.134572 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e27e6-1df5-4bcb-99dd-3a0513504cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:25.135192 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e27e6-1df5-4bcb-99dd-3a0513504cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:25.135532 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e27e6-1df5-4bcb-99dd-3a0513504cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:25.135796 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e27e6-1df5-4bcb-99dd-3a0513504cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:25.136480 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e27e6-1df5-4bcb-99dd-3a0513504cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:25.138908 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e27e6-1df5-4bcb-99dd-3a0513504cb4 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:25.140062 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee0602-c30e-42a1-bde8-81c066a9ea66 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:25.147758 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac79bd-1c2b-4a50-aecb-c7290692493d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:25.148945 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac79bd-1c2b-4a50-aecb-c7290692493d admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:25.149626 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac79bd-1c2b-4a50-aecb-c7290692493d admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:25.150211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac79bd-1c2b-4a50-aecb-c7290692493d admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:25.151321 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac79bd-1c2b-4a50-aecb-c7290692493d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:25.154097 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac79bd-1c2b-4a50-aecb-c7290692493d admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:25.195421 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 871/1732] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:47:25.205625 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 862/1733] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:47:25.209028 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac79bd-1c2b-4a50-aecb-c7290692493d admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:25.216056 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f553924-ba43-47e9-a97a-c0c1d000c8cf None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:25.218716 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f553924-ba43-47e9-a97a-c0c1d000c8cf None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:25.219384 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f553924-ba43-47e9-a97a-c0c1d000c8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:25.244626 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac79bd-1c2b-4a50-aecb-c7290692493d admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:25.261228 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1baeb-04b3-4b8a-b153-dab586e26f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:25.264019 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1baeb-04b3-4b8a-b153-dab586e26f42 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:25.264588 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1baeb-04b3-4b8a-b153-dab586e26f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:25.266247 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1baeb-04b3-4b8a-b153-dab586e26f42 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:25.268848 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1baeb-04b3-4b8a-b153-dab586e26f42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:47:25.271036 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1baeb-04b3-4b8a-b153-dab586e26f42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:25.275588 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1baeb-04b3-4b8a-b153-dab586e26f42 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:25.284248 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2f553924-ba43-47e9-a97a-c0c1d000c8cf None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:25.286833 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2f553924-ba43-47e9-a97a-c0c1d000c8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:25.309153 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:25.325470 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 863/1734] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:47:25.326855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1baeb-04b3-4b8a-b153-dab586e26f42 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:25.337337 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 872/1735] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:25.337337 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f553924-ba43-47e9-a97a-c0c1d000c8cf None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:25.350605 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1baeb-04b3-4b8a-b153-dab586e26f42 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:25.357724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5186f74-5154-4230-a35f-42605659eab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:25.360632 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5186f74-5154-4230-a35f-42605659eab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:25.361360 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5186f74-5154-4230-a35f-42605659eab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:25.362086 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5186f74-5154-4230-a35f-42605659eab7 admin admin] PATH_INFO: `/v3/projects/eae65ac638b7457aa9cb35880d705ac5/users/1564d0e54c794cd8a4be68c4bd3da88e/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:25.364895 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f553924-ba43-47e9-a97a-c0c1d000c8cf None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:25.370520 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5186f74-5154-4230-a35f-42605659eab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eae65ac638b7457aa9cb35880d705ac5, user_id=1564d0e54c794cd8a4be68c4bd3da88e, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:25.389592 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5186f74-5154-4230-a35f-42605659eab7 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:25.393099 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1a7a1-011b-4a9f-9bc6-0fe6346feb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:25.394723 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1a7a1-011b-4a9f-9bc6-0fe6346feb90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:25.394723 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1a7a1-011b-4a9f-9bc6-0fe6346feb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:25.394723 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1a7a1-011b-4a9f-9bc6-0fe6346feb90 admin admin] PATH_INFO: `/v3/projects/81629cda6d8942f0b89359a283c3ff4b/users/b15f16dcdff641c3b526830355ecd0d4/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:25.445724 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1a7a1-011b-4a9f-9bc6-0fe6346feb90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81629cda6d8942f0b89359a283c3ff4b, user_id=b15f16dcdff641c3b526830355ecd0d4, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:25.449185 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1a7a1-011b-4a9f-9bc6-0fe6346feb90 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:25.486247 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 864/1736] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:47:25 2022] PUT /identity/v3/projects/eae65ac638b7457aa9cb35880d705ac5/users/1564d0e54c794cd8a4be68c4bd3da88e/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:25.490339 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5186f74-5154-4230-a35f-42605659eab7 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:25.574916 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 873/1737] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:47:25 2022] PUT /identity/v3/projects/81629cda6d8942f0b89359a283c3ff4b/users/b15f16dcdff641c3b526830355ecd0d4/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:25.593539 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbaa0e-9e52-4ca4-b85b-03e178f663a5 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:25.596114 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbaa0e-9e52-4ca4-b85b-03e178f663a5 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:25.598104 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbaa0e-9e52-4ca4-b85b-03e178f663a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:25.688010 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-03cbaa0e-9e52-4ca4-b85b-03e178f663a5 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:25.699844 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-03cbaa0e-9e52-4ca4-b85b-03e178f663a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:25.785221 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:25.881415 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5186f74-5154-4230-a35f-42605659eab7 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:26.027799 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 874/1738] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:26.031936 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9724275-6da6-4948-b748-eadb79f785c8 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:26.040944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9724275-6da6-4948-b748-eadb79f785c8 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:26.043558 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9724275-6da6-4948-b748-eadb79f785c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:26.138910 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-d9724275-6da6-4948-b748-eadb79f785c8 None None] MFA Rules not processed for user `1564d0e54c794cd8a4be68c4bd3da88e`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:26.140834 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d9724275-6da6-4948-b748-eadb79f785c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:26.158663 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79260a-4421-416b-a6c3-d8b18f21a079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:26.159896 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79260a-4421-416b-a6c3-d8b18f21a079 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:26.162081 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79260a-4421-416b-a6c3-d8b18f21a079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:26.163718 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79260a-4421-416b-a6c3-d8b18f21a079 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:26.164646 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79260a-4421-416b-a6c3-d8b18f21a079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:26.169923 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79260a-4421-416b-a6c3-d8b18f21a079 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:26.338622 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 875/1739] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:26.341717 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0a389-59db-4d17-bcca-56efedc939de None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:26.342722 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0a389-59db-4d17-bcca-56efedc939de None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:26.344415 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0a389-59db-4d17-bcca-56efedc939de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:26.367003 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 865/1740] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:47:25 2022] POST /identity/v3/projects => generated 407 bytes in 868 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:47:26.373311 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817da160-4661-4964-877a-8ca45fbf08b8 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:26.383672 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817da160-4661-4964-877a-8ca45fbf08b8 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:26.384511 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817da160-4661-4964-877a-8ca45fbf08b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:26.442634 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-817da160-4661-4964-877a-8ca45fbf08b8 None None] MFA Rules not processed for user `0c035b3b70c340bf9f52df64449adf5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:26.445098 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-817da160-4661-4964-877a-8ca45fbf08b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:26.471719 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-93c0a389-59db-4d17-bcca-56efedc939de None None] MFA Rules not processed for user `b15f16dcdff641c3b526830355ecd0d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:26.474231 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-93c0a389-59db-4d17-bcca-56efedc939de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:26.666986 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 866/1741] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:26.672092 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 876/1742] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:26.675076 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0a389-59db-4d17-bcca-56efedc939de None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:26.679578 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817da160-4661-4964-877a-8ca45fbf08b8 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:26.802552 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:26.903152 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817da160-4661-4964-877a-8ca45fbf08b8 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:26.920685 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c15fc-ddd1-48ee-85dd-cf1d3abdef00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:26.921007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0a389-59db-4d17-bcca-56efedc939de None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:26.922182 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c15fc-ddd1-48ee-85dd-cf1d3abdef00 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:26.922850 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c15fc-ddd1-48ee-85dd-cf1d3abdef00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:26.923519 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c15fc-ddd1-48ee-85dd-cf1d3abdef00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:26.927829 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c15fc-ddd1-48ee-85dd-cf1d3abdef00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:47:26.929628 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c15fc-ddd1-48ee-85dd-cf1d3abdef00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:26.934478 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c15fc-ddd1-48ee-85dd-cf1d3abdef00 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:26.936229 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c92aca-c941-44f2-a5f2-2bbcfb9939f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:26.937517 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c92aca-c941-44f2-a5f2-2bbcfb9939f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:26.937802 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c92aca-c941-44f2-a5f2-2bbcfb9939f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:26.938084 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c92aca-c941-44f2-a5f2-2bbcfb9939f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:26.938757 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c92aca-c941-44f2-a5f2-2bbcfb9939f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:26.943833 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c92aca-c941-44f2-a5f2-2bbcfb9939f6 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:27.004518 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 867/1743] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:47:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:47:27.008091 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c15fc-ddd1-48ee-85dd-cf1d3abdef00 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:27.016301 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-232c15fc-ddd1-48ee-85dd-cf1d3abdef00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:27.108240 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 877/1744] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:47:26 2022] POST /identity/v3/users => generated 304 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:47:27.109309 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c92aca-c941-44f2-a5f2-2bbcfb9939f6 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:27.152960 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c92aca-c941-44f2-a5f2-2bbcfb9939f6 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:27.157860 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:27.191832 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9f181-633b-485a-90c0-bee562ad4b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:27.196038 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9f181-633b-485a-90c0-bee562ad4b47 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:27.196038 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9f181-633b-485a-90c0-bee562ad4b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:27.196427 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9f181-633b-485a-90c0-bee562ad4b47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:27.197194 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9f181-633b-485a-90c0-bee562ad4b47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:27.203037 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9f181-633b-485a-90c0-bee562ad4b47 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:27.266806 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c15fc-ddd1-48ee-85dd-cf1d3abdef00 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:27.276410 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e3619-444e-429c-afb5-e5682e6fe67d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:27.277089 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e3619-444e-429c-afb5-e5682e6fe67d service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:27.277594 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e3619-444e-429c-afb5-e5682e6fe67d service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:27.279518 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e3619-444e-429c-afb5-e5682e6fe67d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:27.377691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 878/1745] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:47:27 2022] POST /identity/v3/projects => generated 355 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:47:27.380645 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9f181-633b-485a-90c0-bee562ad4b47 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:27.525707 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e3619-444e-429c-afb5-e5682e6fe67d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:27.538225 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e3619-444e-429c-afb5-e5682e6fe67d service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:27.570983 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9f181-633b-485a-90c0-bee562ad4b47 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:27.601558 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bebeb3e-e8a0-49fe-aa6c-cd298d65d94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:27.602495 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebeb3e-e8a0-49fe-aa6c-cd298d65d94f admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:27.603000 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebeb3e-e8a0-49fe-aa6c-cd298d65d94f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:27.603603 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebeb3e-e8a0-49fe-aa6c-cd298d65d94f admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:27.605318 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bebeb3e-e8a0-49fe-aa6c-cd298d65d94f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:27.608209 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bebeb3e-e8a0-49fe-aa6c-cd298d65d94f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:27.657308 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 868/1746] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:47:27.682866 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e3619-444e-429c-afb5-e5682e6fe67d service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:27.772725 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 879/1747] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:47:27 2022] POST /identity/v3/projects => generated 387 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:47:27.776299 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bebeb3e-e8a0-49fe-aa6c-cd298d65d94f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:27.804582 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e3619-444e-429c-afb5-e5682e6fe67d service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:28.006879 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bebeb3e-e8a0-49fe-aa6c-cd298d65d94f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:28.012968 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73079304-e1e8-46dc-b2ca-d34f157c24e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:28.013679 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73079304-e1e8-46dc-b2ca-d34f157c24e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:28.013971 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73079304-e1e8-46dc-b2ca-d34f157c24e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:28.014620 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73079304-e1e8-46dc-b2ca-d34f157c24e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:28.016284 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73079304-e1e8-46dc-b2ca-d34f157c24e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:28.018788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73079304-e1e8-46dc-b2ca-d34f157c24e5 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:28.153386 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f42d0-915b-44b0-85a2-ac62162dc5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:28.154514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f42d0-915b-44b0-85a2-ac62162dc5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:28.155177 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f42d0-915b-44b0-85a2-ac62162dc5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:28.161828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f42d0-915b-44b0-85a2-ac62162dc5c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:28.163234 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f42d0-915b-44b0-85a2-ac62162dc5c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:28.174542 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f42d0-915b-44b0-85a2-ac62162dc5c5 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:28.202771 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 880/1748] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:47:27 2022] POST /identity/v3/users => generated 284 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:47:28.203015 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73079304-e1e8-46dc-b2ca-d34f157c24e5 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:28.223384 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 869/1749] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 565 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:47:28.225032 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f42d0-915b-44b0-85a2-ac62162dc5c5 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:28.246218 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f42d0-915b-44b0-85a2-ac62162dc5c5 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:28.256041 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a213a-f8ce-4045-bbcd-781decb25a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:28.257704 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a213a-f8ce-4045-bbcd-781decb25a16 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:28.258265 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a213a-f8ce-4045-bbcd-781decb25a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:28.259066 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a213a-f8ce-4045-bbcd-781decb25a16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:28.260318 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a213a-f8ce-4045-bbcd-781decb25a16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:28.263845 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a213a-f8ce-4045-bbcd-781decb25a16 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:28.279604 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73079304-e1e8-46dc-b2ca-d34f157c24e5 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:28.282415 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 870/1750] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:47:28.284084 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a213a-f8ce-4045-bbcd-781decb25a16 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:28.291100 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478695c-3a02-476d-9a24-39dd0c6ec124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:28.292067 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478695c-3a02-476d-9a24-39dd0c6ec124 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:28.292588 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478695c-3a02-476d-9a24-39dd0c6ec124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:28.293140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478695c-3a02-476d-9a24-39dd0c6ec124 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:28.294613 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478695c-3a02-476d-9a24-39dd0c6ec124 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:28.297813 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478695c-3a02-476d-9a24-39dd0c6ec124 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:28.299851 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a213a-f8ce-4045-bbcd-781decb25a16 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:28.305867 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35373740-fd22-4ee5-80f9-64713f97bdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:28.307147 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35373740-fd22-4ee5-80f9-64713f97bdc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:28.309130 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35373740-fd22-4ee5-80f9-64713f97bdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:28.309972 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35373740-fd22-4ee5-80f9-64713f97bdc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:28.310919 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35373740-fd22-4ee5-80f9-64713f97bdc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:28.328705 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35373740-fd22-4ee5-80f9-64713f97bdc7 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:28.344891 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:28.387713 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 871/1751] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:47:28.391777 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35373740-fd22-4ee5-80f9-64713f97bdc7 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:28.418506 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35373740-fd22-4ee5-80f9-64713f97bdc7 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:28.438653 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 881/1752] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:47:28 2022] POST /identity/v3/users => generated 294 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:47:28.442127 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6bc1e-1782-43ac-a636-e91d4b274ef5 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:28.442426 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6bc1e-1782-43ac-a636-e91d4b274ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:28.444481 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6bc1e-1782-43ac-a636-e91d4b274ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:28.445236 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113cf116-c75d-417a-9039-9be3004245ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:28.446127 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cf116-c75d-417a-9039-9be3004245ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:28.446345 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cf116-c75d-417a-9039-9be3004245ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:28.446683 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cf116-c75d-417a-9039-9be3004245ca admin admin] PATH_INFO: `/v3/projects/a3b505825c1a48f3bb007f1430e439cd/users/26879249af604dfa9e1863fd7d457a49/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:28.523612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113cf116-c75d-417a-9039-9be3004245ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3b505825c1a48f3bb007f1430e439cd, user_id=26879249af604dfa9e1863fd7d457a49, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:28.540751 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-96d6bc1e-1782-43ac-a636-e91d4b274ef5 None None] MFA Rules not processed for user `cf1cba65d61e45179dcc3aa3ba8391e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:28.543098 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113cf116-c75d-417a-9039-9be3004245ca admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:28.549535 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-96d6bc1e-1782-43ac-a636-e91d4b274ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:28.703086 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 872/1753] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:47:28 2022] PUT /identity/v3/projects/a3b505825c1a48f3bb007f1430e439cd/users/26879249af604dfa9e1863fd7d457a49/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:28.704053 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113cf116-c75d-417a-9039-9be3004245ca admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:28.828706 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 882/1754] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:28.833526 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6bc1e-1782-43ac-a636-e91d4b274ef5 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:28.860858 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6bc1e-1782-43ac-a636-e91d4b274ef5 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:28.866861 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:28.962266 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113cf116-c75d-417a-9039-9be3004245ca admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:28.970934 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc60c4-bdf3-4304-9de2-f2b292f8bbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:28.971304 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc60c4-bdf3-4304-9de2-f2b292f8bbda admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:28.974747 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc60c4-bdf3-4304-9de2-f2b292f8bbda admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:28.975068 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc60c4-bdf3-4304-9de2-f2b292f8bbda admin admin] PATH_INFO: `/v3/projects/d80cbe7f2391495cb74997b7429a59b8/users/da78c54274da4843bf2c939c7eef5b20/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:29.011862 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:29.056892 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc60c4-bdf3-4304-9de2-f2b292f8bbda admin admin] RBAC: Authorizing `identity:create_grant(project_id=d80cbe7f2391495cb74997b7429a59b8, user_id=da78c54274da4843bf2c939c7eef5b20, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:29.080418 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc60c4-bdf3-4304-9de2-f2b292f8bbda admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:29.178779 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161ce75-ec16-458b-9837-55af9a30e2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:29.179461 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161ce75-ec16-458b-9837-55af9a30e2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:29.179744 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161ce75-ec16-458b-9837-55af9a30e2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:29.180021 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161ce75-ec16-458b-9837-55af9a30e2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:29.180694 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161ce75-ec16-458b-9837-55af9a30e2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:29.195362 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 873/1755] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:47:28 2022] PUT /identity/v3/projects/d80cbe7f2391495cb74997b7429a59b8/users/da78c54274da4843bf2c939c7eef5b20/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:29.197195 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161ce75-ec16-458b-9837-55af9a30e2b6 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:29.198033 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc60c4-bdf3-4304-9de2-f2b292f8bbda admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:29.240224 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 883/1756] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:47:29.246413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40100291-6431-4571-8f91-92ad227e829b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:29.247536 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40100291-6431-4571-8f91-92ad227e829b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:29.248028 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40100291-6431-4571-8f91-92ad227e829b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:29.320187 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-40100291-6431-4571-8f91-92ad227e829b None None] MFA Rules not processed for user `da78c54274da4843bf2c939c7eef5b20`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:29.322343 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-40100291-6431-4571-8f91-92ad227e829b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:29.345986 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc60c4-bdf3-4304-9de2-f2b292f8bbda admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:29.353701 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6f191-7fa7-4ccb-a5c3-db223aef0429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:29.354485 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6f191-7fa7-4ccb-a5c3-db223aef0429 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:29.354873 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6f191-7fa7-4ccb-a5c3-db223aef0429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:29.358380 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6f191-7fa7-4ccb-a5c3-db223aef0429 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:29.358380 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6f191-7fa7-4ccb-a5c3-db223aef0429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:29.358380 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6f191-7fa7-4ccb-a5c3-db223aef0429 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:29.378438 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 874/1757] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:47:29.378438 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6f191-7fa7-4ccb-a5c3-db223aef0429 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:29.397779 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6f191-7fa7-4ccb-a5c3-db223aef0429 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:29.420442 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a10ce0-35c5-4520-904e-ca452f26bf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:29.422099 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a10ce0-35c5-4520-904e-ca452f26bf2c admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:29.424509 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a10ce0-35c5-4520-904e-ca452f26bf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:29.424959 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a10ce0-35c5-4520-904e-ca452f26bf2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:29.425803 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a10ce0-35c5-4520-904e-ca452f26bf2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:29.434462 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a10ce0-35c5-4520-904e-ca452f26bf2c admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:29.459624 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 875/1758] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:47:29.462037 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c720d-238d-4f9e-9978-50edfce17daa None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:29.463414 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c720d-238d-4f9e-9978-50edfce17daa None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:29.464039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c720d-238d-4f9e-9978-50edfce17daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:29.514131 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 884/1759] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:29 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:29.514131 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40100291-6431-4571-8f91-92ad227e829b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:29.527659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40100291-6431-4571-8f91-92ad227e829b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:29.540829 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9b30f-0a7d-4cb3-ad8e-7d187b6ee642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:29.542384 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9b30f-0a7d-4cb3-ad8e-7d187b6ee642 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:29.542717 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9b30f-0a7d-4cb3-ad8e-7d187b6ee642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:29.543003 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9b30f-0a7d-4cb3-ad8e-7d187b6ee642 admin admin] PATH_INFO: `/v3/projects/a3b505825c1a48f3bb007f1430e439cd/users/26879249af604dfa9e1863fd7d457a49/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:29.547658 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a9b30f-0a7d-4cb3-ad8e-7d187b6ee642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3b505825c1a48f3bb007f1430e439cd, user_id=26879249af604dfa9e1863fd7d457a49, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:29.554328 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a9b30f-0a7d-4cb3-ad8e-7d187b6ee642 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:29.579298 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 885/1760] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:47:29 2022] PUT /identity/v3/projects/a3b505825c1a48f3bb007f1430e439cd/users/26879249af604dfa9e1863fd7d457a49/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:29.580197 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9b30f-0a7d-4cb3-ad8e-7d187b6ee642 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:29.592402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-a73c720d-238d-4f9e-9978-50edfce17daa None None] MFA Rules not processed for user `84fcccb19a5e43ac9da5d7ca501563e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:29.593859 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-a73c720d-238d-4f9e-9978-50edfce17daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:29.759502 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9b30f-0a7d-4cb3-ad8e-7d187b6ee642 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:29.761076 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 876/1761] 10.222.0.26 () {58 vars in 1009 bytes} [Sun Sep 11 08:47:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:29.761761 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c720d-238d-4f9e-9978-50edfce17daa None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:29.791892 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c720d-238d-4f9e-9978-50edfce17daa None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:29.798740 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376c882-2052-43cc-a87b-0ca1dd0ce8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:29.799480 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376c882-2052-43cc-a87b-0ca1dd0ce8c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:29.799800 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376c882-2052-43cc-a87b-0ca1dd0ce8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:29.800081 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376c882-2052-43cc-a87b-0ca1dd0ce8c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:29.800848 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376c882-2052-43cc-a87b-0ca1dd0ce8c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:29.801089 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a7de9-7765-4936-b14c-3d20cd3eff45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:29.802207 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a7de9-7765-4936-b14c-3d20cd3eff45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:29.803211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376c882-2052-43cc-a87b-0ca1dd0ce8c5 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:29.805520 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a7de9-7765-4936-b14c-3d20cd3eff45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:29.806021 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a7de9-7765-4936-b14c-3d20cd3eff45 admin admin] PATH_INFO: `/v3/projects/9e07fe11e1ba41f8a0c87472f36f7639/users/5efe0f170fdb44d9bfb594b8f0caf394/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:29.834477 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a7de9-7765-4936-b14c-3d20cd3eff45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e07fe11e1ba41f8a0c87472f36f7639, user_id=5efe0f170fdb44d9bfb594b8f0caf394, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:29.840460 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a7de9-7765-4936-b14c-3d20cd3eff45 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:30.001270 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 877/1762] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:47:29 2022] POST /identity/v3/projects => generated 407 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:47:30.003017 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b6a16-720d-437c-b94f-46ef3b366e1a None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:30.003344 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b6a16-720d-437c-b94f-46ef3b366e1a None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:30.003633 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b6a16-720d-437c-b94f-46ef3b366e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:30.046286 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-ef5b6a16-720d-437c-b94f-46ef3b366e1a None None] MFA Rules not processed for user `26879249af604dfa9e1863fd7d457a49`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:30.048173 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ef5b6a16-720d-437c-b94f-46ef3b366e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:30.067955 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 886/1763] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:47:29 2022] PUT /identity/v3/projects/9e07fe11e1ba41f8a0c87472f36f7639/users/5efe0f170fdb44d9bfb594b8f0caf394/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:30.071352 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a7de9-7765-4936-b14c-3d20cd3eff45 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:30.190598 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 878/1764] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:30 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:30.191828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b6a16-720d-437c-b94f-46ef3b366e1a None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:30.315354 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a7de9-7765-4936-b14c-3d20cd3eff45 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:30.330917 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe700f-27fc-481b-a84d-dcf8a573086a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:30.332152 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe700f-27fc-481b-a84d-dcf8a573086a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:30.332292 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe700f-27fc-481b-a84d-dcf8a573086a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:30.332533 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe700f-27fc-481b-a84d-dcf8a573086a admin admin] PATH_INFO: `/v3/users/100695efc6a94e58ba270c7a81c26400` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:30.335491 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe700f-27fc-481b-a84d-dcf8a573086a admin admin] RBAC: Authorizing `identity:delete_user(user_id=100695efc6a94e58ba270c7a81c26400)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:30.340894 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe700f-27fc-481b-a84d-dcf8a573086a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:30.383617 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b6a16-720d-437c-b94f-46ef3b366e1a None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:30.400062 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53086bbe-b246-4dfb-ac68-5401a11ee3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:30.400228 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53086bbe-b246-4dfb-ac68-5401a11ee3ff admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:30.400494 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53086bbe-b246-4dfb-ac68-5401a11ee3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:30.400995 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53086bbe-b246-4dfb-ac68-5401a11ee3ff admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:30.402095 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53086bbe-b246-4dfb-ac68-5401a11ee3ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:30.404698 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53086bbe-b246-4dfb-ac68-5401a11ee3ff admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:30.425390 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:30.606245 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 879/1765] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:47:30 2022] POST /identity/v3/users => generated 310 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:47:30.609130 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5b8cb-88da-463f-bf56-c0456cb8cf0b None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:30.609785 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5b8cb-88da-463f-bf56-c0456cb8cf0b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:30.609785 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5b8cb-88da-463f-bf56-c0456cb8cf0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:30.695861 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-adbe700f-27fc-481b-a84d-dcf8a573086a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '100695efc6a94e58ba270c7a81c26400'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:30.738433 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-f7b5b8cb-88da-463f-bf56-c0456cb8cf0b None None] MFA Rules not processed for user `5efe0f170fdb44d9bfb594b8f0caf394`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:30.740004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f7b5b8cb-88da-463f-bf56-c0456cb8cf0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:30.821563 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-adbe700f-27fc-481b-a84d-dcf8a573086a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '100695efc6a94e58ba270c7a81c26400'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:30.822390 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-adbe700f-27fc-481b-a84d-dcf8a573086a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '100695efc6a94e58ba270c7a81c26400'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:30.823731 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-adbe700f-27fc-481b-a84d-dcf8a573086a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '100695efc6a94e58ba270c7a81c26400'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:30.846836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-adbe700f-27fc-481b-a84d-dcf8a573086a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '100695efc6a94e58ba270c7a81c26400'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:30.905057 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 887/1766] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:47:30 2022] DELETE /identity/v3/users/100695efc6a94e58ba270c7a81c26400 => generated 0 bytes in 837 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:30.906964 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe700f-27fc-481b-a84d-dcf8a573086a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:30.912664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-adbe700f-27fc-481b-a84d-dcf8a573086a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:30.966110 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:30.976295 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 880/1767] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:30.977281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5b8cb-88da-463f-bf56-c0456cb8cf0b None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:30.983945 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f7b5b8cb-88da-463f-bf56-c0456cb8cf0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:31.157490 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe700f-27fc-481b-a84d-dcf8a573086a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:31.175155 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623faa63-e01f-4de6-bd96-2575a10d53ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:31.175824 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623faa63-e01f-4de6-bd96-2575a10d53ae service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:31.176110 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623faa63-e01f-4de6-bd96-2575a10d53ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:31.176384 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623faa63-e01f-4de6-bd96-2575a10d53ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:31.179681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-623faa63-e01f-4de6-bd96-2575a10d53ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:31.328708 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5b8cb-88da-463f-bf56-c0456cb8cf0b None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:31.408355 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623faa63-e01f-4de6-bd96-2575a10d53ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:31.412536 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623faa63-e01f-4de6-bd96-2575a10d53ae service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:31.452293 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 888/1768] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:30 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:47:31.455856 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623faa63-e01f-4de6-bd96-2575a10d53ae service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:31.459737 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-623faa63-e01f-4de6-bd96-2575a10d53ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:31.573869 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e99eef-a121-46c4-a065-2dfee70e3086 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a4f25df9724d34afdd6a41e719546a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:31.574615 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e99eef-a121-46c4-a065-2dfee70e3086 service swift] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:31.574888 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e99eef-a121-46c4-a065-2dfee70e3086 service swift] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:31.575171 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e99eef-a121-46c4-a065-2dfee70e3086 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:31.583218 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e9e99eef-a121-46c4-a065-2dfee70e3086 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:31.592230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:31.742197 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623faa63-e01f-4de6-bd96-2575a10d53ae service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:31.766541 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cb1e3-df4c-447e-9571-7c0c6f86c46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:31.775459 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cb1e3-df4c-447e-9571-7c0c6f86c46a admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:31.775459 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cb1e3-df4c-447e-9571-7c0c6f86c46a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:31.775459 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cb1e3-df4c-447e-9571-7c0c6f86c46a admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:31.775459 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cb1e3-df4c-447e-9571-7c0c6f86c46a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:31.783635 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cb1e3-df4c-447e-9571-7c0c6f86c46a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:31.809766 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e99eef-a121-46c4-a065-2dfee70e3086 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:31.814221 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e99eef-a121-46c4-a065-2dfee70e3086 service swift] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:31.818237 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 889/1769] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:47:31.820484 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63503617-c20c-4016-bbfc-7ec792dfcd83 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:31.835716 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63503617-c20c-4016-bbfc-7ec792dfcd83 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:31.839167 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63503617-c20c-4016-bbfc-7ec792dfcd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:31.852780 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 881/1770] 10.222.0.26 () {60 vars in 1384 bytes} [Sun Sep 11 08:47:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 875 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 08:47:31.870019 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e99eef-a121-46c4-a065-2dfee70e3086 service swift] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:31.876778 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e9e99eef-a121-46c4-a065-2dfee70e3086 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:31.910607 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-63503617-c20c-4016-bbfc-7ec792dfcd83 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:31.912218 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-63503617-c20c-4016-bbfc-7ec792dfcd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:31.952085 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 890/1771] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:31.960475 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63503617-c20c-4016-bbfc-7ec792dfcd83 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:31.987646 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e99eef-a121-46c4-a065-2dfee70e3086 service swift] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:32.024646 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d4122-b16c-4064-b9aa-eaa26bf6e73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:32.025259 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63503617-c20c-4016-bbfc-7ec792dfcd83 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:32.027501 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d4122-b16c-4064-b9aa-eaa26bf6e73f admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:32.028704 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d4122-b16c-4064-b9aa-eaa26bf6e73f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:32.029930 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d4122-b16c-4064-b9aa-eaa26bf6e73f admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:32.033858 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d4122-b16c-4064-b9aa-eaa26bf6e73f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:32.045335 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d4122-b16c-4064-b9aa-eaa26bf6e73f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:32.047166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6210bf9-3fac-4fc0-a8cb-b4b67c379e9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:32.048428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6210bf9-3fac-4fc0-a8cb-b4b67c379e9e service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:32.050442 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6210bf9-3fac-4fc0-a8cb-b4b67c379e9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:32.051069 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6210bf9-3fac-4fc0-a8cb-b4b67c379e9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:32.062818 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c6210bf9-3fac-4fc0-a8cb-b4b67c379e9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:32.403001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 882/1772] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:47:31 2022] POST /identity/v3/projects => generated 389 bytes in 549 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:47:32.407563 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d4122-b16c-4064-b9aa-eaa26bf6e73f admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:32.409156 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6210bf9-3fac-4fc0-a8cb-b4b67c379e9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:32.412309 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6210bf9-3fac-4fc0-a8cb-b4b67c379e9e service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:32.479308 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 891/1773] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:31 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:47:32.517198 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6210bf9-3fac-4fc0-a8cb-b4b67c379e9e service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:32.524663 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c6210bf9-3fac-4fc0-a8cb-b4b67c379e9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:32.729508 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:32.786714 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6210bf9-3fac-4fc0-a8cb-b4b67c379e9e service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:32.999699 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d4122-b16c-4064-b9aa-eaa26bf6e73f admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:33.054761 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21cbb7-9ab9-4e4e-870f-45999e01c40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:33.063172 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21cbb7-9ab9-4e4e-870f-45999e01c40b admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:33.074951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21cbb7-9ab9-4e4e-870f-45999e01c40b admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:33.074951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21cbb7-9ab9-4e4e-870f-45999e01c40b admin admin] PATH_INFO: `/v3/projects/483c11b3243a473392118c67ce4b9fa5/users/a13f8f13fa9443e98dfbb0eeb629e1c9/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:33.229413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21cbb7-9ab9-4e4e-870f-45999e01c40b admin admin] RBAC: Authorizing `identity:create_grant(project_id=483c11b3243a473392118c67ce4b9fa5, user_id=a13f8f13fa9443e98dfbb0eeb629e1c9, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:33.245528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca3b47-6ce7-43dd-bcc0-ba8711ac0f62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:33.248080 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca3b47-6ce7-43dd-bcc0-ba8711ac0f62 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:33.248538 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca3b47-6ce7-43dd-bcc0-ba8711ac0f62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:33.251870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21cbb7-9ab9-4e4e-870f-45999e01c40b admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:33.252743 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca3b47-6ce7-43dd-bcc0-ba8711ac0f62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:33.293765 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca3b47-6ce7-43dd-bcc0-ba8711ac0f62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:33.295345 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca3b47-6ce7-43dd-bcc0-ba8711ac0f62 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:33.383990 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 883/1774] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:47:32 2022] PUT /identity/v3/projects/483c11b3243a473392118c67ce4b9fa5/users/a13f8f13fa9443e98dfbb0eeb629e1c9/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 980 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:33.384264 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 892/1775] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 904 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:47:33.387027 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21cbb7-9ab9-4e4e-870f-45999e01c40b admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:33.392504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca3b47-6ce7-43dd-bcc0-ba8711ac0f62 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:33.423208 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca3b47-6ce7-43dd-bcc0-ba8711ac0f62 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:33.629484 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:33.736371 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21cbb7-9ab9-4e4e-870f-45999e01c40b admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:33.743366 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e882e4f-e7cd-468c-9c4f-b3bebe8c9a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:33.745144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e882e4f-e7cd-468c-9c4f-b3bebe8c9a20 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:33.745531 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e882e4f-e7cd-468c-9c4f-b3bebe8c9a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:33.751528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e882e4f-e7cd-468c-9c4f-b3bebe8c9a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:33.751528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e882e4f-e7cd-468c-9c4f-b3bebe8c9a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:33.754319 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e882e4f-e7cd-468c-9c4f-b3bebe8c9a20 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:33.806732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 893/1776] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:47:33.813297 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e882e4f-e7cd-468c-9c4f-b3bebe8c9a20 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:33.830928 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e882e4f-e7cd-468c-9c4f-b3bebe8c9a20 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:33.836033 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d11df8-2091-49d7-aac0-c70f52a542ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:33.837094 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d11df8-2091-49d7-aac0-c70f52a542ce admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:33.837832 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d11df8-2091-49d7-aac0-c70f52a542ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:33.838506 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d11df8-2091-49d7-aac0-c70f52a542ce admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:33.839583 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d11df8-2091-49d7-aac0-c70f52a542ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:33.842671 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affdad5-fb14-4ae3-8c57-59167e13fc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:33.843945 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d11df8-2091-49d7-aac0-c70f52a542ce admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:33.852374 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affdad5-fb14-4ae3-8c57-59167e13fc02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:33.853068 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affdad5-fb14-4ae3-8c57-59167e13fc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:33.855743 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affdad5-fb14-4ae3-8c57-59167e13fc02 admin admin] PATH_INFO: `/v3/projects/483c11b3243a473392118c67ce4b9fa5/users/a13f8f13fa9443e98dfbb0eeb629e1c9/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:33.864927 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affdad5-fb14-4ae3-8c57-59167e13fc02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=483c11b3243a473392118c67ce4b9fa5, user_id=a13f8f13fa9443e98dfbb0eeb629e1c9, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:33.870808 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affdad5-fb14-4ae3-8c57-59167e13fc02 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:33.899851 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 894/1777] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:47:33 2022] PUT /identity/v3/projects/483c11b3243a473392118c67ce4b9fa5/users/a13f8f13fa9443e98dfbb0eeb629e1c9/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:47:33.932780 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cef95-f48a-4df9-8ae4-8305d84b88e3 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:33.932780 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cef95-f48a-4df9-8ae4-8305d84b88e3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:33.932780 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cef95-f48a-4df9-8ae4-8305d84b88e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:34.027213 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-af5cef95-f48a-4df9-8ae4-8305d84b88e3 None None] MFA Rules not processed for user `a13f8f13fa9443e98dfbb0eeb629e1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:34.028953 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-af5cef95-f48a-4df9-8ae4-8305d84b88e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:34.091914 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 884/1778] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:47:33 2022] POST /identity/v3/users => generated 301 bytes in 707 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:47:34.126413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d6c86-34ec-4e99-a24e-f25773b062b5 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:34.126413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d6c86-34ec-4e99-a24e-f25773b062b5 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:34.126413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d6c86-34ec-4e99-a24e-f25773b062b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:34.165891 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 895/1779] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:33 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:34.167564 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5cef95-f48a-4df9-8ae4-8305d84b88e3 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:34.210242 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-2a5d6c86-34ec-4e99-a24e-f25773b062b5 None None] MFA Rules not processed for user `7c86ca1e378c4042a1807c7a45aaab99`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:34.210242 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2a5d6c86-34ec-4e99-a24e-f25773b062b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:34.410369 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 885/1780] 10.222.0.50 () {58 vars in 1015 bytes} [Sun Sep 11 08:47:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:34.411513 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d6c86-34ec-4e99-a24e-f25773b062b5 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:34.488462 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5cef95-f48a-4df9-8ae4-8305d84b88e3 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:34.513230 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:34.515962 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fc7bd-17af-4015-8bc6-8d197f1eaf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:34.516612 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fc7bd-17af-4015-8bc6-8d197f1eaf44 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:34.517004 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fc7bd-17af-4015-8bc6-8d197f1eaf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:34.517628 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fc7bd-17af-4015-8bc6-8d197f1eaf44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:34.518447 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1fc7bd-17af-4015-8bc6-8d197f1eaf44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:34.527111 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1fc7bd-17af-4015-8bc6-8d197f1eaf44 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:34.583477 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 896/1781] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:47:34.585389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fc7bd-17af-4015-8bc6-8d197f1eaf44 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:34.589658 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d6c86-34ec-4e99-a24e-f25773b062b5 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:34.606968 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:34.607706 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b798ac-f506-4c34-80d0-9b60d25458db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:34.608516 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b798ac-f506-4c34-80d0-9b60d25458db service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:34.608905 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b798ac-f506-4c34-80d0-9b60d25458db service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:34.609298 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b798ac-f506-4c34-80d0-9b60d25458db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:34.618124 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fc7bd-17af-4015-8bc6-8d197f1eaf44 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:34.642809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b89a3-9f3f-4a3a-9e7c-b255b7a78656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:34.643631 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b89a3-9f3f-4a3a-9e7c-b255b7a78656 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:34.643987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b89a3-9f3f-4a3a-9e7c-b255b7a78656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:34.644328 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b89a3-9f3f-4a3a-9e7c-b255b7a78656 admin admin] PATH_INFO: `/v3/projects/d9a59d3c5bf7449da69be5703af1cf95/users/d3414a10ddac4d66bed577c61f5840bf/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:34.662086 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b798ac-f506-4c34-80d0-9b60d25458db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:34.663787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b798ac-f506-4c34-80d0-9b60d25458db service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:34.692712 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b89a3-9f3f-4a3a-9e7c-b255b7a78656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9a59d3c5bf7449da69be5703af1cf95, user_id=d3414a10ddac4d66bed577c61f5840bf, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:34.696004 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b89a3-9f3f-4a3a-9e7c-b255b7a78656 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:34.719625 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 886/1782] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:34 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:47:34.874990 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b798ac-f506-4c34-80d0-9b60d25458db service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:34.884820 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-73b798ac-f506-4c34-80d0-9b60d25458db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:34.913145 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 897/1783] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:47:34 2022] PUT /identity/v3/projects/d9a59d3c5bf7449da69be5703af1cf95/users/d3414a10ddac4d66bed577c61f5840bf/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:34.923152 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b89a3-9f3f-4a3a-9e7c-b255b7a78656 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:34.965964 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b798ac-f506-4c34-80d0-9b60d25458db service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:35.228679 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:35.263743 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e3666-3bc6-4ca2-9b5b-9035f9f12d5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:35.264691 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e3666-3bc6-4ca2-9b5b-9035f9f12d5d service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:35.265900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e3666-3bc6-4ca2-9b5b-9035f9f12d5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:35.266411 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e3666-3bc6-4ca2-9b5b-9035f9f12d5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:35.268088 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b89a3-9f3f-4a3a-9e7c-b255b7a78656 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:35.281442 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e3666-3bc6-4ca2-9b5b-9035f9f12d5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:35.283626 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e3666-3bc6-4ca2-9b5b-9035f9f12d5d service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:35.296248 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 887/1784] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:47:35.296577 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd68bee-c903-4846-b025-66d5b2712f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:35.297248 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd68bee-c903-4846-b025-66d5b2712f3c admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:35.297530 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd68bee-c903-4846-b025-66d5b2712f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:35.297699 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e3666-3bc6-4ca2-9b5b-9035f9f12d5d service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:35.297900 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd68bee-c903-4846-b025-66d5b2712f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:35.298463 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd68bee-c903-4846-b025-66d5b2712f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:35.312702 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd68bee-c903-4846-b025-66d5b2712f3c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:35.314602 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e3666-3bc6-4ca2-9b5b-9035f9f12d5d service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:35.319559 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b2af0-c4e7-4894-a378-26ef9c4fd5d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:35.321614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b2af0-c4e7-4894-a378-26ef9c4fd5d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:35.321614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b2af0-c4e7-4894-a378-26ef9c4fd5d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:35.321614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b2af0-c4e7-4894-a378-26ef9c4fd5d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:35.332710 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b2af0-c4e7-4894-a378-26ef9c4fd5d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:35.334778 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b2af0-c4e7-4894-a378-26ef9c4fd5d4 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:35.347307 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 888/1785] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:47:35.358980 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 898/1786] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:47:35.365314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b2af0-c4e7-4894-a378-26ef9c4fd5d4 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:35.399401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b2af0-c4e7-4894-a378-26ef9c4fd5d4 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:35.414388 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada855e-2bca-4d3f-9034-e452465ecf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:35.415693 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada855e-2bca-4d3f-9034-e452465ecf34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:35.418739 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada855e-2bca-4d3f-9034-e452465ecf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:35.418739 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada855e-2bca-4d3f-9034-e452465ecf34 admin admin] PATH_INFO: `/v3/projects/d9a59d3c5bf7449da69be5703af1cf95/users/d3414a10ddac4d66bed577c61f5840bf/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:35.420148 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada855e-2bca-4d3f-9034-e452465ecf34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9a59d3c5bf7449da69be5703af1cf95, user_id=d3414a10ddac4d66bed577c61f5840bf, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:35.428423 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada855e-2bca-4d3f-9034-e452465ecf34 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:35.494056 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 889/1787] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:47:35 2022] PUT /identity/v3/projects/d9a59d3c5bf7449da69be5703af1cf95/users/d3414a10ddac4d66bed577c61f5840bf/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:35.506671 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704825d-1d70-4bc2-8950-769d5268da76 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:35.507404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704825d-1d70-4bc2-8950-769d5268da76 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:35.508886 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704825d-1d70-4bc2-8950-769d5268da76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:35.701765 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-9704825d-1d70-4bc2-8950-769d5268da76 None None] MFA Rules not processed for user `d3414a10ddac4d66bed577c61f5840bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:35.707987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9704825d-1d70-4bc2-8950-769d5268da76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:35.804522 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada855e-2bca-4d3f-9034-e452465ecf34 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:35.847490 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:36.064855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada855e-2bca-4d3f-9034-e452465ecf34 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:36.075610 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab724e-06ae-43eb-bdc1-fe7a104acb9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:36.076932 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab724e-06ae-43eb-bdc1-fe7a104acb9c service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:36.078039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab724e-06ae-43eb-bdc1-fe7a104acb9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:36.078480 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab724e-06ae-43eb-bdc1-fe7a104acb9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:36.085168 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3eab724e-06ae-43eb-bdc1-fe7a104acb9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:36.119128 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 899/1788] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:35 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 615 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:36.128516 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704825d-1d70-4bc2-8950-769d5268da76 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:36.134654 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9704825d-1d70-4bc2-8950-769d5268da76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:36.156705 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:36.173978 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704825d-1d70-4bc2-8950-769d5268da76 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:36.198487 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b724ca-1caa-485d-92f1-2196b91ce7f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:36.199769 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b724ca-1caa-485d-92f1-2196b91ce7f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:36.200028 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b724ca-1caa-485d-92f1-2196b91ce7f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:36.201166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b724ca-1caa-485d-92f1-2196b91ce7f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:36.236280 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b724ca-1caa-485d-92f1-2196b91ce7f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:36.238072 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b724ca-1caa-485d-92f1-2196b91ce7f6 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:36.254734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 900/1789] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:36 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:47:36.268950 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab724e-06ae-43eb-bdc1-fe7a104acb9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:36.271589 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab724e-06ae-43eb-bdc1-fe7a104acb9c service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:36.328115 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 890/1790] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:35 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:47:36.638858 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b724ca-1caa-485d-92f1-2196b91ce7f6 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:36.829452 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b724ca-1caa-485d-92f1-2196b91ce7f6 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:36.837857 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85044d0-7177-449f-8f1f-b3a88ceb60d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:36.838986 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85044d0-7177-449f-8f1f-b3a88ceb60d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:36.839513 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85044d0-7177-449f-8f1f-b3a88ceb60d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:36.840361 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85044d0-7177-449f-8f1f-b3a88ceb60d9 admin admin] PATH_INFO: `/v3/users/5efe0f170fdb44d9bfb594b8f0caf394` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:36.842737 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85044d0-7177-449f-8f1f-b3a88ceb60d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5efe0f170fdb44d9bfb594b8f0caf394)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:36.846609 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85044d0-7177-449f-8f1f-b3a88ceb60d9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:36.943097 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab724e-06ae-43eb-bdc1-fe7a104acb9c service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:36.945508 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3eab724e-06ae-43eb-bdc1-fe7a104acb9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:37.005546 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab724e-06ae-43eb-bdc1-fe7a104acb9c service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:37.025252 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576cf04-713f-480a-b357-f71911dfc960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:37.027667 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576cf04-713f-480a-b357-f71911dfc960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:37.030166 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576cf04-713f-480a-b357-f71911dfc960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:37.031896 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576cf04-713f-480a-b357-f71911dfc960 admin admin] PATH_INFO: `/v3/projects/6af97c52aec644db9971a138c2142005` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:37.036669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576cf04-713f-480a-b357-f71911dfc960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6af97c52aec644db9971a138c2142005)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:37.051809 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576cf04-713f-480a-b357-f71911dfc960 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:37.303967 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e85044d0-7177-449f-8f1f-b3a88ceb60d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5efe0f170fdb44d9bfb594b8f0caf394'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:37.304269 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a576cf04-713f-480a-b357-f71911dfc960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6af97c52aec644db9971a138c2142005', 'request_id': 'req-a576cf04-713f-480a-b357-f71911dfc960'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:37.310453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a576cf04-713f-480a-b357-f71911dfc960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6af97c52aec644db9971a138c2142005', 'request_id': 'req-a576cf04-713f-480a-b357-f71911dfc960'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:37.440391 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e85044d0-7177-449f-8f1f-b3a88ceb60d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5efe0f170fdb44d9bfb594b8f0caf394'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:37.441643 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e85044d0-7177-449f-8f1f-b3a88ceb60d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5efe0f170fdb44d9bfb594b8f0caf394'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:37.442100 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:37.442884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e85044d0-7177-449f-8f1f-b3a88ceb60d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5efe0f170fdb44d9bfb594b8f0caf394'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:37.483662 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e85044d0-7177-449f-8f1f-b3a88ceb60d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5efe0f170fdb44d9bfb594b8f0caf394'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:37.533629 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a576cf04-713f-480a-b357-f71911dfc960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6af97c52aec644db9971a138c2142005', 'request_id': 'req-a576cf04-713f-480a-b357-f71911dfc960'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:37.552711 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 901/1791] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:47:36 2022] DELETE /identity/v3/users/5efe0f170fdb44d9bfb594b8f0caf394 => generated 0 bytes in 910 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:37.566808 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cd54f-7dcb-4476-bfd0-b2c71d978176 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:37.567128 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cd54f-7dcb-4476-bfd0-b2c71d978176 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:37.567436 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cd54f-7dcb-4476-bfd0-b2c71d978176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:37.608981 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a576cf04-713f-480a-b357-f71911dfc960 admin admin] The token cache is being invalidate because project 6af97c52aec644db9971a138c2142005 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:47:37.611414 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a576cf04-713f-480a-b357-f71911dfc960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:37.619517 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a576cf04-713f-480a-b357-f71911dfc960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:37.621556 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-243cd54f-7dcb-4476-bfd0-b2c71d978176 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:37.626786 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-243cd54f-7dcb-4476-bfd0-b2c71d978176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:37.635759 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 891/1792] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:47:36 2022] DELETE /identity/v3/projects/6af97c52aec644db9971a138c2142005 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:37.640677 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576cf04-713f-480a-b357-f71911dfc960 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:37.642476 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-a576cf04-713f-480a-b357-f71911dfc960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:37.679701 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:37.772610 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 902/1793] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:37.807905 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243cd54f-7dcb-4476-bfd0-b2c71d978176 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:37.812413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-243cd54f-7dcb-4476-bfd0-b2c71d978176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:37.896084 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576cf04-713f-480a-b357-f71911dfc960 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:37.923130 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d81869-9c88-4fb3-bf0e-6b3a4989672c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:37.926988 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d81869-9c88-4fb3-bf0e-6b3a4989672c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:37.927528 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d81869-9c88-4fb3-bf0e-6b3a4989672c admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:37.927916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d81869-9c88-4fb3-bf0e-6b3a4989672c admin admin] PATH_INFO: `/v3/users/1564d0e54c794cd8a4be68c4bd3da88e` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:37.929395 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d81869-9c88-4fb3-bf0e-6b3a4989672c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1564d0e54c794cd8a4be68c4bd3da88e)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:37.933830 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d81869-9c88-4fb3-bf0e-6b3a4989672c admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:37.986775 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243cd54f-7dcb-4476-bfd0-b2c71d978176 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:37.991618 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298ba9a-0461-47c5-aed2-a7080291fcbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:37.993619 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298ba9a-0461-47c5-aed2-a7080291fcbd service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:37.993619 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298ba9a-0461-47c5-aed2-a7080291fcbd service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:37.993619 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298ba9a-0461-47c5-aed2-a7080291fcbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:38.007852 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298ba9a-0461-47c5-aed2-a7080291fcbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:38.009956 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298ba9a-0461-47c5-aed2-a7080291fcbd service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:38.026491 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 903/1794] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:47:38.201649 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985c181-8924-4b09-b0cd-2b5fd741813b None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:38.203733 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985c181-8924-4b09-b0cd-2b5fd741813b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:38.204115 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985c181-8924-4b09-b0cd-2b5fd741813b None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:38.205533 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 904/1795] 10.222.0.26 () {54 vars in 921 bytes} [Sun Sep 11 08:47:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:47:38.239662 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f01a0-9b93-40b4-90e3-57fc8be6f6c4 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:38.240589 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f01a0-9b93-40b4-90e3-57fc8be6f6c4 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:38.241840 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f01a0-9b93-40b4-90e3-57fc8be6f6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:38.306265 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-d52f01a0-9b93-40b4-90e3-57fc8be6f6c4 None None] MFA Rules not processed for user `e62bb9d2e13649b5af239bb56001ce16`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:38.341919 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d52f01a0-9b93-40b4-90e3-57fc8be6f6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:38.364383 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f7d81869-9c88-4fb3-bf0e-6b3a4989672c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1564d0e54c794cd8a4be68c4bd3da88e'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:38.366854 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f7d81869-9c88-4fb3-bf0e-6b3a4989672c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1564d0e54c794cd8a4be68c4bd3da88e'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:38.393289 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f7d81869-9c88-4fb3-bf0e-6b3a4989672c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1564d0e54c794cd8a4be68c4bd3da88e'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:38.394361 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f7d81869-9c88-4fb3-bf0e-6b3a4989672c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1564d0e54c794cd8a4be68c4bd3da88e'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:38.486661 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f7d81869-9c88-4fb3-bf0e-6b3a4989672c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1564d0e54c794cd8a4be68c4bd3da88e'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:38.552074 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 892/1796] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:47:37 2022] DELETE /identity/v3/users/1564d0e54c794cd8a4be68c4bd3da88e => generated 0 bytes in 909 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:38.637560 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 905/1797] 10.222.0.26 () {58 vars in 1018 bytes} [Sun Sep 11 08:47:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:38.931904 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:39.004967 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d81869-9c88-4fb3-bf0e-6b3a4989672c admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:39.009137 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f7d81869-9c88-4fb3-bf0e-6b3a4989672c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:39.172931 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d81869-9c88-4fb3-bf0e-6b3a4989672c admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:39.182488 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde7fbd-c41e-4dee-9679-c81251e0a681 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:39.184475 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde7fbd-c41e-4dee-9679-c81251e0a681 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:39.185271 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde7fbd-c41e-4dee-9679-c81251e0a681 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:39.185944 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde7fbd-c41e-4dee-9679-c81251e0a681 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:39.197758 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde7fbd-c41e-4dee-9679-c81251e0a681 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:39.199664 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde7fbd-c41e-4dee-9679-c81251e0a681 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:39.225856 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 893/1798] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:47:39.506029 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f01a0-9b93-40b4-90e3-57fc8be6f6c4 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:39.507967 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d52f01a0-9b93-40b4-90e3-57fc8be6f6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:39.577930 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f01a0-9b93-40b4-90e3-57fc8be6f6c4 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:39.921497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a17c1-2551-4a91-84f0-7c1f402a60d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:39.922376 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a17c1-2551-4a91-84f0-7c1f402a60d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:39.922779 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a17c1-2551-4a91-84f0-7c1f402a60d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:39.923204 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a17c1-2551-4a91-84f0-7c1f402a60d5 admin admin] PATH_INFO: `/v3/projects/9e07fe11e1ba41f8a0c87472f36f7639` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:39.926603 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a17c1-2551-4a91-84f0-7c1f402a60d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e07fe11e1ba41f8a0c87472f36f7639)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:39.928782 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a17c1-2551-4a91-84f0-7c1f402a60d5 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:40.013688 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:40.758962 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5d0a17c1-2551-4a91-84f0-7c1f402a60d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e07fe11e1ba41f8a0c87472f36f7639', 'request_id': 'req-5d0a17c1-2551-4a91-84f0-7c1f402a60d5'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:40.758962 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5d0a17c1-2551-4a91-84f0-7c1f402a60d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e07fe11e1ba41f8a0c87472f36f7639', 'request_id': 'req-5d0a17c1-2551-4a91-84f0-7c1f402a60d5'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:41.064095 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5d0a17c1-2551-4a91-84f0-7c1f402a60d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e07fe11e1ba41f8a0c87472f36f7639', 'request_id': 'req-5d0a17c1-2551-4a91-84f0-7c1f402a60d5'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:41.104733 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5d0a17c1-2551-4a91-84f0-7c1f402a60d5 admin admin] The token cache is being invalidate because project 9e07fe11e1ba41f8a0c87472f36f7639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:47:41.109152 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5d0a17c1-2551-4a91-84f0-7c1f402a60d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:41.109152 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5d0a17c1-2551-4a91-84f0-7c1f402a60d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:41.119187 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 906/1799] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:47:39 2022] DELETE /identity/v3/projects/9e07fe11e1ba41f8a0c87472f36f7639 => generated 0 bytes in 1608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:41.121421 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde7fbd-c41e-4dee-9679-c81251e0a681 service nova] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:41.122707 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a17c1-2551-4a91-84f0-7c1f402a60d5 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:41.124557 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3fde7fbd-c41e-4dee-9679-c81251e0a681 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:41.126012 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5d0a17c1-2551-4a91-84f0-7c1f402a60d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:41.168557 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde7fbd-c41e-4dee-9679-c81251e0a681 service nova] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:41.270460 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:41.367078 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbe139-296c-42c9-a891-b32f2e416b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:41.368067 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbe139-296c-42c9-a891-b32f2e416b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:41.368506 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbe139-296c-42c9-a891-b32f2e416b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:41.368934 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbe139-296c-42c9-a891-b32f2e416b13 admin admin] PATH_INFO: `/v3/projects/eae65ac638b7457aa9cb35880d705ac5` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:41.372265 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbe139-296c-42c9-a891-b32f2e416b13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eae65ac638b7457aa9cb35880d705ac5)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:41.385057 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbe139-296c-42c9-a891-b32f2e416b13 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:41.537654 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a17c1-2551-4a91-84f0-7c1f402a60d5 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:41.558286 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba9b32-2cca-4e7b-833c-b6d688d3411f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:41.560907 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba9b32-2cca-4e7b-833c-b6d688d3411f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:41.561423 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba9b32-2cca-4e7b-833c-b6d688d3411f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:41.562798 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba9b32-2cca-4e7b-833c-b6d688d3411f admin admin] PATH_INFO: `/v3/users/d3414a10ddac4d66bed577c61f5840bf` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:41.569584 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba9b32-2cca-4e7b-833c-b6d688d3411f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3414a10ddac4d66bed577c61f5840bf)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:41.579633 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba9b32-2cca-4e7b-833c-b6d688d3411f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:41.690514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-b6cbe139-296c-42c9-a891-b32f2e416b13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eae65ac638b7457aa9cb35880d705ac5', 'request_id': 'req-b6cbe139-296c-42c9-a891-b32f2e416b13'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:41.766732 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-b6cbe139-296c-42c9-a891-b32f2e416b13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eae65ac638b7457aa9cb35880d705ac5', 'request_id': 'req-b6cbe139-296c-42c9-a891-b32f2e416b13'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:41.946899 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-b6cbe139-296c-42c9-a891-b32f2e416b13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eae65ac638b7457aa9cb35880d705ac5', 'request_id': 'req-b6cbe139-296c-42c9-a891-b32f2e416b13'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:41.995461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-b6cbe139-296c-42c9-a891-b32f2e416b13 admin admin] The token cache is being invalidate because project eae65ac638b7457aa9cb35880d705ac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:47:41.996691 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-b6cbe139-296c-42c9-a891-b32f2e416b13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:41.998521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-b6cbe139-296c-42c9-a891-b32f2e416b13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:42.003572 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 894/1800] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:47:41 2022] DELETE /identity/v3/projects/eae65ac638b7457aa9cb35880d705ac5 => generated 0 bytes in 883 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:42.013497 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba059d-9591-4bd1-b02c-f4489c225a62 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:42.015156 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba059d-9591-4bd1-b02c-f4489c225a62 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:42.016979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba059d-9591-4bd1-b02c-f4489c225a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:42.069770 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-01ba9b32-2cca-4e7b-833c-b6d688d3411f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3414a10ddac4d66bed577c61f5840bf'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:42.072763 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-81ba059d-9591-4bd1-b02c-f4489c225a62 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:42.075170 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-81ba059d-9591-4bd1-b02c-f4489c225a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:42.182811 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-01ba9b32-2cca-4e7b-833c-b6d688d3411f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3414a10ddac4d66bed577c61f5840bf'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:42.183532 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-01ba9b32-2cca-4e7b-833c-b6d688d3411f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3414a10ddac4d66bed577c61f5840bf'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:42.185144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-01ba9b32-2cca-4e7b-833c-b6d688d3411f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3414a10ddac4d66bed577c61f5840bf'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:42.201133 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-01ba9b32-2cca-4e7b-833c-b6d688d3411f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3414a10ddac4d66bed577c61f5840bf'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:42.265912 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 895/1801] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:42.273890 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 907/1802] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:47:41 2022] DELETE /identity/v3/users/d3414a10ddac4d66bed577c61f5840bf => generated 0 bytes in 1148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:42.280160 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa4fcb-4f27-404e-b008-80872237cd97 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:42.281791 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa4fcb-4f27-404e-b008-80872237cd97 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:42.284065 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa4fcb-4f27-404e-b008-80872237cd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:42.353556 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-7baa4fcb-4f27-404e-b008-80872237cd97 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:42.367708 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7baa4fcb-4f27-404e-b008-80872237cd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:42.676068 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba9b32-2cca-4e7b-833c-b6d688d3411f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:42.684010 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 896/1803] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:42.696004 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba9b32-2cca-4e7b-833c-b6d688d3411f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:42.703569 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7588caa-9f3a-4d55-acaa-0cd48a58f9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:42.704787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7588caa-9f3a-4d55-acaa-0cd48a58f9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:42.705668 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7588caa-9f3a-4d55-acaa-0cd48a58f9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:42.706349 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7588caa-9f3a-4d55-acaa-0cd48a58f9d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:42.708875 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7588caa-9f3a-4d55-acaa-0cd48a58f9d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:47:42.709594 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7588caa-9f3a-4d55-acaa-0cd48a58f9d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:42.711847 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7588caa-9f3a-4d55-acaa-0cd48a58f9d9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:42.726768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:42.735788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 908/1804] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:47:42.737708 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa4fcb-4f27-404e-b008-80872237cd97 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:42.769258 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa4fcb-4f27-404e-b008-80872237cd97 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:42.781409 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d5f23-7e74-42b7-b027-a4cbfef107da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:42.782723 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d5f23-7e74-42b7-b027-a4cbfef107da admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:42.783620 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d5f23-7e74-42b7-b027-a4cbfef107da admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:42.785782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d5f23-7e74-42b7-b027-a4cbfef107da admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:42.787573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d5f23-7e74-42b7-b027-a4cbfef107da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:42.794007 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d5f23-7e74-42b7-b027-a4cbfef107da admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:42.968616 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 897/1805] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:47:42 2022] POST /identity/v3/projects => generated 387 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:47:42.973244 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7588caa-9f3a-4d55-acaa-0cd48a58f9d9 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:42.997248 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7588caa-9f3a-4d55-acaa-0cd48a58f9d9 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:43.155961 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b08e44-768e-4a0a-9d81-e9abee9b4767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:43.157698 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b08e44-768e-4a0a-9d81-e9abee9b4767 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:43.158250 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b08e44-768e-4a0a-9d81-e9abee9b4767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:43.158967 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b08e44-768e-4a0a-9d81-e9abee9b4767 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:43.160011 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b08e44-768e-4a0a-9d81-e9abee9b4767 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:43.162551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b08e44-768e-4a0a-9d81-e9abee9b4767 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:43.323099 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 909/1806] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:47:42 2022] POST /identity/v3/users => generated 294 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:47:43.329404 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d5f23-7e74-42b7-b027-a4cbfef107da admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:43.348845 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d5f23-7e74-42b7-b027-a4cbfef107da admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:43.357323 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66070d4b-a427-48a9-ad8a-24e33905b7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:43.358856 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66070d4b-a427-48a9-ad8a-24e33905b7fa admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:43.359636 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66070d4b-a427-48a9-ad8a-24e33905b7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:43.360529 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66070d4b-a427-48a9-ad8a-24e33905b7fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:43.361851 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66070d4b-a427-48a9-ad8a-24e33905b7fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:43.364561 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66070d4b-a427-48a9-ad8a-24e33905b7fa admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:43.378264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 898/1807] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:47:43.384862 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b08e44-768e-4a0a-9d81-e9abee9b4767 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:43.416897 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b08e44-768e-4a0a-9d81-e9abee9b4767 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:43.425328 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0377e83-86c4-4af6-8e97-3cd298119e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:43.427147 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0377e83-86c4-4af6-8e97-3cd298119e5f admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:43.427147 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0377e83-86c4-4af6-8e97-3cd298119e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:43.427357 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0377e83-86c4-4af6-8e97-3cd298119e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:43.428591 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0377e83-86c4-4af6-8e97-3cd298119e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:43.431957 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0377e83-86c4-4af6-8e97-3cd298119e5f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:43.476952 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66070d4b-a427-48a9-ad8a-24e33905b7fa admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:43.493772 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:43.499803 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 910/1808] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:47:43.564261 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66070d4b-a427-48a9-ad8a-24e33905b7fa admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:43.596345 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4fc83-adde-4951-978b-98a10b2fc1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:43.597750 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4fc83-adde-4951-978b-98a10b2fc1e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:43.598245 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4fc83-adde-4951-978b-98a10b2fc1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:43.598911 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4fc83-adde-4951-978b-98a10b2fc1e8 admin admin] PATH_INFO: `/v3/projects/f7fdd234f5024140803eabf9de7b4b07/users/ac570a18e9964f4eaddbf1e66c578d5d/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:43.655875 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4fc83-adde-4951-978b-98a10b2fc1e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7fdd234f5024140803eabf9de7b4b07, user_id=ac570a18e9964f4eaddbf1e66c578d5d, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:43.665178 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4fc83-adde-4951-978b-98a10b2fc1e8 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:43.804700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 899/1809] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:47:43 2022] PUT /identity/v3/projects/f7fdd234f5024140803eabf9de7b4b07/users/ac570a18e9964f4eaddbf1e66c578d5d/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:43.828359 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe2cac-bade-41a6-904b-3345fa59a2ca None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:43.828652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe2cac-bade-41a6-904b-3345fa59a2ca None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:43.829235 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe2cac-bade-41a6-904b-3345fa59a2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:43.884878 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-bfbe2cac-bade-41a6-904b-3345fa59a2ca None None] MFA Rules not processed for user `ac570a18e9964f4eaddbf1e66c578d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:43.886292 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-bfbe2cac-bade-41a6-904b-3345fa59a2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:44.094620 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 911/1810] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:44.098518 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4fc83-adde-4951-978b-98a10b2fc1e8 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:44.305150 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4fc83-adde-4951-978b-98a10b2fc1e8 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:44.316596 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d42dfd-5785-4ab7-bdf9-a66d864145f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:44.317407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d42dfd-5785-4ab7-bdf9-a66d864145f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:44.318031 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d42dfd-5785-4ab7-bdf9-a66d864145f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:44.320621 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d42dfd-5785-4ab7-bdf9-a66d864145f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:44.320621 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d42dfd-5785-4ab7-bdf9-a66d864145f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:44.326209 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d42dfd-5785-4ab7-bdf9-a66d864145f3 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:44.455395 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 900/1811] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:47:44 2022] POST /identity/v3/projects => generated 385 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:47:44.456847 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe2cac-bade-41a6-904b-3345fa59a2ca None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:44.481969 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe2cac-bade-41a6-904b-3345fa59a2ca None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:44.783863 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d741d4-46f1-45ba-875b-a8511db095a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:44.784509 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d741d4-46f1-45ba-875b-a8511db095a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:44.784852 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d741d4-46f1-45ba-875b-a8511db095a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:44.785194 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d741d4-46f1-45ba-875b-a8511db095a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:44.785881 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d741d4-46f1-45ba-875b-a8511db095a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:44.789540 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d741d4-46f1-45ba-875b-a8511db095a6 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:44.925753 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:44.944575 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 912/1812] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:47:44 2022] POST /identity/v3/users => generated 299 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:47:44.948702 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d42dfd-5785-4ab7-bdf9-a66d864145f3 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:44.963987 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d42dfd-5785-4ab7-bdf9-a66d864145f3 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:44.982537 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ed0e8-56f0-4b4d-87ff-ffd8afc539a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:44.984124 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ed0e8-56f0-4b4d-87ff-ffd8afc539a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:44.984751 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ed0e8-56f0-4b4d-87ff-ffd8afc539a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:44.985025 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ed0e8-56f0-4b4d-87ff-ffd8afc539a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:44.985849 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ed0e8-56f0-4b4d-87ff-ffd8afc539a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:44.990410 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ed0e8-56f0-4b4d-87ff-ffd8afc539a6 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:45.020303 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 901/1813] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:47:45.023461 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d741d4-46f1-45ba-875b-a8511db095a6 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:45.041087 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d741d4-46f1-45ba-875b-a8511db095a6 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:45.047749 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88905626-5c3e-4d61-b23e-81a818ebe7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:45.048836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88905626-5c3e-4d61-b23e-81a818ebe7b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:45.048836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88905626-5c3e-4d61-b23e-81a818ebe7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:45.048836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88905626-5c3e-4d61-b23e-81a818ebe7b2 admin admin] PATH_INFO: `/v3/projects/8f14406c82004d3abd7f637dbfba369d/users/ac08f9cf3878409986afad01e4047c32/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:45.070258 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88905626-5c3e-4d61-b23e-81a818ebe7b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f14406c82004d3abd7f637dbfba369d, user_id=ac08f9cf3878409986afad01e4047c32, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:45.083489 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88905626-5c3e-4d61-b23e-81a818ebe7b2 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:45.113561 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57758109-cf10-4f4c-b662-f961a3c20a1f None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:45.114021 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57758109-cf10-4f4c-b662-f961a3c20a1f None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:45.114539 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57758109-cf10-4f4c-b662-f961a3c20a1f None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:45.117303 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 902/1814] 10.222.0.26 () {54 vars in 921 bytes} [Sun Sep 11 08:47:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:47:45.124825 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:45.155802 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f47e7-d948-4b44-88d2-d4670d7cecef None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:45.156975 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f47e7-d948-4b44-88d2-d4670d7cecef None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:45.157827 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f47e7-d948-4b44-88d2-d4670d7cecef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:45.200602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 913/1815] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:47:45 2022] PUT /identity/v3/projects/8f14406c82004d3abd7f637dbfba369d/users/ac08f9cf3878409986afad01e4047c32/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:47:45.210890 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88905626-5c3e-4d61-b23e-81a818ebe7b2 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:45.232652 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-a10f47e7-d948-4b44-88d2-d4670d7cecef None None] MFA Rules not processed for user `e62bb9d2e13649b5af239bb56001ce16`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:45.236319 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-a10f47e7-d948-4b44-88d2-d4670d7cecef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:45.487714 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 903/1816] 10.222.0.26 () {58 vars in 1018 bytes} [Sun Sep 11 08:47:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:45.622167 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88905626-5c3e-4d61-b23e-81a818ebe7b2 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:45.645762 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dce945-3a31-45b2-8966-b4b8b69ceaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:45.650318 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dce945-3a31-45b2-8966-b4b8b69ceaa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:45.650962 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dce945-3a31-45b2-8966-b4b8b69ceaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:45.652337 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dce945-3a31-45b2-8966-b4b8b69ceaa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:45.653527 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dce945-3a31-45b2-8966-b4b8b69ceaa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:45.661255 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dce945-3a31-45b2-8966-b4b8b69ceaa6 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:45.710986 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f47e7-d948-4b44-88d2-d4670d7cecef None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:45.714729 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-a10f47e7-d948-4b44-88d2-d4670d7cecef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:45.716778 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 914/1817] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 508 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:47:45.735869 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dce945-3a31-45b2-8966-b4b8b69ceaa6 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:45.778257 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dce945-3a31-45b2-8966-b4b8b69ceaa6 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:45.795170 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6e572-e0df-401a-9736-7300757ff117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:45.796096 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6e572-e0df-401a-9736-7300757ff117 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:45.796384 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6e572-e0df-401a-9736-7300757ff117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:45.796793 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6e572-e0df-401a-9736-7300757ff117 admin admin] PATH_INFO: `/v3/projects/8f14406c82004d3abd7f637dbfba369d/users/ac08f9cf3878409986afad01e4047c32/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:45.798563 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f47e7-d948-4b44-88d2-d4670d7cecef None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:45.800042 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6e572-e0df-401a-9736-7300757ff117 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f14406c82004d3abd7f637dbfba369d, user_id=ac08f9cf3878409986afad01e4047c32, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:45.804479 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6e572-e0df-401a-9736-7300757ff117 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:45.822479 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c7119-452f-45cd-9406-a239645e0a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:45.824822 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c7119-452f-45cd-9406-a239645e0a3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:45.825361 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c7119-452f-45cd-9406-a239645e0a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:45.825955 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c7119-452f-45cd-9406-a239645e0a3a admin admin] PATH_INFO: `/v3/projects/d9a59d3c5bf7449da69be5703af1cf95` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:45.829158 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c7119-452f-45cd-9406-a239645e0a3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9a59d3c5bf7449da69be5703af1cf95)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:45.840377 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 915/1818] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:47:45 2022] PUT /identity/v3/projects/8f14406c82004d3abd7f637dbfba369d/users/ac08f9cf3878409986afad01e4047c32/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:45.848238 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c7119-452f-45cd-9406-a239645e0a3a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:45.853158 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98238bb-db46-4bff-90c5-0f8d0bad7878 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:45.853483 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98238bb-db46-4bff-90c5-0f8d0bad7878 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:45.853810 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98238bb-db46-4bff-90c5-0f8d0bad7878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:45.921913 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e98238bb-db46-4bff-90c5-0f8d0bad7878 None None] MFA Rules not processed for user `ac08f9cf3878409986afad01e4047c32`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:45.925087 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e98238bb-db46-4bff-90c5-0f8d0bad7878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:46.151905 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d15c7119-452f-45cd-9406-a239645e0a3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9a59d3c5bf7449da69be5703af1cf95', 'request_id': 'req-d15c7119-452f-45cd-9406-a239645e0a3a'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:46.190956 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d15c7119-452f-45cd-9406-a239645e0a3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9a59d3c5bf7449da69be5703af1cf95', 'request_id': 'req-d15c7119-452f-45cd-9406-a239645e0a3a'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:46.236616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 916/1819] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:46.249335 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98238bb-db46-4bff-90c5-0f8d0bad7878 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:46.256389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e98238bb-db46-4bff-90c5-0f8d0bad7878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:46.349538 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d15c7119-452f-45cd-9406-a239645e0a3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9a59d3c5bf7449da69be5703af1cf95', 'request_id': 'req-d15c7119-452f-45cd-9406-a239645e0a3a'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:46.409253 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d15c7119-452f-45cd-9406-a239645e0a3a admin admin] The token cache is being invalidate because project d9a59d3c5bf7449da69be5703af1cf95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:47:46.412108 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d15c7119-452f-45cd-9406-a239645e0a3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:46.412835 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:46.417621 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d15c7119-452f-45cd-9406-a239645e0a3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:46.425717 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 904/1820] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:47:45 2022] DELETE /identity/v3/projects/d9a59d3c5bf7449da69be5703af1cf95 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:46.444877 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98238bb-db46-4bff-90c5-0f8d0bad7878 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:46.453053 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2326d4-65b1-42a9-a750-780d88df1e83 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:46.458729 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2326d4-65b1-42a9-a750-780d88df1e83 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:46.459953 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2326d4-65b1-42a9-a750-780d88df1e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:46.584090 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-cf2326d4-65b1-42a9-a750-780d88df1e83 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:46.602547 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-cf2326d4-65b1-42a9-a750-780d88df1e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:46.608371 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b75d11-c373-4602-bc39-7a6b4f71d7a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:46.611510 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b75d11-c373-4602-bc39-7a6b4f71d7a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:46.612501 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b75d11-c373-4602-bc39-7a6b4f71d7a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:46.613806 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b75d11-c373-4602-bc39-7a6b4f71d7a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:46.618186 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e2b75d11-c373-4602-bc39-7a6b4f71d7a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:46.826554 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b75d11-c373-4602-bc39-7a6b4f71d7a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:46.831020 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b75d11-c373-4602-bc39-7a6b4f71d7a5 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:46.833792 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 905/1821] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:46.849097 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a9aa5-280f-4a7e-8c0a-9fa65c03bebd None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:46.850153 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a9aa5-280f-4a7e-8c0a-9fa65c03bebd None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:46.851062 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a9aa5-280f-4a7e-8c0a-9fa65c03bebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:46.932586 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 917/1822] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:47:46.934588 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-5b2a9aa5-280f-4a7e-8c0a-9fa65c03bebd None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:46.934588 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5b2a9aa5-280f-4a7e-8c0a-9fa65c03bebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:46.934588 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 906/1823] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:47:46.942417 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b75d11-c373-4602-bc39-7a6b4f71d7a5 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:46.994836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b75d11-c373-4602-bc39-7a6b4f71d7a5 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:47.019202 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d93c5-653d-4065-a6e0-6b8211493dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:47.024476 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d93c5-653d-4065-a6e0-6b8211493dce admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:47.025294 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d93c5-653d-4065-a6e0-6b8211493dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:47.025857 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d93c5-653d-4065-a6e0-6b8211493dce admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:47.027007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d93c5-653d-4065-a6e0-6b8211493dce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:47:47.027581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d93c5-653d-4065-a6e0-6b8211493dce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:47.029714 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d93c5-653d-4065-a6e0-6b8211493dce admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:47.067238 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a9aa5-280f-4a7e-8c0a-9fa65c03bebd None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:47.067939 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 918/1824] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:47:47.085169 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d93c5-653d-4065-a6e0-6b8211493dce admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:47.102649 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a37d93c5-653d-4065-a6e0-6b8211493dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:47.105182 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a9aa5-280f-4a7e-8c0a-9fa65c03bebd None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:47.120743 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72307b0b-9494-46d9-b3ed-b7e46f700229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:47.122176 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72307b0b-9494-46d9-b3ed-b7e46f700229 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:47.122745 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72307b0b-9494-46d9-b3ed-b7e46f700229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:47.124207 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72307b0b-9494-46d9-b3ed-b7e46f700229 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:47.125510 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72307b0b-9494-46d9-b3ed-b7e46f700229 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:47.127549 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d93c5-653d-4065-a6e0-6b8211493dce admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:47.128293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72307b0b-9494-46d9-b3ed-b7e46f700229 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:47.172298 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18180133-7c15-4925-87a7-9602b56681b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:47.173067 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18180133-7c15-4925-87a7-9602b56681b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:47.173364 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18180133-7c15-4925-87a7-9602b56681b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:47.173681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18180133-7c15-4925-87a7-9602b56681b3 admin admin] PATH_INFO: `/v3/users/ac570a18e9964f4eaddbf1e66c578d5d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:47.179704 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18180133-7c15-4925-87a7-9602b56681b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac570a18e9964f4eaddbf1e66c578d5d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:47.182009 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18180133-7c15-4925-87a7-9602b56681b3 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:47.566281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 907/1825] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:47:47 2022] POST /identity/v3/projects => generated 387 bytes in 494 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:47:47.568698 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72307b0b-9494-46d9-b3ed-b7e46f700229 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:47.571940 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-72307b0b-9494-46d9-b3ed-b7e46f700229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:47.793176 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-18180133-7c15-4925-87a7-9602b56681b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac570a18e9964f4eaddbf1e66c578d5d'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:47.805127 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72307b0b-9494-46d9-b3ed-b7e46f700229 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:47.822884 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981310e-cc11-4d8c-8ab0-5d44c55ca665 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:47.825587 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981310e-cc11-4d8c-8ab0-5d44c55ca665 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:47.826380 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981310e-cc11-4d8c-8ab0-5d44c55ca665 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:47.827720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981310e-cc11-4d8c-8ab0-5d44c55ca665 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:47.833557 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2981310e-cc11-4d8c-8ab0-5d44c55ca665 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:47.875453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981310e-cc11-4d8c-8ab0-5d44c55ca665 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:47.878537 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981310e-cc11-4d8c-8ab0-5d44c55ca665 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:47.914353 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 908/1826] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:47:47.917531 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981310e-cc11-4d8c-8ab0-5d44c55ca665 service nova] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:47.984560 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-18180133-7c15-4925-87a7-9602b56681b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac570a18e9964f4eaddbf1e66c578d5d'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:47.986456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-18180133-7c15-4925-87a7-9602b56681b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac570a18e9964f4eaddbf1e66c578d5d'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:47.992477 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-18180133-7c15-4925-87a7-9602b56681b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac570a18e9964f4eaddbf1e66c578d5d'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:48.018245 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981310e-cc11-4d8c-8ab0-5d44c55ca665 service nova] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:48.019780 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-18180133-7c15-4925-87a7-9602b56681b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac570a18e9964f4eaddbf1e66c578d5d'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:48.026514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce6e44-668e-46a1-89ea-17f3aa42d8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:48.043408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce6e44-668e-46a1-89ea-17f3aa42d8e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:48.043408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce6e44-668e-46a1-89ea-17f3aa42d8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:48.043408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce6e44-668e-46a1-89ea-17f3aa42d8e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:48.046444 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce6e44-668e-46a1-89ea-17f3aa42d8e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:48.052698 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce6e44-668e-46a1-89ea-17f3aa42d8e7 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:48.136077 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 919/1827] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:47:47 2022] DELETE /identity/v3/users/ac570a18e9964f4eaddbf1e66c578d5d => generated 0 bytes in 1051 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:47:48.144204 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706bc31-cd3e-4d24-97a2-80fbd0388502 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:48.146235 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706bc31-cd3e-4d24-97a2-80fbd0388502 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:48.147633 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706bc31-cd3e-4d24-97a2-80fbd0388502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:48.178511 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:48.209638 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-a706bc31-cd3e-4d24-97a2-80fbd0388502 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:48.214067 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a706bc31-cd3e-4d24-97a2-80fbd0388502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:48.231455 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 909/1828] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:47:47 2022] POST /identity/v3/users => generated 294 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:47:48.232261 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce6e44-668e-46a1-89ea-17f3aa42d8e7 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:48.250516 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1dce6e44-668e-46a1-89ea-17f3aa42d8e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:48.299422 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce6e44-668e-46a1-89ea-17f3aa42d8e7 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:48.508889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 920/1829] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:48.513537 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706bc31-cd3e-4d24-97a2-80fbd0388502 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:48.520784 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a706bc31-cd3e-4d24-97a2-80fbd0388502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:48.555322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229bc15-7cb3-496e-8300-6022b1b6027c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:48.556597 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229bc15-7cb3-496e-8300-6022b1b6027c admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:48.557022 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229bc15-7cb3-496e-8300-6022b1b6027c admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:48.558047 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229bc15-7cb3-496e-8300-6022b1b6027c admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:48.560939 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229bc15-7cb3-496e-8300-6022b1b6027c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:48.564965 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229bc15-7cb3-496e-8300-6022b1b6027c admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:48.566012 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706bc31-cd3e-4d24-97a2-80fbd0388502 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:48.572986 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916cec1-0746-41cf-ae9b-2fabdcad124c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:48.574291 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916cec1-0746-41cf-ae9b-2fabdcad124c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:48.586550 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 910/1830] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:47:48.586550 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229bc15-7cb3-496e-8300-6022b1b6027c admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:48.589186 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916cec1-0746-41cf-ae9b-2fabdcad124c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:48.589687 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916cec1-0746-41cf-ae9b-2fabdcad124c admin admin] PATH_INFO: `/v3/users/da78c54274da4843bf2c939c7eef5b20` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:48.594360 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3916cec1-0746-41cf-ae9b-2fabdcad124c admin admin] RBAC: Authorizing `identity:delete_user(user_id=da78c54274da4843bf2c939c7eef5b20)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:48.596867 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3916cec1-0746-41cf-ae9b-2fabdcad124c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:48.601356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9229bc15-7cb3-496e-8300-6022b1b6027c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:48.777600 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229bc15-7cb3-496e-8300-6022b1b6027c admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:48.782324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c070f1-ec90-46ac-9cb7-b5eabbcf8bd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:48.783282 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c070f1-ec90-46ac-9cb7-b5eabbcf8bd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:48.783734 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c070f1-ec90-46ac-9cb7-b5eabbcf8bd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:48.784030 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c070f1-ec90-46ac-9cb7-b5eabbcf8bd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:48.797549 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c070f1-ec90-46ac-9cb7-b5eabbcf8bd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:48.799172 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c070f1-ec90-46ac-9cb7-b5eabbcf8bd8 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:48.813336 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 911/1831] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:47:48.814231 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c070f1-ec90-46ac-9cb7-b5eabbcf8bd8 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:48.843182 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c070f1-ec90-46ac-9cb7-b5eabbcf8bd8 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:48.855751 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee4b21-d2b6-42d5-bbff-4b318f393aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:48.856726 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee4b21-d2b6-42d5-bbff-4b318f393aee admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:48.857173 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee4b21-d2b6-42d5-bbff-4b318f393aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:48.857583 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee4b21-d2b6-42d5-bbff-4b318f393aee admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:48.858478 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee4b21-d2b6-42d5-bbff-4b318f393aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:48.860731 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee4b21-d2b6-42d5-bbff-4b318f393aee admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:48.873526 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 912/1832] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:47:48.878374 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee4b21-d2b6-42d5-bbff-4b318f393aee admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:48.895854 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee4b21-d2b6-42d5-bbff-4b318f393aee admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:48.902189 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace5e876-72c9-4f8c-bc71-5e5a7342b5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:48.911280 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5e876-72c9-4f8c-bc71-5e5a7342b5db admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:48.911280 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5e876-72c9-4f8c-bc71-5e5a7342b5db admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:48.911280 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5e876-72c9-4f8c-bc71-5e5a7342b5db admin admin] PATH_INFO: `/v3/projects/4dc192b464e04c94a9fde819ef070a53/users/9ed909a6ca40445c91c2072993117301/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:48.937091 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3916cec1-0746-41cf-ae9b-2fabdcad124c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da78c54274da4843bf2c939c7eef5b20'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:48.959015 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace5e876-72c9-4f8c-bc71-5e5a7342b5db admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dc192b464e04c94a9fde819ef070a53, user_id=9ed909a6ca40445c91c2072993117301, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:48.963771 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace5e876-72c9-4f8c-bc71-5e5a7342b5db admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:49.081322 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:49.120140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3916cec1-0746-41cf-ae9b-2fabdcad124c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da78c54274da4843bf2c939c7eef5b20'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:49.132707 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3916cec1-0746-41cf-ae9b-2fabdcad124c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da78c54274da4843bf2c939c7eef5b20'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:49.133619 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3916cec1-0746-41cf-ae9b-2fabdcad124c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da78c54274da4843bf2c939c7eef5b20'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:49.146252 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 913/1833] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:47:48 2022] PUT /identity/v3/projects/4dc192b464e04c94a9fde819ef070a53/users/9ed909a6ca40445c91c2072993117301/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:49.153955 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3916cec1-0746-41cf-ae9b-2fabdcad124c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da78c54274da4843bf2c939c7eef5b20'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:49.194953 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70f5cd-3e9a-4711-83b8-ba9eba697adc None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:49.195234 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70f5cd-3e9a-4711-83b8-ba9eba697adc None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:49.195666 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70f5cd-3e9a-4711-83b8-ba9eba697adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:49.196417 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 921/1834] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:47:48 2022] DELETE /identity/v3/users/da78c54274da4843bf2c939c7eef5b20 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:49.202486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431d8db-5e7b-4f65-a063-89c7000fd3a3 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:49.231948 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431d8db-5e7b-4f65-a063-89c7000fd3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:49.231948 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431d8db-5e7b-4f65-a063-89c7000fd3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:49.252272 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-7f70f5cd-3e9a-4711-83b8-ba9eba697adc None None] MFA Rules not processed for user `9ed909a6ca40445c91c2072993117301`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:49.253558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7f70f5cd-3e9a-4711-83b8-ba9eba697adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:49.261939 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-8431d8db-5e7b-4f65-a063-89c7000fd3a3 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:49.264140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8431d8db-5e7b-4f65-a063-89c7000fd3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:49.403222 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 922/1835] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:49.428373 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431d8db-5e7b-4f65-a063-89c7000fd3a3 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:49.435221 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8431d8db-5e7b-4f65-a063-89c7000fd3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:49.484902 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 914/1836] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:47:49.491863 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70f5cd-3e9a-4711-83b8-ba9eba697adc None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:49.501598 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7f70f5cd-3e9a-4711-83b8-ba9eba697adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:49.578185 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70f5cd-3e9a-4711-83b8-ba9eba697adc None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:49.599616 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bb931-c531-46c4-a00e-dc62c6d2382b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:49.600169 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bb931-c531-46c4-a00e-dc62c6d2382b admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:49.600645 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bb931-c531-46c4-a00e-dc62c6d2382b admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:49.601114 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bb931-c531-46c4-a00e-dc62c6d2382b admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:49.602265 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5bb931-c531-46c4-a00e-dc62c6d2382b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:49.615879 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5bb931-c531-46c4-a00e-dc62c6d2382b admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:49.722071 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431d8db-5e7b-4f65-a063-89c7000fd3a3 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:49.732460 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a2deb-a61f-4a15-bd32-b8ce9fc79d22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:49.733958 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a2deb-a61f-4a15-bd32-b8ce9fc79d22 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:49.734434 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a2deb-a61f-4a15-bd32-b8ce9fc79d22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:49.734901 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a2deb-a61f-4a15-bd32-b8ce9fc79d22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:49.748530 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a2deb-a61f-4a15-bd32-b8ce9fc79d22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:49.751221 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a2deb-a61f-4a15-bd32-b8ce9fc79d22 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:49.763741 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 923/1837] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:47:49.770503 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 915/1838] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:47:49 2022] POST /identity/v3/projects => generated 387 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:47:49.777159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a2deb-a61f-4a15-bd32-b8ce9fc79d22 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:49.794632 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a2deb-a61f-4a15-bd32-b8ce9fc79d22 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:49.915066 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7aeeaf-045e-4a05-8073-0889fa39622e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:49.916087 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7aeeaf-045e-4a05-8073-0889fa39622e admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:49.916411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7aeeaf-045e-4a05-8073-0889fa39622e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:49.916700 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7aeeaf-045e-4a05-8073-0889fa39622e admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:49.917433 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7aeeaf-045e-4a05-8073-0889fa39622e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:49.919532 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7aeeaf-045e-4a05-8073-0889fa39622e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:50.028143 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bb931-c531-46c4-a00e-dc62c6d2382b admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:50.042378 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2e5bb931-c531-46c4-a00e-dc62c6d2382b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:50.071134 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bb931-c531-46c4-a00e-dc62c6d2382b admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:50.078522 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3dc14-2579-4132-a007-eab4f32a1db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:50.079468 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3dc14-2579-4132-a007-eab4f32a1db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:50.079897 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3dc14-2579-4132-a007-eab4f32a1db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:50.080334 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3dc14-2579-4132-a007-eab4f32a1db1 admin admin] PATH_INFO: `/v3/projects/f7fdd234f5024140803eabf9de7b4b07` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:50.083774 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3dc14-2579-4132-a007-eab4f32a1db1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7fdd234f5024140803eabf9de7b4b07)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:50.086093 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3dc14-2579-4132-a007-eab4f32a1db1 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:50.089705 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 924/1839] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:47:49 2022] POST /identity/v3/users => generated 300 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:47:50.092852 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7aeeaf-045e-4a05-8073-0889fa39622e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:50.117534 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7aeeaf-045e-4a05-8073-0889fa39622e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:50.129698 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bec9c-bc8d-4d1d-9bd9-be4c432cebef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:50.132692 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bec9c-bc8d-4d1d-9bd9-be4c432cebef admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:50.132692 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bec9c-bc8d-4d1d-9bd9-be4c432cebef admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:50.132692 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bec9c-bc8d-4d1d-9bd9-be4c432cebef admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:50.134822 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bec9c-bc8d-4d1d-9bd9-be4c432cebef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:50.138548 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bec9c-bc8d-4d1d-9bd9-be4c432cebef admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:50.173368 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 925/1840] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:47:50.177706 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bec9c-bc8d-4d1d-9bd9-be4c432cebef admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:50.200084 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bec9c-bc8d-4d1d-9bd9-be4c432cebef admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:50.208349 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565b127-af46-4728-b2b6-fea55a020449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:50.209000 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565b127-af46-4728-b2b6-fea55a020449 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:50.209280 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565b127-af46-4728-b2b6-fea55a020449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:50.209558 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565b127-af46-4728-b2b6-fea55a020449 admin admin] PATH_INFO: `/v3/projects/5808959ac8074b10b7fd4085ba3f9031/users/d63381d7a0ba4458b07e09a1c7e8ea30/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:50.228149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565b127-af46-4728-b2b6-fea55a020449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5808959ac8074b10b7fd4085ba3f9031, user_id=d63381d7a0ba4458b07e09a1c7e8ea30, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:50.231220 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565b127-af46-4728-b2b6-fea55a020449 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:50.325908 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 926/1841] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:47:50 2022] PUT /identity/v3/projects/5808959ac8074b10b7fd4085ba3f9031/users/d63381d7a0ba4458b07e09a1c7e8ea30/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:47:50.333243 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565b127-af46-4728-b2b6-fea55a020449 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:50.340635 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e4a3dc14-2579-4132-a007-eab4f32a1db1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7fdd234f5024140803eabf9de7b4b07', 'request_id': 'req-e4a3dc14-2579-4132-a007-eab4f32a1db1'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:50.349758 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e4a3dc14-2579-4132-a007-eab4f32a1db1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7fdd234f5024140803eabf9de7b4b07', 'request_id': 'req-e4a3dc14-2579-4132-a007-eab4f32a1db1'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:50.422403 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565b127-af46-4728-b2b6-fea55a020449 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:50.428966 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e4a3dc14-2579-4132-a007-eab4f32a1db1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7fdd234f5024140803eabf9de7b4b07', 'request_id': 'req-e4a3dc14-2579-4132-a007-eab4f32a1db1'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:50.468271 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e4a3dc14-2579-4132-a007-eab4f32a1db1 admin admin] The token cache is being invalidate because project f7fdd234f5024140803eabf9de7b4b07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:47:50.469551 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e4a3dc14-2579-4132-a007-eab4f32a1db1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:50.470115 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e4a3dc14-2579-4132-a007-eab4f32a1db1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:50.472718 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 916/1842] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:47:50 2022] DELETE /identity/v3/projects/f7fdd234f5024140803eabf9de7b4b07 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:50.480337 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3dc14-2579-4132-a007-eab4f32a1db1 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:50.482653 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e4a3dc14-2579-4132-a007-eab4f32a1db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:50.577029 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7948cd-8669-441a-b968-8d672554b929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:50.577576 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7948cd-8669-441a-b968-8d672554b929 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:50.577868 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7948cd-8669-441a-b968-8d672554b929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:50.578146 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7948cd-8669-441a-b968-8d672554b929 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:50.578919 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7948cd-8669-441a-b968-8d672554b929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:50.580483 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7948cd-8669-441a-b968-8d672554b929 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:50.646754 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 927/1843] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:47:50.649082 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7948cd-8669-441a-b968-8d672554b929 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:50.653080 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2c7948cd-8669-441a-b968-8d672554b929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:50.660043 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3dc14-2579-4132-a007-eab4f32a1db1 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:50.678147 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08161f3a-de1e-4e0d-b6ff-d7aec89acad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:50.680255 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08161f3a-de1e-4e0d-b6ff-d7aec89acad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:50.681346 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08161f3a-de1e-4e0d-b6ff-d7aec89acad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:50.681346 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08161f3a-de1e-4e0d-b6ff-d7aec89acad7 admin admin] PATH_INFO: `/v3/users/ac08f9cf3878409986afad01e4047c32` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:50.683399 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08161f3a-de1e-4e0d-b6ff-d7aec89acad7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac08f9cf3878409986afad01e4047c32)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:50.688013 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08161f3a-de1e-4e0d-b6ff-d7aec89acad7 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:50.696219 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7948cd-8669-441a-b968-8d672554b929 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:50.702872 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62585b4-3057-47c3-8db7-1e06bd0e0c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:50.703757 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62585b4-3057-47c3-8db7-1e06bd0e0c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:50.704139 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62585b4-3057-47c3-8db7-1e06bd0e0c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:50.704516 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62585b4-3057-47c3-8db7-1e06bd0e0c9e admin admin] PATH_INFO: `/v3/projects/d80cbe7f2391495cb74997b7429a59b8` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:50.706240 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62585b4-3057-47c3-8db7-1e06bd0e0c9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d80cbe7f2391495cb74997b7429a59b8)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:50.710002 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62585b4-3057-47c3-8db7-1e06bd0e0c9e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:50.943629 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-08161f3a-de1e-4e0d-b6ff-d7aec89acad7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac08f9cf3878409986afad01e4047c32'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:50.944887 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-08161f3a-de1e-4e0d-b6ff-d7aec89acad7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac08f9cf3878409986afad01e4047c32'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:50.962267 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b62585b4-3057-47c3-8db7-1e06bd0e0c9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd80cbe7f2391495cb74997b7429a59b8', 'request_id': 'req-b62585b4-3057-47c3-8db7-1e06bd0e0c9e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:50.970967 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b62585b4-3057-47c3-8db7-1e06bd0e0c9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd80cbe7f2391495cb74997b7429a59b8', 'request_id': 'req-b62585b4-3057-47c3-8db7-1e06bd0e0c9e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:50.972588 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-08161f3a-de1e-4e0d-b6ff-d7aec89acad7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac08f9cf3878409986afad01e4047c32'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:50.973412 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-08161f3a-de1e-4e0d-b6ff-d7aec89acad7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac08f9cf3878409986afad01e4047c32'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:51.056718 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b62585b4-3057-47c3-8db7-1e06bd0e0c9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd80cbe7f2391495cb74997b7429a59b8', 'request_id': 'req-b62585b4-3057-47c3-8db7-1e06bd0e0c9e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:51.073200 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b62585b4-3057-47c3-8db7-1e06bd0e0c9e admin admin] The token cache is being invalidate because project d80cbe7f2391495cb74997b7429a59b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:47:51.073612 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b62585b4-3057-47c3-8db7-1e06bd0e0c9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:51.074390 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b62585b4-3057-47c3-8db7-1e06bd0e0c9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:51.076327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 928/1844] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:47:50 2022] DELETE /identity/v3/projects/d80cbe7f2391495cb74997b7429a59b8 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:51.082917 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62585b4-3057-47c3-8db7-1e06bd0e0c9e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:51.085033 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b62585b4-3057-47c3-8db7-1e06bd0e0c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:51.112089 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-08161f3a-de1e-4e0d-b6ff-d7aec89acad7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac08f9cf3878409986afad01e4047c32'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:51.133660 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 917/1845] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:47:50 2022] DELETE /identity/v3/users/ac08f9cf3878409986afad01e4047c32 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:51.134674 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08161f3a-de1e-4e0d-b6ff-d7aec89acad7 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:51.136311 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-08161f3a-de1e-4e0d-b6ff-d7aec89acad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:51.188938 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62585b4-3057-47c3-8db7-1e06bd0e0c9e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:51.280248 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08161f3a-de1e-4e0d-b6ff-d7aec89acad7 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:51.289601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111eca5-85af-46cc-8d0d-7b452444b18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:51.293468 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:51.294598 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111eca5-85af-46cc-8d0d-7b452444b18e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:51.296180 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111eca5-85af-46cc-8d0d-7b452444b18e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:51.296501 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111eca5-85af-46cc-8d0d-7b452444b18e admin admin] PATH_INFO: `/v3/users/a13f8f13fa9443e98dfbb0eeb629e1c9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:51.298909 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d111eca5-85af-46cc-8d0d-7b452444b18e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a13f8f13fa9443e98dfbb0eeb629e1c9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:51.302827 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67d1f6-adb3-4c90-8801-5f80c7b3adfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:51.303045 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d111eca5-85af-46cc-8d0d-7b452444b18e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:51.303538 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67d1f6-adb3-4c90-8801-5f80c7b3adfa admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:51.303884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67d1f6-adb3-4c90-8801-5f80c7b3adfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:51.304225 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67d1f6-adb3-4c90-8801-5f80c7b3adfa admin admin] PATH_INFO: `/v3/projects/5808959ac8074b10b7fd4085ba3f9031/users/d63381d7a0ba4458b07e09a1c7e8ea30/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:51.306587 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc67d1f6-adb3-4c90-8801-5f80c7b3adfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5808959ac8074b10b7fd4085ba3f9031, user_id=d63381d7a0ba4458b07e09a1c7e8ea30, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:51.309739 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc67d1f6-adb3-4c90-8801-5f80c7b3adfa admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:51.327369 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 929/1846] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:47:51 2022] PUT /identity/v3/projects/5808959ac8074b10b7fd4085ba3f9031/users/d63381d7a0ba4458b07e09a1c7e8ea30/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:51.344885 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce9bd6-cb19-4507-9479-a9f03f78f3af None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:51.344885 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce9bd6-cb19-4507-9479-a9f03f78f3af None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:51.344885 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce9bd6-cb19-4507-9479-a9f03f78f3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:51.384238 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-73ce9bd6-cb19-4507-9479-a9f03f78f3af None None] MFA Rules not processed for user `d63381d7a0ba4458b07e09a1c7e8ea30`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:51.385531 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-73ce9bd6-cb19-4507-9479-a9f03f78f3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:51.511577 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 930/1847] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:51 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:51.533182 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce9bd6-cb19-4507-9479-a9f03f78f3af None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:51.533182 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-73ce9bd6-cb19-4507-9479-a9f03f78f3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:51.541695 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d111eca5-85af-46cc-8d0d-7b452444b18e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a13f8f13fa9443e98dfbb0eeb629e1c9'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:51.542749 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d111eca5-85af-46cc-8d0d-7b452444b18e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a13f8f13fa9443e98dfbb0eeb629e1c9'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:51.554694 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d111eca5-85af-46cc-8d0d-7b452444b18e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a13f8f13fa9443e98dfbb0eeb629e1c9'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:51.556813 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d111eca5-85af-46cc-8d0d-7b452444b18e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a13f8f13fa9443e98dfbb0eeb629e1c9'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:51.657515 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce9bd6-cb19-4507-9479-a9f03f78f3af None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:51.663617 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca782b-5bc5-4f8a-8b83-6082e16c4c1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:51.664302 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca782b-5bc5-4f8a-8b83-6082e16c4c1b service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:51.664749 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca782b-5bc5-4f8a-8b83-6082e16c4c1b service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:51.665123 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca782b-5bc5-4f8a-8b83-6082e16c4c1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:51.678777 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-baca782b-5bc5-4f8a-8b83-6082e16c4c1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:51.705380 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca782b-5bc5-4f8a-8b83-6082e16c4c1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:51.707871 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca782b-5bc5-4f8a-8b83-6082e16c4c1b service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:51.726934 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 931/1848] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:51 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:47:51.739088 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d111eca5-85af-46cc-8d0d-7b452444b18e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a13f8f13fa9443e98dfbb0eeb629e1c9'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:51.774159 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 918/1849] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:47:51 2022] DELETE /identity/v3/users/a13f8f13fa9443e98dfbb0eeb629e1c9 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:51.934503 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca782b-5bc5-4f8a-8b83-6082e16c4c1b service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:51.934957 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-baca782b-5bc5-4f8a-8b83-6082e16c4c1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:52.055900 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:52.065821 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca782b-5bc5-4f8a-8b83-6082e16c4c1b service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:52.148704 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a1c49-74c5-4d5f-8ae8-808f1af2192f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:52.149421 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a1c49-74c5-4d5f-8ae8-808f1af2192f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:52.149708 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a1c49-74c5-4d5f-8ae8-808f1af2192f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:52.150125 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a1c49-74c5-4d5f-8ae8-808f1af2192f admin admin] PATH_INFO: `/v3/projects/8f14406c82004d3abd7f637dbfba369d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:52.151789 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a1c49-74c5-4d5f-8ae8-808f1af2192f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f14406c82004d3abd7f637dbfba369d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:52.153890 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a1c49-74c5-4d5f-8ae8-808f1af2192f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:52.334971 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-474a1c49-74c5-4d5f-8ae8-808f1af2192f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f14406c82004d3abd7f637dbfba369d', 'request_id': 'req-474a1c49-74c5-4d5f-8ae8-808f1af2192f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:52.352201 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-474a1c49-74c5-4d5f-8ae8-808f1af2192f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f14406c82004d3abd7f637dbfba369d', 'request_id': 'req-474a1c49-74c5-4d5f-8ae8-808f1af2192f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:52.506663 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-474a1c49-74c5-4d5f-8ae8-808f1af2192f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f14406c82004d3abd7f637dbfba369d', 'request_id': 'req-474a1c49-74c5-4d5f-8ae8-808f1af2192f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:52.520267 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-474a1c49-74c5-4d5f-8ae8-808f1af2192f admin admin] The token cache is being invalidate because project 8f14406c82004d3abd7f637dbfba369d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:47:52.520655 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-474a1c49-74c5-4d5f-8ae8-808f1af2192f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:52.521398 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-474a1c49-74c5-4d5f-8ae8-808f1af2192f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:52.523321 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 932/1850] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:47:51 2022] DELETE /identity/v3/projects/8f14406c82004d3abd7f637dbfba369d => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:52.528240 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba28f9-9332-4759-be5e-da259d10b8e1 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:52.528673 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba28f9-9332-4759-be5e-da259d10b8e1 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:52.528775 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba28f9-9332-4759-be5e-da259d10b8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:52.551469 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-48ba28f9-9332-4759-be5e-da259d10b8e1 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:52.552857 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-48ba28f9-9332-4759-be5e-da259d10b8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:52.636704 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 919/1851] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:52.645108 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fb5af-6d48-4c73-93ff-5c76c0a52248 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:52.645397 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fb5af-6d48-4c73-93ff-5c76c0a52248 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:52.645680 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fb5af-6d48-4c73-93ff-5c76c0a52248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:52.666724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba28f9-9332-4759-be5e-da259d10b8e1 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:52.671425 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-8f0fb5af-6d48-4c73-93ff-5c76c0a52248 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:52.673253 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8f0fb5af-6d48-4c73-93ff-5c76c0a52248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:52.674452 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-48ba28f9-9332-4759-be5e-da259d10b8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:52.686094 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 933/1852] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:52.694376 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fb5af-6d48-4c73-93ff-5c76c0a52248 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:52.698187 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba28f9-9332-4759-be5e-da259d10b8e1 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:52.703788 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0ceea-05d0-4ad2-96fa-8f4b51826754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:52.704831 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0ceea-05d0-4ad2-96fa-8f4b51826754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:52.705340 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0ceea-05d0-4ad2-96fa-8f4b51826754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:52.705610 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0ceea-05d0-4ad2-96fa-8f4b51826754 admin admin] PATH_INFO: `/v3/projects/483c11b3243a473392118c67ce4b9fa5` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:52.707664 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec0ceea-05d0-4ad2-96fa-8f4b51826754 admin admin] RBAC: Authorizing `identity:delete_project(project_id=483c11b3243a473392118c67ce4b9fa5)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:52.709925 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec0ceea-05d0-4ad2-96fa-8f4b51826754 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:52.723299 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fb5af-6d48-4c73-93ff-5c76c0a52248 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:52.731084 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f03ed1-edc8-40b2-9d82-72391218bddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:52.731984 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f03ed1-edc8-40b2-9d82-72391218bddc admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:52.732434 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f03ed1-edc8-40b2-9d82-72391218bddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:52.732911 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f03ed1-edc8-40b2-9d82-72391218bddc admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:52.734310 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f03ed1-edc8-40b2-9d82-72391218bddc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:47:52.734810 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f03ed1-edc8-40b2-9d82-72391218bddc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:52.736656 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f03ed1-edc8-40b2-9d82-72391218bddc admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:52.758935 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 934/1853] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:47:52.761031 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f03ed1-edc8-40b2-9d82-72391218bddc admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:52.773584 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f03ed1-edc8-40b2-9d82-72391218bddc admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:52.781301 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112ddfc-6887-4f68-8c83-bed2eb28ca3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:52.782375 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112ddfc-6887-4f68-8c83-bed2eb28ca3f admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:52.782874 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112ddfc-6887-4f68-8c83-bed2eb28ca3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:52.783218 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112ddfc-6887-4f68-8c83-bed2eb28ca3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:52.783980 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112ddfc-6887-4f68-8c83-bed2eb28ca3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:52.786084 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112ddfc-6887-4f68-8c83-bed2eb28ca3f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:52.900898 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-3ec0ceea-05d0-4ad2-96fa-8f4b51826754 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '483c11b3243a473392118c67ce4b9fa5', 'request_id': 'req-3ec0ceea-05d0-4ad2-96fa-8f4b51826754'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:52.919461 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 935/1854] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:47:52 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:47:52.939586 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112ddfc-6887-4f68-8c83-bed2eb28ca3f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:52.939713 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-3ec0ceea-05d0-4ad2-96fa-8f4b51826754 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '483c11b3243a473392118c67ce4b9fa5', 'request_id': 'req-3ec0ceea-05d0-4ad2-96fa-8f4b51826754'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:53.013256 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-3ec0ceea-05d0-4ad2-96fa-8f4b51826754 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '483c11b3243a473392118c67ce4b9fa5', 'request_id': 'req-3ec0ceea-05d0-4ad2-96fa-8f4b51826754'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:53.019201 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112ddfc-6887-4f68-8c83-bed2eb28ca3f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:53.024293 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb59f2-d79f-4e18-bd7e-9f5ce9fc6271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:53.024918 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb59f2-d79f-4e18-bd7e-9f5ce9fc6271 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:53.025199 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb59f2-d79f-4e18-bd7e-9f5ce9fc6271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:53.025473 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb59f2-d79f-4e18-bd7e-9f5ce9fc6271 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:53.026283 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb59f2-d79f-4e18-bd7e-9f5ce9fc6271 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:53.027420 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-3ec0ceea-05d0-4ad2-96fa-8f4b51826754 admin admin] The token cache is being invalidate because project 483c11b3243a473392118c67ce4b9fa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:47:53.027719 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-3ec0ceea-05d0-4ad2-96fa-8f4b51826754 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:53.028426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-3ec0ceea-05d0-4ad2-96fa-8f4b51826754 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:53.028618 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb59f2-d79f-4e18-bd7e-9f5ce9fc6271 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:53.030496 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 920/1855] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:47:52 2022] DELETE /identity/v3/projects/483c11b3243a473392118c67ce4b9fa5 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:53.036515 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a750454-a8e1-48b8-810a-ef9b48da4fb2 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:53.037017 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a750454-a8e1-48b8-810a-ef9b48da4fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:53.037502 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a750454-a8e1-48b8-810a-ef9b48da4fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:53.085764 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-1a750454-a8e1-48b8-810a-ef9b48da4fb2 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:53.088357 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1a750454-a8e1-48b8-810a-ef9b48da4fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:53.107414 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 921/1856] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:47:53.122413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c42d87-6288-4bb8-a787-43579baa46a8 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:53.122691 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c42d87-6288-4bb8-a787-43579baa46a8 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:53.123061 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c42d87-6288-4bb8-a787-43579baa46a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:53.160015 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-e0c42d87-6288-4bb8-a787-43579baa46a8 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:53.163241 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e0c42d87-6288-4bb8-a787-43579baa46a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:53.170458 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 936/1857] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:47:52 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:47:53.175587 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb59f2-d79f-4e18-bd7e-9f5ce9fc6271 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:53.183182 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 922/1858] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:47:53.183378 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-32eb59f2-d79f-4e18-bd7e-9f5ce9fc6271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:53.187659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c42d87-6288-4bb8-a787-43579baa46a8 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:53.203515 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c42d87-6288-4bb8-a787-43579baa46a8 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:53.209451 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb59f2-d79f-4e18-bd7e-9f5ce9fc6271 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:53.212242 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b40f3-e93d-4ca1-b8d9-2018c8b697b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:53.212883 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b40f3-e93d-4ca1-b8d9-2018c8b697b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:53.213244 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b40f3-e93d-4ca1-b8d9-2018c8b697b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:53.213724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b40f3-e93d-4ca1-b8d9-2018c8b697b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:53.214846 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b40f3-e93d-4ca1-b8d9-2018c8b697b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:47:53.215402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b40f3-e93d-4ca1-b8d9-2018c8b697b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:53.217076 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b40f3-e93d-4ca1-b8d9-2018c8b697b9 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:53.218380 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7be74-3e39-4654-9714-4f43209002a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:53.219219 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7be74-3e39-4654-9714-4f43209002a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:53.219712 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7be74-3e39-4654-9714-4f43209002a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:53.220200 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7be74-3e39-4654-9714-4f43209002a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:53.221282 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c7be74-3e39-4654-9714-4f43209002a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:53.224360 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c7be74-3e39-4654-9714-4f43209002a3 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:53.231309 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 923/1859] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:47:53.238758 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b40f3-e93d-4ca1-b8d9-2018c8b697b9 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:53.244762 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 937/1860] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:47:53.249401 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7be74-3e39-4654-9714-4f43209002a3 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:53.252598 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b40f3-e93d-4ca1-b8d9-2018c8b697b9 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:53.258720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af146982-aa69-42f0-a3a6-b1901d6154db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:53.259651 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af146982-aa69-42f0-a3a6-b1901d6154db admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:53.260093 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af146982-aa69-42f0-a3a6-b1901d6154db admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:53.260539 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af146982-aa69-42f0-a3a6-b1901d6154db admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:53.261693 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af146982-aa69-42f0-a3a6-b1901d6154db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:53.265990 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7be74-3e39-4654-9714-4f43209002a3 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:53.266148 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af146982-aa69-42f0-a3a6-b1901d6154db admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:53.271584 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f1a8d-7a94-4414-8c9e-15296d124b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:53.272215 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f1a8d-7a94-4414-8c9e-15296d124b08 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:53.272819 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f1a8d-7a94-4414-8c9e-15296d124b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:53.272819 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f1a8d-7a94-4414-8c9e-15296d124b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:53.273448 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f1a8d-7a94-4414-8c9e-15296d124b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:53.275102 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f1a8d-7a94-4414-8c9e-15296d124b08 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:53.288192 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 938/1861] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:47:53.292665 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f1a8d-7a94-4414-8c9e-15296d124b08 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:53.303223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f1a8d-7a94-4414-8c9e-15296d124b08 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:53.308216 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b9fcb-17f0-44da-ab1e-e924ef75b3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:53.308897 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b9fcb-17f0-44da-ab1e-e924ef75b3be admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:53.319406 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b9fcb-17f0-44da-ab1e-e924ef75b3be admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:53.319406 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b9fcb-17f0-44da-ab1e-e924ef75b3be admin admin] PATH_INFO: `/v3/projects/fec858bd3aff4e79b2b078a6de1ba5ed/users/21223029a50e407ab0ba60907508eae4/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:53.327912 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b9fcb-17f0-44da-ab1e-e924ef75b3be admin admin] RBAC: Authorizing `identity:create_grant(project_id=fec858bd3aff4e79b2b078a6de1ba5ed, user_id=21223029a50e407ab0ba60907508eae4, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:53.331497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b9fcb-17f0-44da-ab1e-e924ef75b3be admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:53.457612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 924/1862] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:47:53 2022] POST /identity/v3/projects => generated 361 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:47:53.459843 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:53.465604 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 939/1863] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:47:53 2022] PUT /identity/v3/projects/fec858bd3aff4e79b2b078a6de1ba5ed/users/21223029a50e407ab0ba60907508eae4/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:47:53.466595 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af146982-aa69-42f0-a3a6-b1901d6154db admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:53.484510 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d342a-bc7c-4678-b4fd-b5b1bfe6643c None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:53.484931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d342a-bc7c-4678-b4fd-b5b1bfe6643c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:53.485243 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d342a-bc7c-4678-b4fd-b5b1bfe6643c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:53.534111 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-7c2d342a-bc7c-4678-b4fd-b5b1bfe6643c None None] MFA Rules not processed for user `21223029a50e407ab0ba60907508eae4`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:53.535232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7c2d342a-bc7c-4678-b4fd-b5b1bfe6643c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:53.565690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af146982-aa69-42f0-a3a6-b1901d6154db admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:53.629527 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 940/1864] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:53.642593 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d342a-bc7c-4678-b4fd-b5b1bfe6643c None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:53.644060 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36884c-f7f7-48b1-9b2a-bf0ec4041db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:53.644861 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7c2d342a-bc7c-4678-b4fd-b5b1bfe6643c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:53.647222 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36884c-f7f7-48b1-9b2a-bf0ec4041db4 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:53.647222 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36884c-f7f7-48b1-9b2a-bf0ec4041db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:53.647222 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36884c-f7f7-48b1-9b2a-bf0ec4041db4 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:53.647222 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36884c-f7f7-48b1-9b2a-bf0ec4041db4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:53.649451 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36884c-f7f7-48b1-9b2a-bf0ec4041db4 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:53.765662 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d342a-bc7c-4678-b4fd-b5b1bfe6643c None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:53.770887 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082e0dc-82c0-4af4-9627-6f7d3227fc1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:53.771901 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082e0dc-82c0-4af4-9627-6f7d3227fc1f service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:53.772286 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082e0dc-82c0-4af4-9627-6f7d3227fc1f service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:53.772672 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082e0dc-82c0-4af4-9627-6f7d3227fc1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:53.784091 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082e0dc-82c0-4af4-9627-6f7d3227fc1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:53.785859 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082e0dc-82c0-4af4-9627-6f7d3227fc1f service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:53.799005 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 941/1865] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:47:53.800134 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082e0dc-82c0-4af4-9627-6f7d3227fc1f service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:53.802588 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4082e0dc-82c0-4af4-9627-6f7d3227fc1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:53.827971 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 925/1866] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:47:53 2022] POST /identity/v3/users => generated 281 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:47:53.829711 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36884c-f7f7-48b1-9b2a-bf0ec4041db4 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:53.851355 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082e0dc-82c0-4af4-9627-6f7d3227fc1f service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:53.868792 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36884c-f7f7-48b1-9b2a-bf0ec4041db4 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:53.878421 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102db97-05f0-409f-bb34-343057628927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:53.880166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102db97-05f0-409f-bb34-343057628927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:53.880894 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102db97-05f0-409f-bb34-343057628927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:53.881579 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102db97-05f0-409f-bb34-343057628927 admin admin] PATH_INFO: `/v3/users/9ed909a6ca40445c91c2072993117301` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:53.885048 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6ddb1-8aaa-40b5-a6e7-7a9aef0a172b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:53.885809 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6ddb1-8aaa-40b5-a6e7-7a9aef0a172b admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:53.886100 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6ddb1-8aaa-40b5-a6e7-7a9aef0a172b admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:53.886435 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6ddb1-8aaa-40b5-a6e7-7a9aef0a172b admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:53.887534 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102db97-05f0-409f-bb34-343057628927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ed909a6ca40445c91c2072993117301)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:53.888190 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6ddb1-8aaa-40b5-a6e7-7a9aef0a172b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:53.892887 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6ddb1-8aaa-40b5-a6e7-7a9aef0a172b admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:53.897363 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102db97-05f0-409f-bb34-343057628927 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:53.920060 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 926/1867] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:47:53.928255 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6ddb1-8aaa-40b5-a6e7-7a9aef0a172b admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:53.940546 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6ddb1-8aaa-40b5-a6e7-7a9aef0a172b admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:53.944941 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:53.946912 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cec8b7-6b86-4e47-aae7-e6bc1e26235a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:53.947616 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cec8b7-6b86-4e47-aae7-e6bc1e26235a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:53.949258 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cec8b7-6b86-4e47-aae7-e6bc1e26235a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:53.949258 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cec8b7-6b86-4e47-aae7-e6bc1e26235a admin admin] PATH_INFO: `/v3/users/21223029a50e407ab0ba60907508eae4` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:53.949580 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cec8b7-6b86-4e47-aae7-e6bc1e26235a admin admin] RBAC: Authorizing `identity:delete_user(user_id=21223029a50e407ab0ba60907508eae4)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:53.952686 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cec8b7-6b86-4e47-aae7-e6bc1e26235a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:54.204962 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3102db97-05f0-409f-bb34-343057628927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ed909a6ca40445c91c2072993117301'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:54.261828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-48cec8b7-6b86-4e47-aae7-e6bc1e26235a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21223029a50e407ab0ba60907508eae4'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:54.263170 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-48cec8b7-6b86-4e47-aae7-e6bc1e26235a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21223029a50e407ab0ba60907508eae4'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:54.278485 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-48cec8b7-6b86-4e47-aae7-e6bc1e26235a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21223029a50e407ab0ba60907508eae4'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:54.279419 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-48cec8b7-6b86-4e47-aae7-e6bc1e26235a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21223029a50e407ab0ba60907508eae4'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:54.283820 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3102db97-05f0-409f-bb34-343057628927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ed909a6ca40445c91c2072993117301'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:54.284854 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3102db97-05f0-409f-bb34-343057628927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ed909a6ca40445c91c2072993117301'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:54.285883 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3102db97-05f0-409f-bb34-343057628927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ed909a6ca40445c91c2072993117301'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:54.314770 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3102db97-05f0-409f-bb34-343057628927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ed909a6ca40445c91c2072993117301'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:54.353138 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-48cec8b7-6b86-4e47-aae7-e6bc1e26235a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21223029a50e407ab0ba60907508eae4'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:54.383379 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 942/1868] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:47:53 2022] DELETE /identity/v3/users/9ed909a6ca40445c91c2072993117301 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:54.384545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102db97-05f0-409f-bb34-343057628927 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:54.389999 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3102db97-05f0-409f-bb34-343057628927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:54.404766 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 927/1869] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:47:53 2022] DELETE /identity/v3/users/21223029a50e407ab0ba60907508eae4 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:54.407860 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022c7da-a74e-4fed-b007-4fc366ebb17b None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:54.410318 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022c7da-a74e-4fed-b007-4fc366ebb17b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:54.411972 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022c7da-a74e-4fed-b007-4fc366ebb17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:54.459913 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-f022c7da-a74e-4fed-b007-4fc366ebb17b None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:54.463973 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f022c7da-a74e-4fed-b007-4fc366ebb17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:54.523156 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102db97-05f0-409f-bb34-343057628927 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:54.630080 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 928/1870] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:54.630080 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa1187-069e-42fc-9ec3-86025fb1e53c None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:54.630080 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa1187-069e-42fc-9ec3-86025fb1e53c None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:54.630080 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa1187-069e-42fc-9ec3-86025fb1e53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:54.664432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-5eaa1187-069e-42fc-9ec3-86025fb1e53c None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:54.671406 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5eaa1187-069e-42fc-9ec3-86025fb1e53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:54.671707 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86573327-2eeb-42f8-ab06-495592758bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:54.671707 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86573327-2eeb-42f8-ab06-495592758bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:54.671707 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86573327-2eeb-42f8-ab06-495592758bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:54.671707 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86573327-2eeb-42f8-ab06-495592758bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:54.672306 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86573327-2eeb-42f8-ab06-495592758bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:54.681264 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86573327-2eeb-42f8-ab06-495592758bb1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:54.700189 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:54.709321 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 929/1871] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:54.710566 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa1187-069e-42fc-9ec3-86025fb1e53c None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:54.711549 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 943/1872] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:47:54.712618 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5eaa1187-069e-42fc-9ec3-86025fb1e53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:54.718356 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86573327-2eeb-42f8-ab06-495592758bb1 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:54.755281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86573327-2eeb-42f8-ab06-495592758bb1 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:54.763681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c809aa-b871-439a-9e41-ebac0487a0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:54.765974 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c809aa-b871-439a-9e41-ebac0487a0e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:54.766469 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c809aa-b871-439a-9e41-ebac0487a0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:54.767886 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c809aa-b871-439a-9e41-ebac0487a0e9 admin admin] PATH_INFO: `/v3/projects/3aa97a5eeb4a4c308a614d9ccfdd603d/users/b3165d5eabff49a5a2cfbc7ca03ddc65/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:54.794303 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c809aa-b871-439a-9e41-ebac0487a0e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa97a5eeb4a4c308a614d9ccfdd603d, user_id=b3165d5eabff49a5a2cfbc7ca03ddc65, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:54.798289 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c809aa-b871-439a-9e41-ebac0487a0e9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:54.816466 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa1187-069e-42fc-9ec3-86025fb1e53c None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:54.820038 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:54.828935 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2839ea-d007-4207-8288-35a5b6e3af0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:54.829598 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2839ea-d007-4207-8288-35a5b6e3af0a service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:54.829892 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2839ea-d007-4207-8288-35a5b6e3af0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:54.830172 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2839ea-d007-4207-8288-35a5b6e3af0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:54.842162 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2839ea-d007-4207-8288-35a5b6e3af0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:54.844544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2839ea-d007-4207-8288-35a5b6e3af0a service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:54.859303 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 930/1873] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:47:54.860602 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2839ea-d007-4207-8288-35a5b6e3af0a service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:54.862355 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2e2839ea-d007-4207-8288-35a5b6e3af0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:54.885240 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2839ea-d007-4207-8288-35a5b6e3af0a service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:54.893584 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 944/1874] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:47:54 2022] PUT /identity/v3/projects/3aa97a5eeb4a4c308a614d9ccfdd603d/users/b3165d5eabff49a5a2cfbc7ca03ddc65/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:54.904793 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b4030-96c6-403c-9835-9e1e3d8e9157 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:54.905269 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b4030-96c6-403c-9835-9e1e3d8e9157 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:54.908268 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b4030-96c6-403c-9835-9e1e3d8e9157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:54.979408 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-4a0b4030-96c6-403c-9835-9e1e3d8e9157 None None] MFA Rules not processed for user `b3165d5eabff49a5a2cfbc7ca03ddc65`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:54.981309 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4a0b4030-96c6-403c-9835-9e1e3d8e9157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:55.018421 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d0835-15d8-4a08-ac71-333a5ac74574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:55.019454 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d0835-15d8-4a08-ac71-333a5ac74574 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:55.019454 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d0835-15d8-4a08-ac71-333a5ac74574 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:55.019672 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d0835-15d8-4a08-ac71-333a5ac74574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:55.107417 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 945/1875] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:55.140489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d0835-15d8-4a08-ac71-333a5ac74574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:55.143471 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d0835-15d8-4a08-ac71-333a5ac74574 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:55.165119 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b4030-96c6-403c-9835-9e1e3d8e9157 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:55.167158 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4a0b4030-96c6-403c-9835-9e1e3d8e9157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:55.177007 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 931/1876] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:47:55.273594 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b4030-96c6-403c-9835-9e1e3d8e9157 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:55.281663 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c5cac-bd03-4c32-ae4e-283148301c96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:55.282398 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c5cac-bd03-4c32-ae4e-283148301c96 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:55.283236 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c5cac-bd03-4c32-ae4e-283148301c96 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:55.283236 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c5cac-bd03-4c32-ae4e-283148301c96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:55.298560 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c5cac-bd03-4c32-ae4e-283148301c96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:55.301023 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c5cac-bd03-4c32-ae4e-283148301c96 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:55.315458 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 946/1877] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:47:55.334830 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d0835-15d8-4a08-ac71-333a5ac74574 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:55.346566 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d0835-15d8-4a08-ac71-333a5ac74574 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:55.351417 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14ef41-321f-4282-9e56-5a21062d20f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:55.352154 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14ef41-321f-4282-9e56-5a21062d20f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:55.352440 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14ef41-321f-4282-9e56-5a21062d20f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:55.352718 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14ef41-321f-4282-9e56-5a21062d20f4 admin admin] PATH_INFO: `/v3/users/b3165d5eabff49a5a2cfbc7ca03ddc65` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:55.354090 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14ef41-321f-4282-9e56-5a21062d20f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3165d5eabff49a5a2cfbc7ca03ddc65)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:55.356117 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14ef41-321f-4282-9e56-5a21062d20f4 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:55.525009 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c5cac-bd03-4c32-ae4e-283148301c96 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:55.527598 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-429c5cac-bd03-4c32-ae4e-283148301c96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:55.556886 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c5cac-bd03-4c32-ae4e-283148301c96 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:55.568874 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c8cad-49d4-437b-ac53-5356b68b2407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:55.570718 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c8cad-49d4-437b-ac53-5356b68b2407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:55.570933 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c8cad-49d4-437b-ac53-5356b68b2407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:55.571939 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c8cad-49d4-437b-ac53-5356b68b2407 admin admin] PATH_INFO: `/v3/projects/4dc192b464e04c94a9fde819ef070a53` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:55.573554 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c8cad-49d4-437b-ac53-5356b68b2407 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dc192b464e04c94a9fde819ef070a53)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:55.578223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c8cad-49d4-437b-ac53-5356b68b2407 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:55.655628 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-3b14ef41-321f-4282-9e56-5a21062d20f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3165d5eabff49a5a2cfbc7ca03ddc65'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:55.656753 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-3b14ef41-321f-4282-9e56-5a21062d20f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3165d5eabff49a5a2cfbc7ca03ddc65'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:55.669341 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-3b14ef41-321f-4282-9e56-5a21062d20f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3165d5eabff49a5a2cfbc7ca03ddc65'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:55.671541 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-3b14ef41-321f-4282-9e56-5a21062d20f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3165d5eabff49a5a2cfbc7ca03ddc65'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:55.759802 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-019c8cad-49d4-437b-ac53-5356b68b2407 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dc192b464e04c94a9fde819ef070a53', 'request_id': 'req-019c8cad-49d4-437b-ac53-5356b68b2407'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:55.777254 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-3b14ef41-321f-4282-9e56-5a21062d20f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3165d5eabff49a5a2cfbc7ca03ddc65'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:55.801076 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-019c8cad-49d4-437b-ac53-5356b68b2407 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dc192b464e04c94a9fde819ef070a53', 'request_id': 'req-019c8cad-49d4-437b-ac53-5356b68b2407'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:55.821623 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:55.826938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 932/1878] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:47:55 2022] DELETE /identity/v3/users/b3165d5eabff49a5a2cfbc7ca03ddc65 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:47:55.831799 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14ef41-321f-4282-9e56-5a21062d20f4 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:55.831799 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3b14ef41-321f-4282-9e56-5a21062d20f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:55.923897 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-019c8cad-49d4-437b-ac53-5356b68b2407 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dc192b464e04c94a9fde819ef070a53', 'request_id': 'req-019c8cad-49d4-437b-ac53-5356b68b2407'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:55.949681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-019c8cad-49d4-437b-ac53-5356b68b2407 admin admin] The token cache is being invalidate because project 4dc192b464e04c94a9fde819ef070a53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:47:55.952419 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-019c8cad-49d4-437b-ac53-5356b68b2407 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:55.952419 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-019c8cad-49d4-437b-ac53-5356b68b2407 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:55.953430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14ef41-321f-4282-9e56-5a21062d20f4 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:55.954502 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 947/1879] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:47:55 2022] DELETE /identity/v3/projects/4dc192b464e04c94a9fde819ef070a53 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:47:55.963185 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d81a4-42eb-4934-9721-8e89bcd6ced3 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:55.963421 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e69bb-0da8-437a-84b3-6c96ece19fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:55.964261 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d81a4-42eb-4934-9721-8e89bcd6ced3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:55.964629 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d81a4-42eb-4934-9721-8e89bcd6ced3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:55.965184 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e69bb-0da8-437a-84b3-6c96ece19fa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:55.966007 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e69bb-0da8-437a-84b3-6c96ece19fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:55.966477 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e69bb-0da8-437a-84b3-6c96ece19fa1 admin admin] PATH_INFO: `/v3/projects/fec858bd3aff4e79b2b078a6de1ba5ed` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:55.969633 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e69bb-0da8-437a-84b3-6c96ece19fa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fec858bd3aff4e79b2b078a6de1ba5ed)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:55.975087 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:55.981196 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e69bb-0da8-437a-84b3-6c96ece19fa1 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:56.003128 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-335d81a4-42eb-4934-9721-8e89bcd6ced3 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:56.005757 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-335d81a4-42eb-4934-9721-8e89bcd6ced3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:56.013438 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 948/1880] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:56.022231 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d81a4-42eb-4934-9721-8e89bcd6ced3 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:56.022231 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-335d81a4-42eb-4934-9721-8e89bcd6ced3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:56.040238 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d81a4-42eb-4934-9721-8e89bcd6ced3 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:56.056523 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c9927-f256-44db-9384-f2923c160fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:56.057200 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c9927-f256-44db-9384-f2923c160fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:56.057486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c9927-f256-44db-9384-f2923c160fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:56.057946 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c9927-f256-44db-9384-f2923c160fb6 admin admin] PATH_INFO: `/v3/users/d63381d7a0ba4458b07e09a1c7e8ea30` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:56.060014 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c9927-f256-44db-9384-f2923c160fb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d63381d7a0ba4458b07e09a1c7e8ea30)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:56.062824 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c9927-f256-44db-9384-f2923c160fb6 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:56.468072 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3d9c9927-f256-44db-9384-f2923c160fb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd63381d7a0ba4458b07e09a1c7e8ea30'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:56.479729 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5a2e69bb-0da8-437a-84b3-6c96ece19fa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fec858bd3aff4e79b2b078a6de1ba5ed', 'request_id': 'req-5a2e69bb-0da8-437a-84b3-6c96ece19fa1'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:56.499776 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5a2e69bb-0da8-437a-84b3-6c96ece19fa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fec858bd3aff4e79b2b078a6de1ba5ed', 'request_id': 'req-5a2e69bb-0da8-437a-84b3-6c96ece19fa1'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:56.588735 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3d9c9927-f256-44db-9384-f2923c160fb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd63381d7a0ba4458b07e09a1c7e8ea30'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:56.591021 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3d9c9927-f256-44db-9384-f2923c160fb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd63381d7a0ba4458b07e09a1c7e8ea30'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:56.599214 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3d9c9927-f256-44db-9384-f2923c160fb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd63381d7a0ba4458b07e09a1c7e8ea30'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:56.654372 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3d9c9927-f256-44db-9384-f2923c160fb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd63381d7a0ba4458b07e09a1c7e8ea30'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:56.714470 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5a2e69bb-0da8-437a-84b3-6c96ece19fa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fec858bd3aff4e79b2b078a6de1ba5ed', 'request_id': 'req-5a2e69bb-0da8-437a-84b3-6c96ece19fa1'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:56.722921 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 949/1881] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:47:56 2022] DELETE /identity/v3/users/d63381d7a0ba4458b07e09a1c7e8ea30 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:56.728902 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c9927-f256-44db-9384-f2923c160fb6 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:56.735934 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3d9c9927-f256-44db-9384-f2923c160fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:56.763852 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5a2e69bb-0da8-437a-84b3-6c96ece19fa1 admin admin] The token cache is being invalidate because project fec858bd3aff4e79b2b078a6de1ba5ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:47:56.769038 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5a2e69bb-0da8-437a-84b3-6c96ece19fa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:56.771820 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5a2e69bb-0da8-437a-84b3-6c96ece19fa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:56.778433 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 933/1882] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:47:55 2022] DELETE /identity/v3/projects/fec858bd3aff4e79b2b078a6de1ba5ed => generated 0 bytes in 950 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:56.787603 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c96804-30ab-4ac7-9f78-2249463f07ba None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:56.787603 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c96804-30ab-4ac7-9f78-2249463f07ba None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:56.787603 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c96804-30ab-4ac7-9f78-2249463f07ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:56.840175 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-62c96804-30ab-4ac7-9f78-2249463f07ba None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:56.845994 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-62c96804-30ab-4ac7-9f78-2249463f07ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:56.940351 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c9927-f256-44db-9384-f2923c160fb6 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:56.967782 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed01e3-8f44-4254-8945-803c70c45f26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:56.967782 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed01e3-8f44-4254-8945-803c70c45f26 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:56.967782 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed01e3-8f44-4254-8945-803c70c45f26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:56.967782 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed01e3-8f44-4254-8945-803c70c45f26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:56.968660 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-afed01e3-8f44-4254-8945-803c70c45f26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:57.067285 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 934/1883] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:57.075555 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04113a-6bbd-4367-923e-5cf823919927 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:57.075842 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04113a-6bbd-4367-923e-5cf823919927 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:57.076293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04113a-6bbd-4367-923e-5cf823919927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:57.117993 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-7b04113a-6bbd-4367-923e-5cf823919927 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:57.119365 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7b04113a-6bbd-4367-923e-5cf823919927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:57.134969 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 935/1884] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:47:57.136212 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04113a-6bbd-4367-923e-5cf823919927 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:57.154216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04113a-6bbd-4367-923e-5cf823919927 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:57.164506 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3035c3-9adf-486b-ab89-1244b3e08e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:57.165903 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3035c3-9adf-486b-ab89-1244b3e08e23 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:57.165903 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3035c3-9adf-486b-ab89-1244b3e08e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:57.165903 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3035c3-9adf-486b-ab89-1244b3e08e23 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:57.166415 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3035c3-9adf-486b-ab89-1244b3e08e23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:47:57.166732 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3035c3-9adf-486b-ab89-1244b3e08e23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:57.175490 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3035c3-9adf-486b-ab89-1244b3e08e23 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:57.185657 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed01e3-8f44-4254-8945-803c70c45f26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:57.195798 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 936/1885] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:47:57.196096 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed01e3-8f44-4254-8945-803c70c45f26 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:57.197381 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3035c3-9adf-486b-ab89-1244b3e08e23 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:57.214214 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 950/1886] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:47:57.222214 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3035c3-9adf-486b-ab89-1244b3e08e23 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:57.231045 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050b106-d7a4-4c53-8fd0-33c16691db27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:57.232138 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050b106-d7a4-4c53-8fd0-33c16691db27 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:57.232771 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050b106-d7a4-4c53-8fd0-33c16691db27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:57.233925 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050b106-d7a4-4c53-8fd0-33c16691db27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:57.236568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050b106-d7a4-4c53-8fd0-33c16691db27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:57.240672 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050b106-d7a4-4c53-8fd0-33c16691db27 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:57.394540 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:57.466806 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed01e3-8f44-4254-8945-803c70c45f26 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:57.466959 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 937/1887] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:47:57 2022] POST /identity/v3/projects => generated 371 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:47:57.485046 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed01e3-8f44-4254-8945-803c70c45f26 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:57.616200 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:57.674568 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ee727-7b8c-4ec9-ab84-aa98f19b5636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:57.677719 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ee727-7b8c-4ec9-ab84-aa98f19b5636 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:57.682778 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ee727-7b8c-4ec9-ab84-aa98f19b5636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:57.686795 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ee727-7b8c-4ec9-ab84-aa98f19b5636 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:57.686795 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ee727-7b8c-4ec9-ab84-aa98f19b5636 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:57.692033 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ee727-7b8c-4ec9-ab84-aa98f19b5636 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:57.709614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d52139-abc1-4bbb-9887-87b13d3548fa None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:57.710278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d52139-abc1-4bbb-9887-87b13d3548fa None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:57.711022 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d52139-abc1-4bbb-9887-87b13d3548fa None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:57.717682 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 938/1888] 10.222.0.26 () {54 vars in 921 bytes} [Sun Sep 11 08:47:57 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:47:57.742657 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3b1cd-1f65-4034-a4a8-ac4b7fc30839 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:57.742937 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3b1cd-1f65-4034-a4a8-ac4b7fc30839 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:57.743428 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3b1cd-1f65-4034-a4a8-ac4b7fc30839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:57.777817 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-3cc3b1cd-1f65-4034-a4a8-ac4b7fc30839 None None] MFA Rules not processed for user `e62bb9d2e13649b5af239bb56001ce16`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:57.780793 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3cc3b1cd-1f65-4034-a4a8-ac4b7fc30839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:57.809026 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 951/1889] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:47:57 2022] POST /identity/v3/users => generated 286 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:47:57.814403 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ee727-7b8c-4ec9-ab84-aa98f19b5636 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:57.833723 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ee727-7b8c-4ec9-ab84-aa98f19b5636 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:57.850868 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62689cce-2950-4e87-bd84-e33de31076e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:57.853618 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62689cce-2950-4e87-bd84-e33de31076e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:57.854670 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62689cce-2950-4e87-bd84-e33de31076e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:57.855530 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62689cce-2950-4e87-bd84-e33de31076e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:57.857030 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62689cce-2950-4e87-bd84-e33de31076e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:57.862579 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62689cce-2950-4e87-bd84-e33de31076e2 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:57.877833 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 952/1890] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:47:57.881941 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62689cce-2950-4e87-bd84-e33de31076e2 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:57.882955 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 939/1891] 10.222.0.26 () {58 vars in 1018 bytes} [Sun Sep 11 08:47:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:57.894110 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62689cce-2950-4e87-bd84-e33de31076e2 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:57.899644 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a760038-1468-4c48-a6cb-795f888ec939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:57.900350 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a760038-1468-4c48-a6cb-795f888ec939 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:57.901605 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a760038-1468-4c48-a6cb-795f888ec939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:57.901903 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a760038-1468-4c48-a6cb-795f888ec939 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:57.902659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a760038-1468-4c48-a6cb-795f888ec939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:57.904447 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a760038-1468-4c48-a6cb-795f888ec939 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:57.930255 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 953/1892] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:47:57.930574 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3b1cd-1f65-4034-a4a8-ac4b7fc30839 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:57.930574 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3cc3b1cd-1f65-4034-a4a8-ac4b7fc30839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:57.938465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a760038-1468-4c48-a6cb-795f888ec939 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:57.950143 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a760038-1468-4c48-a6cb-795f888ec939 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:57.961545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454dbf1f-597c-4257-bd77-be3729206cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:57.962237 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454dbf1f-597c-4257-bd77-be3729206cdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:57.962668 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454dbf1f-597c-4257-bd77-be3729206cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:57.963112 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454dbf1f-597c-4257-bd77-be3729206cdd admin admin] PATH_INFO: `/v3/projects/b850d260d1fa45b58900415dcc97f47e/users/950750cb1a20452e9a69759a9e2b7e80/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:57.988086 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454dbf1f-597c-4257-bd77-be3729206cdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b850d260d1fa45b58900415dcc97f47e, user_id=950750cb1a20452e9a69759a9e2b7e80, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:57.991294 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454dbf1f-597c-4257-bd77-be3729206cdd admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:58.045050 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3b1cd-1f65-4034-a4a8-ac4b7fc30839 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:58.069699 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5d2a4-6cd9-40e1-ab16-fc36ad4033a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:58.070805 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5d2a4-6cd9-40e1-ab16-fc36ad4033a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:58.071342 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5d2a4-6cd9-40e1-ab16-fc36ad4033a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:58.071839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5d2a4-6cd9-40e1-ab16-fc36ad4033a1 admin admin] PATH_INFO: `/v3/projects/5808959ac8074b10b7fd4085ba3f9031` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:58.080609 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5d2a4-6cd9-40e1-ab16-fc36ad4033a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5808959ac8074b10b7fd4085ba3f9031)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:58.084957 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5d2a4-6cd9-40e1-ab16-fc36ad4033a1 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:58.121157 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 954/1893] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:47:57 2022] PUT /identity/v3/projects/b850d260d1fa45b58900415dcc97f47e/users/950750cb1a20452e9a69759a9e2b7e80/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:58.122743 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454dbf1f-597c-4257-bd77-be3729206cdd admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:58.125955 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-454dbf1f-597c-4257-bd77-be3729206cdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:58.306204 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-15e5d2a4-6cd9-40e1-ab16-fc36ad4033a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5808959ac8074b10b7fd4085ba3f9031', 'request_id': 'req-15e5d2a4-6cd9-40e1-ab16-fc36ad4033a1'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:58.317451 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454dbf1f-597c-4257-bd77-be3729206cdd admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:58.334459 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-15e5d2a4-6cd9-40e1-ab16-fc36ad4033a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5808959ac8074b10b7fd4085ba3f9031', 'request_id': 'req-15e5d2a4-6cd9-40e1-ab16-fc36ad4033a1'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:58.449811 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12fe94-3db5-4514-baf8-e31aa1c86b69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:58.451420 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12fe94-3db5-4514-baf8-e31aa1c86b69 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:58.452606 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12fe94-3db5-4514-baf8-e31aa1c86b69 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:58.452932 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-15e5d2a4-6cd9-40e1-ab16-fc36ad4033a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5808959ac8074b10b7fd4085ba3f9031', 'request_id': 'req-15e5d2a4-6cd9-40e1-ab16-fc36ad4033a1'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:58.453748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12fe94-3db5-4514-baf8-e31aa1c86b69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:58.478722 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12fe94-3db5-4514-baf8-e31aa1c86b69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:58.480052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-15e5d2a4-6cd9-40e1-ab16-fc36ad4033a1 admin admin] The token cache is being invalidate because project 5808959ac8074b10b7fd4085ba3f9031 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:47:58.480433 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-15e5d2a4-6cd9-40e1-ab16-fc36ad4033a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:58.482107 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12fe94-3db5-4514-baf8-e31aa1c86b69 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:58.482655 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-15e5d2a4-6cd9-40e1-ab16-fc36ad4033a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:58.485767 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 940/1894] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:47:57 2022] DELETE /identity/v3/projects/5808959ac8074b10b7fd4085ba3f9031 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:58.496498 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301a389-f5d1-4b65-8957-9d070f77308f None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:58.501905 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301a389-f5d1-4b65-8957-9d070f77308f None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:58.501905 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301a389-f5d1-4b65-8957-9d070f77308f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:58.523392 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 955/1895] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:47:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:47:58.525238 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12fe94-3db5-4514-baf8-e31aa1c86b69 service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:58.536614 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5d12fe94-3db5-4514-baf8-e31aa1c86b69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:58.545137 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-b301a389-f5d1-4b65-8957-9d070f77308f None None] MFA Rules not processed for user `950750cb1a20452e9a69759a9e2b7e80`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:58.547042 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b301a389-f5d1-4b65-8957-9d070f77308f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:58.650242 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 941/1896] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:58.657093 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b757baf-74ed-4812-a29b-8f954c25fe5a None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:58.657093 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b757baf-74ed-4812-a29b-8f954c25fe5a None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:58.657465 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b757baf-74ed-4812-a29b-8f954c25fe5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:58.687475 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-7b757baf-74ed-4812-a29b-8f954c25fe5a None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:58.688963 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7b757baf-74ed-4812-a29b-8f954c25fe5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:58.739845 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12fe94-3db5-4514-baf8-e31aa1c86b69 service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:58.748345 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c812e0-60d8-4363-9abf-d64cd92b19de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:58.749620 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c812e0-60d8-4363-9abf-d64cd92b19de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:58.749909 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c812e0-60d8-4363-9abf-d64cd92b19de admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:58.750185 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c812e0-60d8-4363-9abf-d64cd92b19de admin admin] PATH_INFO: `/v3/projects/3aa97a5eeb4a4c308a614d9ccfdd603d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:58.773507 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c812e0-60d8-4363-9abf-d64cd92b19de admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aa97a5eeb4a4c308a614d9ccfdd603d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:58.775815 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c812e0-60d8-4363-9abf-d64cd92b19de admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:58.821755 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 942/1897] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:58.822460 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b757baf-74ed-4812-a29b-8f954c25fe5a None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:58.824082 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7b757baf-74ed-4812-a29b-8f954c25fe5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:58.839489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b757baf-74ed-4812-a29b-8f954c25fe5a None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:58.846604 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa7ca2-4084-4bbd-8ca0-f14748b4cca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:58.847681 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa7ca2-4084-4bbd-8ca0-f14748b4cca4 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:58.848171 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa7ca2-4084-4bbd-8ca0-f14748b4cca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:58.848585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa7ca2-4084-4bbd-8ca0-f14748b4cca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:58.850522 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa7ca2-4084-4bbd-8ca0-f14748b4cca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:58.854233 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa7ca2-4084-4bbd-8ca0-f14748b4cca4 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:58.995174 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-69c812e0-60d8-4363-9abf-d64cd92b19de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aa97a5eeb4a4c308a614d9ccfdd603d', 'request_id': 'req-69c812e0-60d8-4363-9abf-d64cd92b19de'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:59.017325 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 943/1898] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:47:58 2022] POST /identity/v3/projects => generated 375 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:47:59.017425 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-69c812e0-60d8-4363-9abf-d64cd92b19de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aa97a5eeb4a4c308a614d9ccfdd603d', 'request_id': 'req-69c812e0-60d8-4363-9abf-d64cd92b19de'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:59.017501 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97b74a-da8d-4f2f-83b8-b75d12d40ef9 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:59.017501 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97b74a-da8d-4f2f-83b8-b75d12d40ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:59.017501 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97b74a-da8d-4f2f-83b8-b75d12d40ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:59.056893 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-3d97b74a-da8d-4f2f-83b8-b75d12d40ef9 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:59.058292 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3d97b74a-da8d-4f2f-83b8-b75d12d40ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:59.129055 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 944/1899] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:59.130082 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97b74a-da8d-4f2f-83b8-b75d12d40ef9 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:59.141329 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97b74a-da8d-4f2f-83b8-b75d12d40ef9 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:59.146812 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312a050-ec07-408b-9828-d2be7baac09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:59.147370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-69c812e0-60d8-4363-9abf-d64cd92b19de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aa97a5eeb4a4c308a614d9ccfdd603d', 'request_id': 'req-69c812e0-60d8-4363-9abf-d64cd92b19de'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:59.147580 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312a050-ec07-408b-9828-d2be7baac09a admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:59.147748 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312a050-ec07-408b-9828-d2be7baac09a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:59.148269 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312a050-ec07-408b-9828-d2be7baac09a admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:59.148934 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a312a050-ec07-408b-9828-d2be7baac09a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:59.150944 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a312a050-ec07-408b-9828-d2be7baac09a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:59.169682 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-69c812e0-60d8-4363-9abf-d64cd92b19de admin admin] The token cache is being invalidate because project 3aa97a5eeb4a4c308a614d9ccfdd603d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:47:59.170015 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-69c812e0-60d8-4363-9abf-d64cd92b19de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:59.170684 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-69c812e0-60d8-4363-9abf-d64cd92b19de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:47:59.172316 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 956/1900] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:47:58 2022] DELETE /identity/v3/projects/3aa97a5eeb4a4c308a614d9ccfdd603d => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:59.173243 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c812e0-60d8-4363-9abf-d64cd92b19de admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:59.175096 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-69c812e0-60d8-4363-9abf-d64cd92b19de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:59.260868 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 945/1901] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:47:59 2022] POST /identity/v3/users => generated 294 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:47:59.262064 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47366b-3b73-4a0b-9ba3-65f869faa7a1 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:59.262363 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47366b-3b73-4a0b-9ba3-65f869faa7a1 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:59.262865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47366b-3b73-4a0b-9ba3-65f869faa7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:59.267459 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c812e0-60d8-4363-9abf-d64cd92b19de admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:59.274536 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedce199-7d6e-427e-8a88-74f503dbe12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:59.275282 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedce199-7d6e-427e-8a88-74f503dbe12e admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:59.275658 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedce199-7d6e-427e-8a88-74f503dbe12e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:59.275931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedce199-7d6e-427e-8a88-74f503dbe12e admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:59.276600 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedce199-7d6e-427e-8a88-74f503dbe12e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:47:59.276908 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedce199-7d6e-427e-8a88-74f503dbe12e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:59.278929 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedce199-7d6e-427e-8a88-74f503dbe12e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:59.291865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-ec47366b-3b73-4a0b-9ba3-65f869faa7a1 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:59.296081 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 957/1902] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:47:59.296081 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedce199-7d6e-427e-8a88-74f503dbe12e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:59.296375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ec47366b-3b73-4a0b-9ba3-65f869faa7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:59.296536 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-dedce199-7d6e-427e-8a88-74f503dbe12e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:59.303830 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 946/1903] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:59.305122 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47366b-3b73-4a0b-9ba3-65f869faa7a1 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:59.310602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedce199-7d6e-427e-8a88-74f503dbe12e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:59.318929 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47366b-3b73-4a0b-9ba3-65f869faa7a1 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:59.320357 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf7866-29ba-47c5-862e-4c03b0d34c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:59.321017 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf7866-29ba-47c5-862e-4c03b0d34c49 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:59.321270 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf7866-29ba-47c5-862e-4c03b0d34c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:59.321539 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf7866-29ba-47c5-862e-4c03b0d34c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:59.322195 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf7866-29ba-47c5-862e-4c03b0d34c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:59.323986 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf7866-29ba-47c5-862e-4c03b0d34c49 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:59.325078 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831d083-b515-41cc-b4bf-b7ed591460c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:59.325985 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831d083-b515-41cc-b4bf-b7ed591460c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:59.326383 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831d083-b515-41cc-b4bf-b7ed591460c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:59.327534 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831d083-b515-41cc-b4bf-b7ed591460c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:59.328322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8831d083-b515-41cc-b4bf-b7ed591460c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:59.331287 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8831d083-b515-41cc-b4bf-b7ed591460c7 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:59.345701 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 958/1904] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:47:59.348126 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b977dd-0339-4c38-b57d-db28d25c4bdf None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:59.348626 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b977dd-0339-4c38-b57d-db28d25c4bdf None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:59.349011 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b977dd-0339-4c38-b57d-db28d25c4bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:59.378080 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-86b977dd-0339-4c38-b57d-db28d25c4bdf None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:47:59.382906 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-86b977dd-0339-4c38-b57d-db28d25c4bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:47:59.399898 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 959/1905] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:47:59.401384 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b977dd-0339-4c38-b57d-db28d25c4bdf None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:59.421446 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b977dd-0339-4c38-b57d-db28d25c4bdf None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:59.435015 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9bfa62-6267-49e2-8e8c-56ad96dd8e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:59.436056 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bfa62-6267-49e2-8e8c-56ad96dd8e0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:59.438975 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bfa62-6267-49e2-8e8c-56ad96dd8e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:59.439300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bfa62-6267-49e2-8e8c-56ad96dd8e0d admin admin] PATH_INFO: `/v3/projects/9aefb0df088b41638bc79e6bf577c51d/users/67024073aee74735a844be9c1e0fd112/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:59.464579 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 947/1906] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:47:59 2022] POST /identity/v3/projects => generated 375 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:47:59.465599 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831d083-b515-41cc-b4bf-b7ed591460c7 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:59.476979 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9bfa62-6267-49e2-8e8c-56ad96dd8e0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aefb0df088b41638bc79e6bf577c51d, user_id=67024073aee74735a844be9c1e0fd112, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:59.484150 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9bfa62-6267-49e2-8e8c-56ad96dd8e0d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:59.554184 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831d083-b515-41cc-b4bf-b7ed591460c7 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:59.562176 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e28303-da59-4741-a095-3b020ebca5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:59.562942 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e28303-da59-4741-a095-3b020ebca5cd admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:59.563431 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e28303-da59-4741-a095-3b020ebca5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:59.563795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e28303-da59-4741-a095-3b020ebca5cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:59.564481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e28303-da59-4741-a095-3b020ebca5cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:47:59.568561 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e28303-da59-4741-a095-3b020ebca5cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:59.568561 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e28303-da59-4741-a095-3b020ebca5cd admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:59.589935 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 948/1907] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:47:59.589935 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e28303-da59-4741-a095-3b020ebca5cd admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:59.598433 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 960/1908] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:47:59 2022] PUT /identity/v3/projects/9aefb0df088b41638bc79e6bf577c51d/users/67024073aee74735a844be9c1e0fd112/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:47:59.599071 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9bfa62-6267-49e2-8e8c-56ad96dd8e0d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:59.602698 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e28303-da59-4741-a095-3b020ebca5cd admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:59.681828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab277f6f-e710-4be9-8bdd-344316f2c1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:59.682638 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab277f6f-e710-4be9-8bdd-344316f2c1ea admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:59.683008 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab277f6f-e710-4be9-8bdd-344316f2c1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:59.683316 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab277f6f-e710-4be9-8bdd-344316f2c1ea admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:59.684190 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab277f6f-e710-4be9-8bdd-344316f2c1ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:59.686970 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab277f6f-e710-4be9-8bdd-344316f2c1ea admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:59.695504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9bfa62-6267-49e2-8e8c-56ad96dd8e0d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:59.700623 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb527c00-b168-4ff5-a645-46bc81adf22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:59.701457 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb527c00-b168-4ff5-a645-46bc81adf22a admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:59.707907 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb527c00-b168-4ff5-a645-46bc81adf22a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:59.707907 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb527c00-b168-4ff5-a645-46bc81adf22a admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:59.707907 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb527c00-b168-4ff5-a645-46bc81adf22a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:59.707907 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb527c00-b168-4ff5-a645-46bc81adf22a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:59.882137 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 949/1909] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:47:59 2022] POST /identity/v3/users => generated 288 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:47:59.883217 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab277f6f-e710-4be9-8bdd-344316f2c1ea admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:59.897616 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab277f6f-e710-4be9-8bdd-344316f2c1ea admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:47:59.902613 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:59.909228 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb549b49-324b-4bb1-98e0-f68005d94af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:47:59.909228 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb549b49-324b-4bb1-98e0-f68005d94af5 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:47:59.909228 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb549b49-324b-4bb1-98e0-f68005d94af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:47:59.909228 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb549b49-324b-4bb1-98e0-f68005d94af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:47:59.909864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb549b49-324b-4bb1-98e0-f68005d94af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:47:59.912541 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb549b49-324b-4bb1-98e0-f68005d94af5 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:47:59.919111 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 961/1910] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:47:59 2022] POST /identity/v3/projects => generated 371 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:47:59.921395 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb527c00-b168-4ff5-a645-46bc81adf22a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:59.931817 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 950/1911] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:47:59.931817 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb549b49-324b-4bb1-98e0-f68005d94af5 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:47:59.945920 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb549b49-324b-4bb1-98e0-f68005d94af5 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:00.023505 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb527c00-b168-4ff5-a645-46bc81adf22a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:00.029250 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b08d4-b97f-4586-8f86-de284d6b6f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:00.030847 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b08d4-b97f-4586-8f86-de284d6b6f55 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:00.031350 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b08d4-b97f-4586-8f86-de284d6b6f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:00.031801 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b08d4-b97f-4586-8f86-de284d6b6f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:00.032727 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b08d4-b97f-4586-8f86-de284d6b6f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:00.035742 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b08d4-b97f-4586-8f86-de284d6b6f55 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:00.035921 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4caac3b-564c-4d9a-aec8-bbea3363ad40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:00.036728 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4caac3b-564c-4d9a-aec8-bbea3363ad40 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:00.037296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4caac3b-564c-4d9a-aec8-bbea3363ad40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:00.037796 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4caac3b-564c-4d9a-aec8-bbea3363ad40 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:00.039182 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4caac3b-564c-4d9a-aec8-bbea3363ad40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:00.044105 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4caac3b-564c-4d9a-aec8-bbea3363ad40 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:00.048686 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 962/1912] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:00.049773 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b08d4-b97f-4586-8f86-de284d6b6f55 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:00.055523 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-190b08d4-b97f-4586-8f86-de284d6b6f55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:00.081117 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:00.084516 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b08d4-b97f-4586-8f86-de284d6b6f55 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:00.093311 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da788ab-78a6-4896-a42d-13e7314b66b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:00.094039 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da788ab-78a6-4896-a42d-13e7314b66b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:00.094517 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da788ab-78a6-4896-a42d-13e7314b66b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:00.094862 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da788ab-78a6-4896-a42d-13e7314b66b7 admin admin] PATH_INFO: `/v3/users/b15f16dcdff641c3b526830355ecd0d4` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:00.096675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da788ab-78a6-4896-a42d-13e7314b66b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b15f16dcdff641c3b526830355ecd0d4)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:00.098921 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da788ab-78a6-4896-a42d-13e7314b66b7 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:00.154834 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 951/1913] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:47:59 2022] POST /identity/v3/users => generated 286 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:48:00.154834 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4caac3b-564c-4d9a-aec8-bbea3363ad40 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:00.173266 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4caac3b-564c-4d9a-aec8-bbea3363ad40 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:00.181895 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b2c36-5686-49a2-9783-2879d74ab4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:00.183091 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b2c36-5686-49a2-9783-2879d74ab4ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:00.183637 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b2c36-5686-49a2-9783-2879d74ab4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:00.184459 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b2c36-5686-49a2-9783-2879d74ab4ae admin admin] PATH_INFO: `/v3/projects/9aefb0df088b41638bc79e6bf577c51d/users/67024073aee74735a844be9c1e0fd112/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:00.188494 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b2c36-5686-49a2-9783-2879d74ab4ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aefb0df088b41638bc79e6bf577c51d, user_id=67024073aee74735a844be9c1e0fd112, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:00.197785 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b2c36-5686-49a2-9783-2879d74ab4ae admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:00.238237 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 952/1914] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:48:00 2022] PUT /identity/v3/projects/9aefb0df088b41638bc79e6bf577c51d/users/67024073aee74735a844be9c1e0fd112/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:00.238237 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b2c36-5686-49a2-9783-2879d74ab4ae admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:00.316597 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2da788ab-78a6-4896-a42d-13e7314b66b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b15f16dcdff641c3b526830355ecd0d4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:00.341289 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b2c36-5686-49a2-9783-2879d74ab4ae admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:00.350926 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745f880-92b7-4952-98bc-1e010f217dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:00.352390 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745f880-92b7-4952-98bc-1e010f217dab admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:00.352622 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745f880-92b7-4952-98bc-1e010f217dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:00.353117 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745f880-92b7-4952-98bc-1e010f217dab admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:00.354711 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745f880-92b7-4952-98bc-1e010f217dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:00.357660 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745f880-92b7-4952-98bc-1e010f217dab admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:00.379213 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 953/1915] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:00.380800 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745f880-92b7-4952-98bc-1e010f217dab admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:00.400398 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745f880-92b7-4952-98bc-1e010f217dab admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:00.407900 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2da788ab-78a6-4896-a42d-13e7314b66b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b15f16dcdff641c3b526830355ecd0d4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:00.410665 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2da788ab-78a6-4896-a42d-13e7314b66b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b15f16dcdff641c3b526830355ecd0d4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:00.413021 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2da788ab-78a6-4896-a42d-13e7314b66b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b15f16dcdff641c3b526830355ecd0d4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:00.426396 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20156a-902f-45bc-b506-5df54efec8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:00.428853 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20156a-902f-45bc-b506-5df54efec8ba admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:00.429391 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20156a-902f-45bc-b506-5df54efec8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:00.429917 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20156a-902f-45bc-b506-5df54efec8ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:00.443282 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c20156a-902f-45bc-b506-5df54efec8ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:00.443747 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2da788ab-78a6-4896-a42d-13e7314b66b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b15f16dcdff641c3b526830355ecd0d4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:00.443893 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c20156a-902f-45bc-b506-5df54efec8ba admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:00.472150 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 954/1916] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:00.473793 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3e4f1-0071-4de2-a956-8848d3c338f1 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:00.474164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3e4f1-0071-4de2-a956-8848d3c338f1 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:00.474487 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3e4f1-0071-4de2-a956-8848d3c338f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:00.488527 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 963/1917] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:48:00 2022] DELETE /identity/v3/users/b15f16dcdff641c3b526830355ecd0d4 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:00.489830 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da788ab-78a6-4896-a42d-13e7314b66b7 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:00.491643 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2da788ab-78a6-4896-a42d-13e7314b66b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:00.509011 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-d2c3e4f1-0071-4de2-a956-8848d3c338f1 None None] MFA Rules not processed for user `67024073aee74735a844be9c1e0fd112`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:00.512051 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d2c3e4f1-0071-4de2-a956-8848d3c338f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:00.578188 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da788ab-78a6-4896-a42d-13e7314b66b7 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:00.585585 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306284c-23a2-4d74-9426-a6147db2cc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:00.586709 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306284c-23a2-4d74-9426-a6147db2cc71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:00.587354 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306284c-23a2-4d74-9426-a6147db2cc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:00.587909 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306284c-23a2-4d74-9426-a6147db2cc71 admin admin] PATH_INFO: `/v3/projects/298aa829cc5a45d386a0f2790166e288/users/c8dc8f4ff34d4c179375ecabadd397e6/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:00.606502 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306284c-23a2-4d74-9426-a6147db2cc71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=298aa829cc5a45d386a0f2790166e288, user_id=c8dc8f4ff34d4c179375ecabadd397e6, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:00.610023 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306284c-23a2-4d74-9426-a6147db2cc71 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:00.641346 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 955/1918] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:00.641346 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3e4f1-0071-4de2-a956-8848d3c338f1 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:00.641346 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d2c3e4f1-0071-4de2-a956-8848d3c338f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:00.681188 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3e4f1-0071-4de2-a956-8848d3c338f1 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:00.687814 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e831d4-2296-4b35-9439-9150a05e01cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:00.689046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e831d4-2296-4b35-9439-9150a05e01cf admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:00.690716 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e831d4-2296-4b35-9439-9150a05e01cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:00.691216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e831d4-2296-4b35-9439-9150a05e01cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:00.692344 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e831d4-2296-4b35-9439-9150a05e01cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:00.697664 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e831d4-2296-4b35-9439-9150a05e01cf admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:00.723402 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 964/1919] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:48:00 2022] PUT /identity/v3/projects/298aa829cc5a45d386a0f2790166e288/users/c8dc8f4ff34d4c179375ecabadd397e6/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:00.740599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a614fb8-7381-4ecf-9878-53be15069cd7 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:00.747461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 956/1920] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:00.747461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e831d4-2296-4b35-9439-9150a05e01cf admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:00.747708 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a614fb8-7381-4ecf-9878-53be15069cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:00.747708 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a614fb8-7381-4ecf-9878-53be15069cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:00.748163 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f6e831d4-2296-4b35-9439-9150a05e01cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:00.788761 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2a614fb8-7381-4ecf-9878-53be15069cd7 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:00.790131 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2a614fb8-7381-4ecf-9878-53be15069cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:00.845557 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e831d4-2296-4b35-9439-9150a05e01cf admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:00.926764 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 965/1921] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:00.944440 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875db9e-c776-4870-8fb2-9c341ed104cd None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:00.944826 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875db9e-c776-4870-8fb2-9c341ed104cd None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:00.945112 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875db9e-c776-4870-8fb2-9c341ed104cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:01.000942 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ad0a1-5e3b-4848-947d-9b84cc6f0a88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:01.002295 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ad0a1-5e3b-4848-947d-9b84cc6f0a88 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:01.002743 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ad0a1-5e3b-4848-947d-9b84cc6f0a88 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:01.003171 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ad0a1-5e3b-4848-947d-9b84cc6f0a88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:01.006301 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-482ad0a1-5e3b-4848-947d-9b84cc6f0a88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:01.010960 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-1875db9e-c776-4870-8fb2-9c341ed104cd None None] MFA Rules not processed for user `c8dc8f4ff34d4c179375ecabadd397e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:01.013175 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1875db9e-c776-4870-8fb2-9c341ed104cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:01.136605 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 966/1922] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:01.136605 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875db9e-c776-4870-8fb2-9c341ed104cd None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:01.149979 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875db9e-c776-4870-8fb2-9c341ed104cd None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:01.156109 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa8dd0-7779-4513-bf9f-d6862e5a8c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:01.156355 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ad0a1-5e3b-4848-947d-9b84cc6f0a88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:01.156703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa8dd0-7779-4513-bf9f-d6862e5a8c65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:01.157490 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa8dd0-7779-4513-bf9f-d6862e5a8c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:01.157490 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa8dd0-7779-4513-bf9f-d6862e5a8c65 admin admin] PATH_INFO: `/v3/projects/be2b329ba81047ffacdbc40f9dc879ab/users/4dd8ebaf766e47bb9eaa7538e0ee1733/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:01.167011 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ad0a1-5e3b-4848-947d-9b84cc6f0a88 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:01.177717 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa8dd0-7779-4513-bf9f-d6862e5a8c65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2b329ba81047ffacdbc40f9dc879ab, user_id=4dd8ebaf766e47bb9eaa7538e0ee1733, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:01.181003 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa8dd0-7779-4513-bf9f-d6862e5a8c65 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:01.195609 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 957/1923] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:48:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:48:01.198004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ad0a1-5e3b-4848-947d-9b84cc6f0a88 service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:01.200447 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-482ad0a1-5e3b-4848-947d-9b84cc6f0a88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:01.300360 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ad0a1-5e3b-4848-947d-9b84cc6f0a88 service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:01.301257 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 967/1924] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:48:01 2022] PUT /identity/v3/projects/be2b329ba81047ffacdbc40f9dc879ab/users/4dd8ebaf766e47bb9eaa7538e0ee1733/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:01.302812 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa8dd0-7779-4513-bf9f-d6862e5a8c65 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:01.313117 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-cffa8dd0-7779-4513-bf9f-d6862e5a8c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:01.398294 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa8dd0-7779-4513-bf9f-d6862e5a8c65 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:01.402628 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203927e-90eb-408c-933b-3cc75d70e1d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:01.403431 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203927e-90eb-408c-933b-3cc75d70e1d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:01.403978 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203927e-90eb-408c-933b-3cc75d70e1d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:01.404353 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203927e-90eb-408c-933b-3cc75d70e1d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:01.414428 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b7ae4-07f0-4991-ac05-0e514324bb62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:01.415105 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b7ae4-07f0-4991-ac05-0e514324bb62 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:01.415542 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b7ae4-07f0-4991-ac05-0e514324bb62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:01.416132 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b7ae4-07f0-4991-ac05-0e514324bb62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:01.506329 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a203927e-90eb-408c-933b-3cc75d70e1d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:01.518245 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a203927e-90eb-408c-933b-3cc75d70e1d6 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:01.543752 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b7ae4-07f0-4991-ac05-0e514324bb62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:01.549412 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b7ae4-07f0-4991-ac05-0e514324bb62 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:01.552750 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 968/1925] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:48:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:48:01.555997 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60df57-b4a8-4be2-bf72-3ac13a78b4b6 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:01.556805 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60df57-b4a8-4be2-bf72-3ac13a78b4b6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:01.557358 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60df57-b4a8-4be2-bf72-3ac13a78b4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:01.600164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 958/1926] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:48:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:48:01.683651 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-bb60df57-b4a8-4be2-bf72-3ac13a78b4b6 None None] MFA Rules not processed for user `4dd8ebaf766e47bb9eaa7538e0ee1733`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:01.691656 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-bb60df57-b4a8-4be2-bf72-3ac13a78b4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:01.836990 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 969/1927] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:01.846454 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:01.955917 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:02.168472 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b7ae4-07f0-4991-ac05-0e514324bb62 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:02.195359 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b7ae4-07f0-4991-ac05-0e514324bb62 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:02.202302 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc23482-e000-4b4b-9589-254f42b19b89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:02.203994 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc23482-e000-4b4b-9589-254f42b19b89 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:02.204539 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc23482-e000-4b4b-9589-254f42b19b89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:02.204880 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc23482-e000-4b4b-9589-254f42b19b89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:02.217179 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc23482-e000-4b4b-9589-254f42b19b89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:02.219016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc23482-e000-4b4b-9589-254f42b19b89 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:02.230260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 959/1928] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:48:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:48:02.557543 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60df57-b4a8-4be2-bf72-3ac13a78b4b6 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:02.558006 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-bb60df57-b4a8-4be2-bf72-3ac13a78b4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:02.574818 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60df57-b4a8-4be2-bf72-3ac13a78b4b6 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:02.579832 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39866c37-eef5-40b8-ab39-87a6ded5f1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:02.580692 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39866c37-eef5-40b8-ab39-87a6ded5f1a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:02.581069 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39866c37-eef5-40b8-ab39-87a6ded5f1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:02.581417 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39866c37-eef5-40b8-ab39-87a6ded5f1a2 admin admin] PATH_INFO: `/v3/projects/81629cda6d8942f0b89359a283c3ff4b` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:02.583128 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39866c37-eef5-40b8-ab39-87a6ded5f1a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81629cda6d8942f0b89359a283c3ff4b)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:02.585187 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39866c37-eef5-40b8-ab39-87a6ded5f1a2 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:02.768260 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-39866c37-eef5-40b8-ab39-87a6ded5f1a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81629cda6d8942f0b89359a283c3ff4b', 'request_id': 'req-39866c37-eef5-40b8-ab39-87a6ded5f1a2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:02.777360 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-39866c37-eef5-40b8-ab39-87a6ded5f1a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81629cda6d8942f0b89359a283c3ff4b', 'request_id': 'req-39866c37-eef5-40b8-ab39-87a6ded5f1a2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:02.874889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-39866c37-eef5-40b8-ab39-87a6ded5f1a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81629cda6d8942f0b89359a283c3ff4b', 'request_id': 'req-39866c37-eef5-40b8-ab39-87a6ded5f1a2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:02.893137 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-39866c37-eef5-40b8-ab39-87a6ded5f1a2 admin admin] The token cache is being invalidate because project 81629cda6d8942f0b89359a283c3ff4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:48:02.893852 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-39866c37-eef5-40b8-ab39-87a6ded5f1a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:02.895014 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-39866c37-eef5-40b8-ab39-87a6ded5f1a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:02.897795 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 970/1929] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:48:02 2022] DELETE /identity/v3/projects/81629cda6d8942f0b89359a283c3ff4b => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:02.904239 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc23482-e000-4b4b-9589-254f42b19b89 service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:02.923176 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc23482-e000-4b4b-9589-254f42b19b89 service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:03.014889 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771da37a-796b-4da5-835f-745f97c65124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:03.015724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771da37a-796b-4da5-835f-745f97c65124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:03.016007 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771da37a-796b-4da5-835f-745f97c65124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:03.016270 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771da37a-796b-4da5-835f-745f97c65124 admin admin] PATH_INFO: `/v3/users/26879249af604dfa9e1863fd7d457a49` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:03.017438 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771da37a-796b-4da5-835f-745f97c65124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26879249af604dfa9e1863fd7d457a49)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:03.019505 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771da37a-796b-4da5-835f-745f97c65124 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:03.251867 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-771da37a-796b-4da5-835f-745f97c65124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26879249af604dfa9e1863fd7d457a49'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:03.253332 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-771da37a-796b-4da5-835f-745f97c65124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26879249af604dfa9e1863fd7d457a49'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:03.262727 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-771da37a-796b-4da5-835f-745f97c65124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26879249af604dfa9e1863fd7d457a49'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:03.263779 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-771da37a-796b-4da5-835f-745f97c65124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26879249af604dfa9e1863fd7d457a49'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:03.360645 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-771da37a-796b-4da5-835f-745f97c65124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26879249af604dfa9e1863fd7d457a49'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:03.385506 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 960/1930] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:48:02 2022] DELETE /identity/v3/users/26879249af604dfa9e1863fd7d457a49 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:03.983383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39866c37-eef5-40b8-ab39-87a6ded5f1a2 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:03.985216 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-39866c37-eef5-40b8-ab39-87a6ded5f1a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:04.001598 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39866c37-eef5-40b8-ab39-87a6ded5f1a2 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:04.076645 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31200db9-db70-4463-a2cd-2aabe3656411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:04.077546 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31200db9-db70-4463-a2cd-2aabe3656411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:04.077920 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31200db9-db70-4463-a2cd-2aabe3656411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:04.078363 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31200db9-db70-4463-a2cd-2aabe3656411 admin admin] PATH_INFO: `/v3/projects/a3b505825c1a48f3bb007f1430e439cd` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:04.079827 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31200db9-db70-4463-a2cd-2aabe3656411 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3b505825c1a48f3bb007f1430e439cd)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:04.082135 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31200db9-db70-4463-a2cd-2aabe3656411 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:04.093839 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:04.198471 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-31200db9-db70-4463-a2cd-2aabe3656411 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3b505825c1a48f3bb007f1430e439cd', 'request_id': 'req-31200db9-db70-4463-a2cd-2aabe3656411'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:04.208606 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-31200db9-db70-4463-a2cd-2aabe3656411 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3b505825c1a48f3bb007f1430e439cd', 'request_id': 'req-31200db9-db70-4463-a2cd-2aabe3656411'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:04.247725 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:04.294361 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-31200db9-db70-4463-a2cd-2aabe3656411 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3b505825c1a48f3bb007f1430e439cd', 'request_id': 'req-31200db9-db70-4463-a2cd-2aabe3656411'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:04.320807 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-31200db9-db70-4463-a2cd-2aabe3656411 admin admin] The token cache is being invalidate because project a3b505825c1a48f3bb007f1430e439cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:48:04.321661 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-31200db9-db70-4463-a2cd-2aabe3656411 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:04.325590 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-31200db9-db70-4463-a2cd-2aabe3656411 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:04.329165 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 971/1931] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:48:03 2022] DELETE /identity/v3/projects/a3b505825c1a48f3bb007f1430e439cd => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:04.334258 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e519443-aafe-4297-86a2-5bf37c4b9ced None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:04.335053 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e519443-aafe-4297-86a2-5bf37c4b9ced None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:04.335053 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e519443-aafe-4297-86a2-5bf37c4b9ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:04.395105 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-3e519443-aafe-4297-86a2-5bf37c4b9ced None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:04.396743 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3e519443-aafe-4297-86a2-5bf37c4b9ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:04.505714 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 961/1932] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:48:04.519016 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20742233-9d69-4022-8e52-b2c4077e5e6b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:04.519508 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20742233-9d69-4022-8e52-b2c4077e5e6b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:04.519925 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20742233-9d69-4022-8e52-b2c4077e5e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:04.578293 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-20742233-9d69-4022-8e52-b2c4077e5e6b None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:04.579625 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-20742233-9d69-4022-8e52-b2c4077e5e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:04.592912 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 972/1933] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:04.594755 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e519443-aafe-4297-86a2-5bf37c4b9ced None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:04.612433 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e519443-aafe-4297-86a2-5bf37c4b9ced None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:04.620566 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396953c0-b2d0-4301-87c6-dee77028169e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:04.621660 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396953c0-b2d0-4301-87c6-dee77028169e admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:04.622192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396953c0-b2d0-4301-87c6-dee77028169e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:04.622696 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396953c0-b2d0-4301-87c6-dee77028169e admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:04.623900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396953c0-b2d0-4301-87c6-dee77028169e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:48:04.624402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396953c0-b2d0-4301-87c6-dee77028169e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:04.627680 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396953c0-b2d0-4301-87c6-dee77028169e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:04.650303 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 962/1934] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:48:04.656283 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20742233-9d69-4022-8e52-b2c4077e5e6b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:04.681013 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20742233-9d69-4022-8e52-b2c4077e5e6b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:04.686400 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24221521-e524-4827-95f3-8e894ae0f6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:04.687058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24221521-e524-4827-95f3-8e894ae0f6c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:04.687379 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24221521-e524-4827-95f3-8e894ae0f6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:04.687660 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24221521-e524-4827-95f3-8e894ae0f6c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:04.688315 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24221521-e524-4827-95f3-8e894ae0f6c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:04.690574 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24221521-e524-4827-95f3-8e894ae0f6c4 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:04.963757 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 973/1935] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:48:04 2022] POST /identity/v3/projects => generated 375 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:48:04.965305 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396953c0-b2d0-4301-87c6-dee77028169e admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:04.987325 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396953c0-b2d0-4301-87c6-dee77028169e admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:05.074694 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b49560-91d5-4548-b1eb-117d0990f300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:05.078374 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b49560-91d5-4548-b1eb-117d0990f300 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:05.078972 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b49560-91d5-4548-b1eb-117d0990f300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:05.079485 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b49560-91d5-4548-b1eb-117d0990f300 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:05.080398 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b49560-91d5-4548-b1eb-117d0990f300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:05.082926 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b49560-91d5-4548-b1eb-117d0990f300 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:05.212037 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 963/1936] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:48:04 2022] POST /identity/v3/users => generated 288 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:48:05.216437 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24221521-e524-4827-95f3-8e894ae0f6c4 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:05.227487 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24221521-e524-4827-95f3-8e894ae0f6c4 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:05.232840 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60fbeb-2d76-414f-b47e-c7d517683c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:05.233392 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60fbeb-2d76-414f-b47e-c7d517683c6b admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:05.233704 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60fbeb-2d76-414f-b47e-c7d517683c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:05.233979 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60fbeb-2d76-414f-b47e-c7d517683c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:05.234705 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60fbeb-2d76-414f-b47e-c7d517683c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:05.236394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60fbeb-2d76-414f-b47e-c7d517683c6b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:05.247898 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 974/1937] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:05.257715 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b49560-91d5-4548-b1eb-117d0990f300 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:05.268556 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b49560-91d5-4548-b1eb-117d0990f300 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:05.274994 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec98b1f-49a3-4d58-ba1b-bfe17f7c623f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:05.275641 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec98b1f-49a3-4d58-ba1b-bfe17f7c623f admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:05.276094 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec98b1f-49a3-4d58-ba1b-bfe17f7c623f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:05.276366 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec98b1f-49a3-4d58-ba1b-bfe17f7c623f admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:05.277006 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec98b1f-49a3-4d58-ba1b-bfe17f7c623f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:05.278846 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec98b1f-49a3-4d58-ba1b-bfe17f7c623f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:05.294545 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 964/1938] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:05.302002 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60fbeb-2d76-414f-b47e-c7d517683c6b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:05.319710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60fbeb-2d76-414f-b47e-c7d517683c6b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:05.325552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13daa23e-6f5a-46fc-9ec6-361841515ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:05.326481 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13daa23e-6f5a-46fc-9ec6-361841515ead admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:05.327789 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13daa23e-6f5a-46fc-9ec6-361841515ead admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:05.328195 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13daa23e-6f5a-46fc-9ec6-361841515ead admin admin] PATH_INFO: `/v3/projects/25b4cf4618d84cbe946c749a1286efed/users/57cdadf3d2d1443db9fafdbacbdb86a7/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:05.346005 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13daa23e-6f5a-46fc-9ec6-361841515ead admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b4cf4618d84cbe946c749a1286efed, user_id=57cdadf3d2d1443db9fafdbacbdb86a7, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:05.349516 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13daa23e-6f5a-46fc-9ec6-361841515ead admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:05.433915 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 975/1939] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:48:05 2022] PUT /identity/v3/projects/25b4cf4618d84cbe946c749a1286efed/users/57cdadf3d2d1443db9fafdbacbdb86a7/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:05.454671 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6de41-e6d0-466c-9248-2ccf47ca4a26 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:05.455581 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6de41-e6d0-466c-9248-2ccf47ca4a26 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:05.455718 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6de41-e6d0-466c-9248-2ccf47ca4a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:05.527053 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-42a6de41-e6d0-466c-9248-2ccf47ca4a26 None None] MFA Rules not processed for user `57cdadf3d2d1443db9fafdbacbdb86a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:05.529418 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-42a6de41-e6d0-466c-9248-2ccf47ca4a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:05.632202 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 965/1940] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:05.634886 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13daa23e-6f5a-46fc-9ec6-361841515ead admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:05.729577 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:05.779437 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13daa23e-6f5a-46fc-9ec6-361841515ead admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:05.798636 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ff7ad-ea1c-42a2-8b94-268f14731722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:05.800691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ff7ad-ea1c-42a2-8b94-268f14731722 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:05.800691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ff7ad-ea1c-42a2-8b94-268f14731722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:05.800691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ff7ad-ea1c-42a2-8b94-268f14731722 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:05.801346 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ff7ad-ea1c-42a2-8b94-268f14731722 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:05.803739 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ff7ad-ea1c-42a2-8b94-268f14731722 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:05.872257 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6de41-e6d0-466c-9248-2ccf47ca4a26 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:05.874360 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-42a6de41-e6d0-466c-9248-2ccf47ca4a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:05.891060 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6de41-e6d0-466c-9248-2ccf47ca4a26 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:05.896906 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7fe13-7419-472a-88c3-ffb820d6aae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:05.896906 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7fe13-7419-472a-88c3-ffb820d6aae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:05.896906 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7fe13-7419-472a-88c3-ffb820d6aae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:05.896906 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7fe13-7419-472a-88c3-ffb820d6aae7 admin admin] PATH_INFO: `/v3/users/950750cb1a20452e9a69759a9e2b7e80` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:05.900618 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7fe13-7419-472a-88c3-ffb820d6aae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=950750cb1a20452e9a69759a9e2b7e80)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:05.903104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7fe13-7419-472a-88c3-ffb820d6aae7 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:05.947268 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 976/1941] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:48:05 2022] POST /identity/v3/projects => generated 379 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:48:05.948913 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ff7ad-ea1c-42a2-8b94-268f14731722 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:06.052152 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ff7ad-ea1c-42a2-8b94-268f14731722 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:06.060593 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577df09-4654-40ea-81ca-0adba06b3652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:06.062047 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577df09-4654-40ea-81ca-0adba06b3652 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:06.062560 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577df09-4654-40ea-81ca-0adba06b3652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:06.063066 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577df09-4654-40ea-81ca-0adba06b3652 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:06.064636 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577df09-4654-40ea-81ca-0adba06b3652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:06.069247 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577df09-4654-40ea-81ca-0adba06b3652 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:06.078083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:06.141504 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-95c7fe13-7419-472a-88c3-ffb820d6aae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '950750cb1a20452e9a69759a9e2b7e80'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:06.142128 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-95c7fe13-7419-472a-88c3-ffb820d6aae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '950750cb1a20452e9a69759a9e2b7e80'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:06.150554 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-95c7fe13-7419-472a-88c3-ffb820d6aae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '950750cb1a20452e9a69759a9e2b7e80'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:06.151492 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-95c7fe13-7419-472a-88c3-ffb820d6aae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '950750cb1a20452e9a69759a9e2b7e80'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:06.181359 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 977/1942] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:48:05 2022] POST /identity/v3/users => generated 296 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:48:06.187132 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577df09-4654-40ea-81ca-0adba06b3652 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:06.189564 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8577df09-4654-40ea-81ca-0adba06b3652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:06.211879 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577df09-4654-40ea-81ca-0adba06b3652 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:06.225871 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf055df6-b624-4c5f-a523-187e9e457b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:06.230140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf055df6-b624-4c5f-a523-187e9e457b8c admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:06.230140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf055df6-b624-4c5f-a523-187e9e457b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:06.230140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf055df6-b624-4c5f-a523-187e9e457b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:06.230140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf055df6-b624-4c5f-a523-187e9e457b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:06.230832 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf055df6-b624-4c5f-a523-187e9e457b8c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:06.254304 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 978/1943] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:48:06.261790 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf055df6-b624-4c5f-a523-187e9e457b8c admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:06.270134 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-95c7fe13-7419-472a-88c3-ffb820d6aae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '950750cb1a20452e9a69759a9e2b7e80'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:06.309789 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf055df6-b624-4c5f-a523-187e9e457b8c admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:06.322889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfda19f-c01c-4a90-88c7-6553f12171df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:06.323601 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfda19f-c01c-4a90-88c7-6553f12171df admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:06.323882 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfda19f-c01c-4a90-88c7-6553f12171df admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:06.324163 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfda19f-c01c-4a90-88c7-6553f12171df admin admin] PATH_INFO: `/v3/projects/5754c772827e4e8aa70b1ae0cdc0adc7/users/eb988a6dde7147cab2cf61523c6128cb/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:06.327103 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 966/1944] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:48:05 2022] DELETE /identity/v3/users/950750cb1a20452e9a69759a9e2b7e80 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:06.331879 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1203ed-aca3-440e-9c41-cbcf2d6e9165 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:06.332167 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1203ed-aca3-440e-9c41-cbcf2d6e9165 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:06.332449 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1203ed-aca3-440e-9c41-cbcf2d6e9165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:06.352764 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfda19f-c01c-4a90-88c7-6553f12171df admin admin] RBAC: Authorizing `identity:create_grant(project_id=5754c772827e4e8aa70b1ae0cdc0adc7, user_id=eb988a6dde7147cab2cf61523c6128cb, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:06.356274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfda19f-c01c-4a90-88c7-6553f12171df admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:06.359169 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-ca1203ed-aca3-440e-9c41-cbcf2d6e9165 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:06.360507 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ca1203ed-aca3-440e-9c41-cbcf2d6e9165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:06.455906 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 967/1945] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:48:06.472720 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 979/1946] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:48:06 2022] PUT /identity/v3/projects/5754c772827e4e8aa70b1ae0cdc0adc7/users/eb988a6dde7147cab2cf61523c6128cb/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:06.478203 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1203ed-aca3-440e-9c41-cbcf2d6e9165 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:06.478469 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfda19f-c01c-4a90-88c7-6553f12171df admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:06.480484 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-fbfda19f-c01c-4a90-88c7-6553f12171df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:06.494941 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1203ed-aca3-440e-9c41-cbcf2d6e9165 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:06.556790 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfda19f-c01c-4a90-88c7-6553f12171df admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:06.561319 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327cd08-83fc-40e5-bbc3-0f3d3f482fb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:06.562080 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327cd08-83fc-40e5-bbc3-0f3d3f482fb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:06.562429 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327cd08-83fc-40e5-bbc3-0f3d3f482fb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:06.562990 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327cd08-83fc-40e5-bbc3-0f3d3f482fb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:06.624244 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219f12e-6335-49a1-8b07-612caa8a3fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:06.625215 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219f12e-6335-49a1-8b07-612caa8a3fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:06.626361 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219f12e-6335-49a1-8b07-612caa8a3fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:06.626839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219f12e-6335-49a1-8b07-612caa8a3fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:06.628411 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7219f12e-6335-49a1-8b07-612caa8a3fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:06.630590 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7219f12e-6335-49a1-8b07-612caa8a3fd8 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:06.649748 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 968/1947] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:06.655210 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219f12e-6335-49a1-8b07-612caa8a3fd8 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:06.660304 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327cd08-83fc-40e5-bbc3-0f3d3f482fb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:06.661849 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327cd08-83fc-40e5-bbc3-0f3d3f482fb6 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:06.668057 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219f12e-6335-49a1-8b07-612caa8a3fd8 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:06.673993 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382e6c5-68aa-440f-b71c-a28c16e68027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:06.675037 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382e6c5-68aa-440f-b71c-a28c16e68027 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:06.675525 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382e6c5-68aa-440f-b71c-a28c16e68027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:06.676219 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382e6c5-68aa-440f-b71c-a28c16e68027 admin admin] PATH_INFO: `/v3/projects/5754c772827e4e8aa70b1ae0cdc0adc7/users/eb988a6dde7147cab2cf61523c6128cb/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:06.679113 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382e6c5-68aa-440f-b71c-a28c16e68027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5754c772827e4e8aa70b1ae0cdc0adc7, user_id=eb988a6dde7147cab2cf61523c6128cb, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:06.683367 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 980/1948] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:48:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:48:06.683604 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382e6c5-68aa-440f-b71c-a28c16e68027 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:06.711371 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 969/1949] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:48:06 2022] PUT /identity/v3/projects/5754c772827e4e8aa70b1ae0cdc0adc7/users/eb988a6dde7147cab2cf61523c6128cb/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:48:06.713094 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b357cc-0142-41a5-8eef-09a19eb02cbf None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:06.713697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b357cc-0142-41a5-8eef-09a19eb02cbf None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:06.721360 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b357cc-0142-41a5-8eef-09a19eb02cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:06.769414 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-11b357cc-0142-41a5-8eef-09a19eb02cbf None None] MFA Rules not processed for user `eb988a6dde7147cab2cf61523c6128cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:06.770711 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-11b357cc-0142-41a5-8eef-09a19eb02cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:06.882524 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 981/1950] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:06 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:06.902032 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382e6c5-68aa-440f-b71c-a28c16e68027 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:06.905483 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6382e6c5-68aa-440f-b71c-a28c16e68027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:07.048847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382e6c5-68aa-440f-b71c-a28c16e68027 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:07.060800 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c69c736-5872-4068-afed-c7404389be23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:07.061437 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69c736-5872-4068-afed-c7404389be23 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:07.061736 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69c736-5872-4068-afed-c7404389be23 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:07.062001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69c736-5872-4068-afed-c7404389be23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:07.063825 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4c69c736-5872-4068-afed-c7404389be23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:07.142486 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c69c736-5872-4068-afed-c7404389be23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:07.144323 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c69c736-5872-4068-afed-c7404389be23 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:07.169895 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 970/1951] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:48:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:48:07.431049 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b357cc-0142-41a5-8eef-09a19eb02cbf None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:07.432495 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-11b357cc-0142-41a5-8eef-09a19eb02cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:07.589560 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b357cc-0142-41a5-8eef-09a19eb02cbf None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:07.600517 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafdb88-0a92-4310-869b-3a1818f44d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:07.600853 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafdb88-0a92-4310-869b-3a1818f44d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:07.601135 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafdb88-0a92-4310-869b-3a1818f44d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:07.601413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafdb88-0a92-4310-869b-3a1818f44d88 admin admin] PATH_INFO: `/v3/projects/b850d260d1fa45b58900415dcc97f47e` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:07.603535 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eafdb88-0a92-4310-869b-3a1818f44d88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b850d260d1fa45b58900415dcc97f47e)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:07.605604 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eafdb88-0a92-4310-869b-3a1818f44d88 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:07.813499 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0eafdb88-0a92-4310-869b-3a1818f44d88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b850d260d1fa45b58900415dcc97f47e', 'request_id': 'req-0eafdb88-0a92-4310-869b-3a1818f44d88'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:07.849352 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0eafdb88-0a92-4310-869b-3a1818f44d88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b850d260d1fa45b58900415dcc97f47e', 'request_id': 'req-0eafdb88-0a92-4310-869b-3a1818f44d88'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:07.933739 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0eafdb88-0a92-4310-869b-3a1818f44d88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b850d260d1fa45b58900415dcc97f47e', 'request_id': 'req-0eafdb88-0a92-4310-869b-3a1818f44d88'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:07.975905 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0eafdb88-0a92-4310-869b-3a1818f44d88 admin admin] The token cache is being invalidate because project b850d260d1fa45b58900415dcc97f47e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:48:07.977895 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0eafdb88-0a92-4310-869b-3a1818f44d88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:07.979739 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0eafdb88-0a92-4310-869b-3a1818f44d88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:07.987856 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 982/1952] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:48:07 2022] DELETE /identity/v3/projects/b850d260d1fa45b58900415dcc97f47e => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:07.991457 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c69c736-5872-4068-afed-c7404389be23 service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:08.013916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c69c736-5872-4068-afed-c7404389be23 service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:08.022911 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:08.095466 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:08.138071 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf3558-f73d-40d7-a7e5-6f8d9615d75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:08.138783 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf3558-f73d-40d7-a7e5-6f8d9615d75b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:08.139671 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf3558-f73d-40d7-a7e5-6f8d9615d75b admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:08.140132 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf3558-f73d-40d7-a7e5-6f8d9615d75b admin admin] PATH_INFO: `/v3/users/67024073aee74735a844be9c1e0fd112` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:08.141634 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf3558-f73d-40d7-a7e5-6f8d9615d75b admin admin] RBAC: Authorizing `identity:delete_user(user_id=67024073aee74735a844be9c1e0fd112)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:08.143821 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf3558-f73d-40d7-a7e5-6f8d9615d75b admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:08.454821 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0fcf3558-f73d-40d7-a7e5-6f8d9615d75b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67024073aee74735a844be9c1e0fd112'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:08.456048 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0fcf3558-f73d-40d7-a7e5-6f8d9615d75b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67024073aee74735a844be9c1e0fd112'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:08.478869 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0fcf3558-f73d-40d7-a7e5-6f8d9615d75b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67024073aee74735a844be9c1e0fd112'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:08.484561 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0fcf3558-f73d-40d7-a7e5-6f8d9615d75b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67024073aee74735a844be9c1e0fd112'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:08.592566 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0fcf3558-f73d-40d7-a7e5-6f8d9615d75b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67024073aee74735a844be9c1e0fd112'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:08.646858 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 971/1953] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:48:07 2022] DELETE /identity/v3/users/67024073aee74735a844be9c1e0fd112 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:08.752929 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafdb88-0a92-4310-869b-3a1818f44d88 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:08.755007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0eafdb88-0a92-4310-869b-3a1818f44d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:08.775887 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafdb88-0a92-4310-869b-3a1818f44d88 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:08.863707 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867aa27-3e42-403d-b476-874a4871877e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:08.864433 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867aa27-3e42-403d-b476-874a4871877e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:08.864713 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867aa27-3e42-403d-b476-874a4871877e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:08.864989 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867aa27-3e42-403d-b476-874a4871877e admin admin] PATH_INFO: `/v3/users/4dd8ebaf766e47bb9eaa7538e0ee1733` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:08.866259 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1867aa27-3e42-403d-b476-874a4871877e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dd8ebaf766e47bb9eaa7538e0ee1733)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:08.868396 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1867aa27-3e42-403d-b476-874a4871877e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:09.120833 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1867aa27-3e42-403d-b476-874a4871877e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dd8ebaf766e47bb9eaa7538e0ee1733'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:09.238098 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1867aa27-3e42-403d-b476-874a4871877e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dd8ebaf766e47bb9eaa7538e0ee1733'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:09.239403 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1867aa27-3e42-403d-b476-874a4871877e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dd8ebaf766e47bb9eaa7538e0ee1733'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:09.240223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1867aa27-3e42-403d-b476-874a4871877e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dd8ebaf766e47bb9eaa7538e0ee1733'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:09.251129 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1867aa27-3e42-403d-b476-874a4871877e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dd8ebaf766e47bb9eaa7538e0ee1733'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:09.287566 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf3558-f73d-40d7-a7e5-6f8d9615d75b admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:09.290036 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-0fcf3558-f73d-40d7-a7e5-6f8d9615d75b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:09.306270 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 983/1954] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:48:08 2022] DELETE /identity/v3/users/4dd8ebaf766e47bb9eaa7538e0ee1733 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:09.315605 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b7b6b-0b65-4196-b653-37305fe13186 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:09.316348 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b7b6b-0b65-4196-b653-37305fe13186 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:09.318004 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b7b6b-0b65-4196-b653-37305fe13186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:09.361257 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-a53b7b6b-0b65-4196-b653-37305fe13186 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:09.365267 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a53b7b6b-0b65-4196-b653-37305fe13186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:09.371398 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf3558-f73d-40d7-a7e5-6f8d9615d75b admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:09.464843 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:09.469841 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 984/1955] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:48:09.472223 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155c780-2961-442e-96f7-003ebbb0a103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:09.473336 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155c780-2961-442e-96f7-003ebbb0a103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:09.473839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155c780-2961-442e-96f7-003ebbb0a103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:09.474327 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155c780-2961-442e-96f7-003ebbb0a103 admin admin] PATH_INFO: `/v3/projects/9aefb0df088b41638bc79e6bf577c51d` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:09.476101 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155c780-2961-442e-96f7-003ebbb0a103 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aefb0df088b41638bc79e6bf577c51d)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:09.478624 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155c780-2961-442e-96f7-003ebbb0a103 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:09.488836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b7b6b-0b65-4196-b653-37305fe13186 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:09.490893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a53b7b6b-0b65-4196-b653-37305fe13186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:09.631536 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b7b6b-0b65-4196-b653-37305fe13186 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:09.651888 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8155c780-2961-442e-96f7-003ebbb0a103 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aefb0df088b41638bc79e6bf577c51d', 'request_id': 'req-8155c780-2961-442e-96f7-003ebbb0a103'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:09.667629 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8155c780-2961-442e-96f7-003ebbb0a103 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aefb0df088b41638bc79e6bf577c51d', 'request_id': 'req-8155c780-2961-442e-96f7-003ebbb0a103'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:09.756174 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d02dee-b297-4ae4-9f95-b5106352dc91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:09.757206 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d02dee-b297-4ae4-9f95-b5106352dc91 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:09.757647 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d02dee-b297-4ae4-9f95-b5106352dc91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:09.758013 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d02dee-b297-4ae4-9f95-b5106352dc91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:09.817113 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8155c780-2961-442e-96f7-003ebbb0a103 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aefb0df088b41638bc79e6bf577c51d', 'request_id': 'req-8155c780-2961-442e-96f7-003ebbb0a103'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:09.834943 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8155c780-2961-442e-96f7-003ebbb0a103 admin admin] The token cache is being invalidate because project 9aefb0df088b41638bc79e6bf577c51d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:48:09.835242 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8155c780-2961-442e-96f7-003ebbb0a103 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:09.836073 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8155c780-2961-442e-96f7-003ebbb0a103 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:09.840668 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 972/1956] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:48:09 2022] DELETE /identity/v3/projects/9aefb0df088b41638bc79e6bf577c51d => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:09.846845 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db9e7d-afa4-47f4-bf2d-08843b19ddac None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:09.847531 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db9e7d-afa4-47f4-bf2d-08843b19ddac None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:09.848432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db9e7d-afa4-47f4-bf2d-08843b19ddac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:09.862025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d02dee-b297-4ae4-9f95-b5106352dc91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:09.863964 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d02dee-b297-4ae4-9f95-b5106352dc91 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:09.871772 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-83db9e7d-afa4-47f4-bf2d-08843b19ddac None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:09.874068 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-83db9e7d-afa4-47f4-bf2d-08843b19ddac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:09.884372 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 985/1957] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:48:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:48:09.892289 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 973/1958] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:48:09.894398 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0c362-3fa4-46a7-8dfc-751479cb8a52 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:09.895174 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0c362-3fa4-46a7-8dfc-751479cb8a52 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:09.895727 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0c362-3fa4-46a7-8dfc-751479cb8a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:09.923169 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-83f0c362-3fa4-46a7-8dfc-751479cb8a52 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:09.925404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-83f0c362-3fa4-46a7-8dfc-751479cb8a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:09.943844 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 986/1959] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:48:09.946129 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db9e7d-afa4-47f4-bf2d-08843b19ddac None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:09.959676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db9e7d-afa4-47f4-bf2d-08843b19ddac None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:09.965992 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedbeac-e538-4d3b-9bfa-7dd6f8d8f903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:09.965992 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedbeac-e538-4d3b-9bfa-7dd6f8d8f903 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:09.966812 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedbeac-e538-4d3b-9bfa-7dd6f8d8f903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:09.966812 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedbeac-e538-4d3b-9bfa-7dd6f8d8f903 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:09.968425 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aedbeac-e538-4d3b-9bfa-7dd6f8d8f903 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:48:09.968856 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aedbeac-e538-4d3b-9bfa-7dd6f8d8f903 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:09.971477 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aedbeac-e538-4d3b-9bfa-7dd6f8d8f903 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:09.990655 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 974/1960] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:48:09.991661 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0c362-3fa4-46a7-8dfc-751479cb8a52 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:10.003336 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0c362-3fa4-46a7-8dfc-751479cb8a52 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:10.008372 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c8455-d266-44d5-bf3d-9cc22c9713c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:10.009210 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c8455-d266-44d5-bf3d-9cc22c9713c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:10.009899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c8455-d266-44d5-bf3d-9cc22c9713c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:10.010428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c8455-d266-44d5-bf3d-9cc22c9713c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:10.011109 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c8455-d266-44d5-bf3d-9cc22c9713c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:10.013097 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c8455-d266-44d5-bf3d-9cc22c9713c6 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:10.133218 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:10.148007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 987/1961] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:48:09 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:48:10.151903 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedbeac-e538-4d3b-9bfa-7dd6f8d8f903 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:10.162610 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedbeac-e538-4d3b-9bfa-7dd6f8d8f903 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:10.272027 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ba366-b2ba-4ed3-be8f-76cefa6a51e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:10.272691 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ba366-b2ba-4ed3-be8f-76cefa6a51e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:10.276093 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ba366-b2ba-4ed3-be8f-76cefa6a51e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:10.276093 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ba366-b2ba-4ed3-be8f-76cefa6a51e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:10.276603 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ba366-b2ba-4ed3-be8f-76cefa6a51e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:10.280802 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ba366-b2ba-4ed3-be8f-76cefa6a51e7 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:10.447823 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 975/1962] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:48:10 2022] POST /identity/v3/users => generated 287 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:48:10.454598 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c8455-d266-44d5-bf3d-9cc22c9713c6 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:10.467565 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c8455-d266-44d5-bf3d-9cc22c9713c6 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:10.479574 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d303d-7026-4814-8880-5a5189b672f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:10.479574 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d303d-7026-4814-8880-5a5189b672f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:10.479574 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d303d-7026-4814-8880-5a5189b672f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:10.479574 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d303d-7026-4814-8880-5a5189b672f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:10.479920 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d303d-7026-4814-8880-5a5189b672f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:10.479920 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d303d-7026-4814-8880-5a5189b672f0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:10.490258 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 988/1963] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:10.494396 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ba366-b2ba-4ed3-be8f-76cefa6a51e7 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:10.507767 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ba366-b2ba-4ed3-be8f-76cefa6a51e7 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:10.518070 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda55228-b83c-4f9b-b09c-c46b0a76f103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:10.518759 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda55228-b83c-4f9b-b09c-c46b0a76f103 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:10.519005 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda55228-b83c-4f9b-b09c-c46b0a76f103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:10.520037 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda55228-b83c-4f9b-b09c-c46b0a76f103 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:10.520850 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda55228-b83c-4f9b-b09c-c46b0a76f103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:10.522627 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda55228-b83c-4f9b-b09c-c46b0a76f103 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:10.541399 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 976/1964] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:10.543513 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d303d-7026-4814-8880-5a5189b672f0 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:10.558932 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d303d-7026-4814-8880-5a5189b672f0 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:10.568794 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f3102-b997-4c49-bc34-058ef76840df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:10.568794 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f3102-b997-4c49-bc34-058ef76840df admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:10.568794 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f3102-b997-4c49-bc34-058ef76840df admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:10.568794 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f3102-b997-4c49-bc34-058ef76840df admin admin] PATH_INFO: `/v3/projects/2f5bd35e7b2449bc8f24daea0ba240d5/users/c80fcafb1c34439b93873e1291a4eaeb/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:10.581033 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda55228-b83c-4f9b-b09c-c46b0a76f103 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:10.584830 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-eda55228-b83c-4f9b-b09c-c46b0a76f103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:10.590799 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f3102-b997-4c49-bc34-058ef76840df admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f5bd35e7b2449bc8f24daea0ba240d5, user_id=c80fcafb1c34439b93873e1291a4eaeb, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:10.594351 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f3102-b997-4c49-bc34-058ef76840df admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:10.617162 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda55228-b83c-4f9b-b09c-c46b0a76f103 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:10.627490 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da339a70-5a64-4129-913d-65245e3fc9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:10.628993 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da339a70-5a64-4129-913d-65245e3fc9db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:10.629656 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da339a70-5a64-4129-913d-65245e3fc9db admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:10.630183 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da339a70-5a64-4129-913d-65245e3fc9db admin admin] PATH_INFO: `/v3/projects/be2b329ba81047ffacdbc40f9dc879ab` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:10.631785 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da339a70-5a64-4129-913d-65245e3fc9db admin admin] RBAC: Authorizing `identity:delete_project(project_id=be2b329ba81047ffacdbc40f9dc879ab)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:10.634591 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da339a70-5a64-4129-913d-65245e3fc9db admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:10.683305 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 989/1965] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:48:10 2022] PUT /identity/v3/projects/2f5bd35e7b2449bc8f24daea0ba240d5/users/c80fcafb1c34439b93873e1291a4eaeb/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:10.690386 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4deca-ab2c-4852-bfa0-5fc4ea8e6daa None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:10.690705 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4deca-ab2c-4852-bfa0-5fc4ea8e6daa None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:10.690951 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4deca-ab2c-4852-bfa0-5fc4ea8e6daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:10.714751 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-76e4deca-ab2c-4852-bfa0-5fc4ea8e6daa None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:10.716977 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-76e4deca-ab2c-4852-bfa0-5fc4ea8e6daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:10.800361 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-da339a70-5a64-4129-913d-65245e3fc9db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be2b329ba81047ffacdbc40f9dc879ab', 'request_id': 'req-da339a70-5a64-4129-913d-65245e3fc9db'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:10.813320 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-da339a70-5a64-4129-913d-65245e3fc9db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be2b329ba81047ffacdbc40f9dc879ab', 'request_id': 'req-da339a70-5a64-4129-913d-65245e3fc9db'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:10.867033 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 990/1966] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:48:10.868652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4deca-ab2c-4852-bfa0-5fc4ea8e6daa None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:10.873084 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-76e4deca-ab2c-4852-bfa0-5fc4ea8e6daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:10.941287 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-da339a70-5a64-4129-913d-65245e3fc9db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be2b329ba81047ffacdbc40f9dc879ab', 'request_id': 'req-da339a70-5a64-4129-913d-65245e3fc9db'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:10.962397 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4deca-ab2c-4852-bfa0-5fc4ea8e6daa None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:10.963044 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-da339a70-5a64-4129-913d-65245e3fc9db admin admin] The token cache is being invalidate because project be2b329ba81047ffacdbc40f9dc879ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:48:10.963525 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-da339a70-5a64-4129-913d-65245e3fc9db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:10.965267 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-da339a70-5a64-4129-913d-65245e3fc9db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:10.968651 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 977/1967] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:48:10 2022] DELETE /identity/v3/projects/be2b329ba81047ffacdbc40f9dc879ab => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:10.976645 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da339a70-5a64-4129-913d-65245e3fc9db admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:10.979225 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-da339a70-5a64-4129-913d-65245e3fc9db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:11.082072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da339a70-5a64-4129-913d-65245e3fc9db admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:11.092146 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634a8f8-a335-4d2f-b559-cea62f1a1564 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:11.092841 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634a8f8-a335-4d2f-b559-cea62f1a1564 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:11.094599 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634a8f8-a335-4d2f-b559-cea62f1a1564 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:11.094795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634a8f8-a335-4d2f-b559-cea62f1a1564 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:11.101289 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd411f-c3f0-4c71-86a4-f68f70525c73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:11.101289 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd411f-c3f0-4c71-86a4-f68f70525c73 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:11.101675 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-0634a8f8-a335-4d2f-b559-cea62f1a1564 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:11.101813 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd411f-c3f0-4c71-86a4-f68f70525c73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:11.101813 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd411f-c3f0-4c71-86a4-f68f70525c73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:11.108081 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e8bd411f-c3f0-4c71-86a4-f68f70525c73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:11.252971 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd411f-c3f0-4c71-86a4-f68f70525c73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:11.254480 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd411f-c3f0-4c71-86a4-f68f70525c73 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:11.269052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0634a8f8-a335-4d2f-b559-cea62f1a1564 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:11.270716 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0634a8f8-a335-4d2f-b559-cea62f1a1564 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:11.292457 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 978/1968] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:48:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:48:11.293541 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 991/1969] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:48:10 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:48:11.294037 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99696b61-d600-4ede-acb2-feb10c4a056d None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:11.294345 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99696b61-d600-4ede-acb2-feb10c4a056d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:11.299092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99696b61-d600-4ede-acb2-feb10c4a056d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:11.348853 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-99696b61-d600-4ede-acb2-feb10c4a056d None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:11.350264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-99696b61-d600-4ede-acb2-feb10c4a056d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:11.375609 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 979/1970] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:11.390962 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adc4ef-df2f-4698-84a3-b1478e9a7dfa None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:11.391627 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adc4ef-df2f-4698-84a3-b1478e9a7dfa None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:11.391976 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adc4ef-df2f-4698-84a3-b1478e9a7dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:11.428779 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-58adc4ef-df2f-4698-84a3-b1478e9a7dfa None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:11.439605 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-58adc4ef-df2f-4698-84a3-b1478e9a7dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:11.440606 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 992/1971] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:11.448613 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99696b61-d600-4ede-acb2-feb10c4a056d None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:11.462007 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99696b61-d600-4ede-acb2-feb10c4a056d None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:11.469933 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98a59b-2631-4e41-87f8-e5061c5ca520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:11.471201 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98a59b-2631-4e41-87f8-e5061c5ca520 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:11.471925 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98a59b-2631-4e41-87f8-e5061c5ca520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:11.472387 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98a59b-2631-4e41-87f8-e5061c5ca520 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:11.473568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98a59b-2631-4e41-87f8-e5061c5ca520 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:48:11.474084 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98a59b-2631-4e41-87f8-e5061c5ca520 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:11.476492 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98a59b-2631-4e41-87f8-e5061c5ca520 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:11.501722 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:11.511077 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 980/1972] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:48:11.512363 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adc4ef-df2f-4698-84a3-b1478e9a7dfa None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:11.526696 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adc4ef-df2f-4698-84a3-b1478e9a7dfa None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:11.534600 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ec820-2836-4f00-a267-71f51371dc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:11.536086 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ec820-2836-4f00-a267-71f51371dc1b admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:11.536966 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ec820-2836-4f00-a267-71f51371dc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:11.537256 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ec820-2836-4f00-a267-71f51371dc1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:11.538590 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ec820-2836-4f00-a267-71f51371dc1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:11.540986 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ec820-2836-4f00-a267-71f51371dc1b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:11.702843 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 993/1973] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:48:11 2022] POST /identity/v3/projects => generated 385 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:48:11.709078 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98a59b-2631-4e41-87f8-e5061c5ca520 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:11.720284 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98a59b-2631-4e41-87f8-e5061c5ca520 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:11.835422 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:11.884302 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fcd9bd-a4a7-479c-818e-25c2518d7fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:11.885404 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcd9bd-a4a7-479c-818e-25c2518d7fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:11.886141 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcd9bd-a4a7-479c-818e-25c2518d7fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:11.887919 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcd9bd-a4a7-479c-818e-25c2518d7fc3 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:11.890590 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fcd9bd-a4a7-479c-818e-25c2518d7fc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:11.893836 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fcd9bd-a4a7-479c-818e-25c2518d7fc3 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:12.028009 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 981/1974] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:48:11 2022] POST /identity/v3/users => generated 293 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:48:12.033380 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ec820-2836-4f00-a267-71f51371dc1b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:12.073523 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ec820-2836-4f00-a267-71f51371dc1b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:12.114145 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d8b47-85dd-4a03-82d2-1d7c5fb4c26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:12.115397 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d8b47-85dd-4a03-82d2-1d7c5fb4c26b admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:12.119315 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d8b47-85dd-4a03-82d2-1d7c5fb4c26b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:12.131090 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d8b47-85dd-4a03-82d2-1d7c5fb4c26b admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:12.140245 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d8b47-85dd-4a03-82d2-1d7c5fb4c26b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:12.157273 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d8b47-85dd-4a03-82d2-1d7c5fb4c26b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:12.218888 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 994/1975] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:12.233801 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fcd9bd-a4a7-479c-818e-25c2518d7fc3 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:12.254954 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fcd9bd-a4a7-479c-818e-25c2518d7fc3 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:12.267095 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08102e-9988-44cf-baa9-7eac9dcad45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:12.267850 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08102e-9988-44cf-baa9-7eac9dcad45f admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:12.268138 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08102e-9988-44cf-baa9-7eac9dcad45f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:12.268413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08102e-9988-44cf-baa9-7eac9dcad45f admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:12.269188 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08102e-9988-44cf-baa9-7eac9dcad45f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:12.271171 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08102e-9988-44cf-baa9-7eac9dcad45f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:12.292887 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 982/1976] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:12.297488 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d8b47-85dd-4a03-82d2-1d7c5fb4c26b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:12.311437 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d8b47-85dd-4a03-82d2-1d7c5fb4c26b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:12.317376 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f99d3-1de9-4345-9c32-ccbcef9fcb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:12.317756 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f99d3-1de9-4345-9c32-ccbcef9fcb6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:12.317975 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f99d3-1de9-4345-9c32-ccbcef9fcb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:12.318469 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f99d3-1de9-4345-9c32-ccbcef9fcb6f admin admin] PATH_INFO: `/v3/projects/bf7748550aa74a7bb41ea179ed29143b/users/f32daa5f87d245fcb907e14bfea8b191/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:12.337791 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f99d3-1de9-4345-9c32-ccbcef9fcb6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf7748550aa74a7bb41ea179ed29143b, user_id=f32daa5f87d245fcb907e14bfea8b191, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:12.340779 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f99d3-1de9-4345-9c32-ccbcef9fcb6f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:12.589957 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 995/1977] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:48:12 2022] PUT /identity/v3/projects/bf7748550aa74a7bb41ea179ed29143b/users/f32daa5f87d245fcb907e14bfea8b191/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:12.605143 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b5ed5-5f53-4c2e-a253-9e911094d630 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:12.605143 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b5ed5-5f53-4c2e-a253-9e911094d630 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:12.605143 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b5ed5-5f53-4c2e-a253-9e911094d630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:12.683626 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-785b5ed5-5f53-4c2e-a253-9e911094d630 None None] MFA Rules not processed for user `f32daa5f87d245fcb907e14bfea8b191`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:12.693524 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-785b5ed5-5f53-4c2e-a253-9e911094d630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:12.860127 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 983/1978] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:12.864635 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f99d3-1de9-4345-9c32-ccbcef9fcb6f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:13.012099 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f99d3-1de9-4345-9c32-ccbcef9fcb6f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:13.023409 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6876ac-9631-40c3-9045-e989fb9d8691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:13.024925 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6876ac-9631-40c3-9045-e989fb9d8691 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:13.025688 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6876ac-9631-40c3-9045-e989fb9d8691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:13.026323 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6876ac-9631-40c3-9045-e989fb9d8691 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:13.027831 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6876ac-9631-40c3-9045-e989fb9d8691 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:13.033212 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6876ac-9631-40c3-9045-e989fb9d8691 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:13.236485 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:13.265608 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 996/1979] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:48:12 2022] POST /identity/v3/projects => generated 385 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:48:13.269818 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b5ed5-5f53-4c2e-a253-9e911094d630 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:13.286225 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b5ed5-5f53-4c2e-a253-9e911094d630 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:13.391621 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e103c44-b828-4d9b-8cf1-9097af92f766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:13.391621 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e103c44-b828-4d9b-8cf1-9097af92f766 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:13.391621 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e103c44-b828-4d9b-8cf1-9097af92f766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:13.391621 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e103c44-b828-4d9b-8cf1-9097af92f766 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:13.392291 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e103c44-b828-4d9b-8cf1-9097af92f766 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:13.392291 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e103c44-b828-4d9b-8cf1-9097af92f766 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:13.502874 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 984/1980] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:48:13 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:48:13.508414 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6876ac-9631-40c3-9045-e989fb9d8691 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:13.531411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6876ac-9631-40c3-9045-e989fb9d8691 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:13.541355 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8eda3a-5d26-4c1b-877b-52639baa020d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:13.542543 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8eda3a-5d26-4c1b-877b-52639baa020d admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:13.543102 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8eda3a-5d26-4c1b-877b-52639baa020d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:13.543702 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8eda3a-5d26-4c1b-877b-52639baa020d admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:13.545753 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8eda3a-5d26-4c1b-877b-52639baa020d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:13.549518 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8eda3a-5d26-4c1b-877b-52639baa020d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:13.578127 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 997/1981] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:13.584392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e103c44-b828-4d9b-8cf1-9097af92f766 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:13.605991 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e103c44-b828-4d9b-8cf1-9097af92f766 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:13.615685 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93690f-65c1-4693-959a-edcdb4e03c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:13.616681 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93690f-65c1-4693-959a-edcdb4e03c38 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:13.617184 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93690f-65c1-4693-959a-edcdb4e03c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:13.617714 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93690f-65c1-4693-959a-edcdb4e03c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:13.619169 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93690f-65c1-4693-959a-edcdb4e03c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:13.622668 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93690f-65c1-4693-959a-edcdb4e03c38 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:13.651337 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 985/1982] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:13.656023 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8eda3a-5d26-4c1b-877b-52639baa020d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:13.674460 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8eda3a-5d26-4c1b-877b-52639baa020d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:13.682292 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c58228-be0a-40d7-b16f-7d1f53ef6711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:13.683070 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c58228-be0a-40d7-b16f-7d1f53ef6711 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:13.683522 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c58228-be0a-40d7-b16f-7d1f53ef6711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:13.683933 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c58228-be0a-40d7-b16f-7d1f53ef6711 admin admin] PATH_INFO: `/v3/projects/3970a72688224cb5abc65c25955c8553/users/5c0dfe3ac54b4c659b12f5adb0af932a/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:13.718687 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c58228-be0a-40d7-b16f-7d1f53ef6711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3970a72688224cb5abc65c25955c8553, user_id=5c0dfe3ac54b4c659b12f5adb0af932a, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:13.720497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c58228-be0a-40d7-b16f-7d1f53ef6711 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:13.917139 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 998/1983] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:48:13 2022] PUT /identity/v3/projects/3970a72688224cb5abc65c25955c8553/users/5c0dfe3ac54b4c659b12f5adb0af932a/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:48:13.929926 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0420a5-f4a8-4abe-8167-66665f9fe6a7 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:13.930510 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0420a5-f4a8-4abe-8167-66665f9fe6a7 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:13.931050 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0420a5-f4a8-4abe-8167-66665f9fe6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:13.984971 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-4b0420a5-f4a8-4abe-8167-66665f9fe6a7 None None] MFA Rules not processed for user `5c0dfe3ac54b4c659b12f5adb0af932a`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:13.987832 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4b0420a5-f4a8-4abe-8167-66665f9fe6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:14.104097 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 986/1984] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:14.105232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c58228-be0a-40d7-b16f-7d1f53ef6711 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:14.199558 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c58228-be0a-40d7-b16f-7d1f53ef6711 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:14.202099 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f66c1b-5508-4b41-aafd-4c31f01fb0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:14.202789 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f66c1b-5508-4b41-aafd-4c31f01fb0ab admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:14.203099 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f66c1b-5508-4b41-aafd-4c31f01fb0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:14.203425 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f66c1b-5508-4b41-aafd-4c31f01fb0ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:14.204257 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f66c1b-5508-4b41-aafd-4c31f01fb0ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:14.208203 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f66c1b-5508-4b41-aafd-4c31f01fb0ab admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:14.238803 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d74132-2be0-4506-b908-9f49c8d771c9 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:14.240108 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d74132-2be0-4506-b908-9f49c8d771c9 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:14.241175 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d74132-2be0-4506-b908-9f49c8d771c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:14.298030 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-b5d74132-2be0-4506-b908-9f49c8d771c9 None None] MFA Rules not processed for user `c80fcafb1c34439b93873e1291a4eaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:14.299512 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b5d74132-2be0-4506-b908-9f49c8d771c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:14.364943 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 999/1985] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:48:14 2022] POST /identity/v3/projects => generated 383 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:48:14.374403 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f66c1b-5508-4b41-aafd-4c31f01fb0ab admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:14.403869 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 987/1986] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:14.412813 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d74132-2be0-4506-b908-9f49c8d771c9 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:14.414489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b5d74132-2be0-4506-b908-9f49c8d771c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:14.468601 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f66c1b-5508-4b41-aafd-4c31f01fb0ab admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:14.473540 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e83771-846d-47b5-9441-dc6745c2b366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:14.474167 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e83771-846d-47b5-9441-dc6745c2b366 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:14.474526 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e83771-846d-47b5-9441-dc6745c2b366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:14.474788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e83771-846d-47b5-9441-dc6745c2b366 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:14.477385 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e83771-846d-47b5-9441-dc6745c2b366 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:14.477687 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e83771-846d-47b5-9441-dc6745c2b366 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:14.484909 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:14.525011 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d74132-2be0-4506-b908-9f49c8d771c9 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:14.590756 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901b738-5fb9-4b9e-8f57-01f355e4cddf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:14.596437 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901b738-5fb9-4b9e-8f57-01f355e4cddf service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:14.596437 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901b738-5fb9-4b9e-8f57-01f355e4cddf service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:14.596437 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901b738-5fb9-4b9e-8f57-01f355e4cddf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:14.597047 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1000/1987] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:48:14 2022] POST /identity/v3/users => generated 298 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:48:14.599196 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e83771-846d-47b5-9441-dc6745c2b366 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:14.611056 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e83771-846d-47b5-9441-dc6745c2b366 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:14.616809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615da5c6-6027-4792-b5cc-71fa3a5c34fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:14.617441 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615da5c6-6027-4792-b5cc-71fa3a5c34fd admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:14.617727 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615da5c6-6027-4792-b5cc-71fa3a5c34fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:14.618006 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615da5c6-6027-4792-b5cc-71fa3a5c34fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:14.618680 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615da5c6-6027-4792-b5cc-71fa3a5c34fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:14.620461 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615da5c6-6027-4792-b5cc-71fa3a5c34fd admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:14.644392 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1001/1988] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:48:14.651078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615da5c6-6027-4792-b5cc-71fa3a5c34fd admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:14.669882 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615da5c6-6027-4792-b5cc-71fa3a5c34fd admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:14.686540 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2d98d-6b3f-4fe8-a80b-1a2eb485ffc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:14.687671 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901b738-5fb9-4b9e-8f57-01f355e4cddf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:14.691869 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2d98d-6b3f-4fe8-a80b-1a2eb485ffc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:14.691869 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2d98d-6b3f-4fe8-a80b-1a2eb485ffc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:14.691869 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2d98d-6b3f-4fe8-a80b-1a2eb485ffc3 admin admin] PATH_INFO: `/v3/projects/cc3a873c97914f2cb70dc927183e0334/users/daef8d23cbd14b24a85f282976bcace9/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:14.692125 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901b738-5fb9-4b9e-8f57-01f355e4cddf service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:14.716035 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 988/1989] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:48:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:48:14.716743 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2d98d-6b3f-4fe8-a80b-1a2eb485ffc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc3a873c97914f2cb70dc927183e0334, user_id=daef8d23cbd14b24a85f282976bcace9, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:14.723019 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2d98d-6b3f-4fe8-a80b-1a2eb485ffc3 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:14.809690 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1002/1990] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:48:14 2022] PUT /identity/v3/projects/cc3a873c97914f2cb70dc927183e0334/users/daef8d23cbd14b24a85f282976bcace9/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:14.815180 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901b738-5fb9-4b9e-8f57-01f355e4cddf service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:14.823683 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:14.828773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901b738-5fb9-4b9e-8f57-01f355e4cddf service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:14.896303 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fc238-529c-4a66-8856-bf1f3d2dcc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:14.897351 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fc238-529c-4a66-8856-bf1f3d2dcc72 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:14.897736 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fc238-529c-4a66-8856-bf1f3d2dcc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:14.898236 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fc238-529c-4a66-8856-bf1f3d2dcc72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:14.899410 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2fc238-529c-4a66-8856-bf1f3d2dcc72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:14.902609 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2fc238-529c-4a66-8856-bf1f3d2dcc72 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:14.925322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 989/1991] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:14.929747 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2d98d-6b3f-4fe8-a80b-1a2eb485ffc3 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:14.952647 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2d98d-6b3f-4fe8-a80b-1a2eb485ffc3 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:14.962603 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e61eb-132b-453f-8130-9948074dbd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:14.965099 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e61eb-132b-453f-8130-9948074dbd0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:14.965099 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e61eb-132b-453f-8130-9948074dbd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:14.965099 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e61eb-132b-453f-8130-9948074dbd0e admin admin] PATH_INFO: `/v3/projects/cc3a873c97914f2cb70dc927183e0334/users/daef8d23cbd14b24a85f282976bcace9/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:14.982505 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e61eb-132b-453f-8130-9948074dbd0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc3a873c97914f2cb70dc927183e0334, user_id=daef8d23cbd14b24a85f282976bcace9, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:14.992118 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e61eb-132b-453f-8130-9948074dbd0e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:15.014736 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1003/1992] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:48:14 2022] PUT /identity/v3/projects/cc3a873c97914f2cb70dc927183e0334/users/daef8d23cbd14b24a85f282976bcace9/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:15.025413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5701e30-ad78-4bdb-9244-1deb9e4dcd78 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:15.025804 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5701e30-ad78-4bdb-9244-1deb9e4dcd78 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:15.026164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5701e30-ad78-4bdb-9244-1deb9e4dcd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:15.062635 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-d5701e30-ad78-4bdb-9244-1deb9e4dcd78 None None] MFA Rules not processed for user `daef8d23cbd14b24a85f282976bcace9`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:15.063943 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d5701e30-ad78-4bdb-9244-1deb9e4dcd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:15.196995 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 990/1993] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:15 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:15.213901 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e61eb-132b-453f-8130-9948074dbd0e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:15.215753 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-846e61eb-132b-453f-8130-9948074dbd0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:15.306142 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e61eb-132b-453f-8130-9948074dbd0e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:15.309952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259a81b-f44d-46e0-a170-01f60508c679 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:15.310654 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259a81b-f44d-46e0-a170-01f60508c679 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:15.311985 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259a81b-f44d-46e0-a170-01f60508c679 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:15.312295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259a81b-f44d-46e0-a170-01f60508c679 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:15.376082 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259a81b-f44d-46e0-a170-01f60508c679 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:15.377574 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259a81b-f44d-46e0-a170-01f60508c679 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:15.388529 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1004/1994] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:48:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:48:15.523535 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:15.935489 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:17.057670 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:17.354853 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:17.870674 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5701e30-ad78-4bdb-9244-1deb9e4dcd78 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:17.872787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d5701e30-ad78-4bdb-9244-1deb9e4dcd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:17.930648 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639ed4b-5dc6-4a3c-86bb-34c289e04893 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:17.930987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639ed4b-5dc6-4a3c-86bb-34c289e04893 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:17.931369 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639ed4b-5dc6-4a3c-86bb-34c289e04893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:17.955515 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e639ed4b-5dc6-4a3c-86bb-34c289e04893 None None] MFA Rules not processed for user `c80fcafb1c34439b93873e1291a4eaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:17.957803 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e639ed4b-5dc6-4a3c-86bb-34c289e04893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:17.974303 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5701e30-ad78-4bdb-9244-1deb9e4dcd78 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:17.983327 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd467e8-0f88-4fa2-8fa4-835479f253c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:17.984371 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd467e8-0f88-4fa2-8fa4-835479f253c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:17.986588 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd467e8-0f88-4fa2-8fa4-835479f253c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:17.986588 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd467e8-0f88-4fa2-8fa4-835479f253c5 admin admin] PATH_INFO: `/v3/users/57cdadf3d2d1443db9fafdbacbdb86a7` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:17.987605 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd467e8-0f88-4fa2-8fa4-835479f253c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57cdadf3d2d1443db9fafdbacbdb86a7)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:17.990183 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd467e8-0f88-4fa2-8fa4-835479f253c5 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:18.070481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:18.075916 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1005/1995] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:48:18.131226 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:18.240490 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-afd467e8-0f88-4fa2-8fa4-835479f253c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57cdadf3d2d1443db9fafdbacbdb86a7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:18.241768 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-afd467e8-0f88-4fa2-8fa4-835479f253c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57cdadf3d2d1443db9fafdbacbdb86a7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:18.256422 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-afd467e8-0f88-4fa2-8fa4-835479f253c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57cdadf3d2d1443db9fafdbacbdb86a7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:18.257587 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-afd467e8-0f88-4fa2-8fa4-835479f253c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57cdadf3d2d1443db9fafdbacbdb86a7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:18.332495 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-afd467e8-0f88-4fa2-8fa4-835479f253c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57cdadf3d2d1443db9fafdbacbdb86a7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:18.360966 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 991/1996] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:48:17 2022] DELETE /identity/v3/users/57cdadf3d2d1443db9fafdbacbdb86a7 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:18.366507 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d927559-6724-4d72-9629-c2a7fa3fd629 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:18.366896 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d927559-6724-4d72-9629-c2a7fa3fd629 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:18.367288 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d927559-6724-4d72-9629-c2a7fa3fd629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:18.399301 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-9d927559-6724-4d72-9629-c2a7fa3fd629 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:18.399301 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9d927559-6724-4d72-9629-c2a7fa3fd629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:18.457398 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:18.484689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1006/1997] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:48:18.497507 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd467e8-0f88-4fa2-8fa4-835479f253c5 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:18.499676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-afd467e8-0f88-4fa2-8fa4-835479f253c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:18.506991 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:18.603454 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd467e8-0f88-4fa2-8fa4-835479f253c5 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:18.614624 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab284eb-0da8-476a-8ecb-21160514f969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:18.624413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab284eb-0da8-476a-8ecb-21160514f969 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:18.626961 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab284eb-0da8-476a-8ecb-21160514f969 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:18.626961 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab284eb-0da8-476a-8ecb-21160514f969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:18.650069 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab284eb-0da8-476a-8ecb-21160514f969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:18.651830 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab284eb-0da8-476a-8ecb-21160514f969 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:18.665224 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 992/1998] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:48:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:48:18.707782 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:19.180209 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d927559-6724-4d72-9629-c2a7fa3fd629 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:19.184554 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9d927559-6724-4d72-9629-c2a7fa3fd629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:19.289932 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d927559-6724-4d72-9629-c2a7fa3fd629 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:19.311062 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7cac2c-6e21-405d-b743-d7e25cd4bf1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:19.324101 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cac2c-6e21-405d-b743-d7e25cd4bf1e service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:19.324613 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cac2c-6e21-405d-b743-d7e25cd4bf1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:19.325218 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cac2c-6e21-405d-b743-d7e25cd4bf1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:19.329103 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-db7cac2c-6e21-405d-b743-d7e25cd4bf1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:19.377756 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:19.436429 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7cac2c-6e21-405d-b743-d7e25cd4bf1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:19.437847 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7cac2c-6e21-405d-b743-d7e25cd4bf1e service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:19.450835 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1007/1999] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:48:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:48:19.474322 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:19.483300 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab284eb-0da8-476a-8ecb-21160514f969 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:19.485983 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-dab284eb-0da8-476a-8ecb-21160514f969 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:19.504840 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab284eb-0da8-476a-8ecb-21160514f969 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:19.510179 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efd872-a2fc-4518-9398-a39ed497f2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:19.510835 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efd872-a2fc-4518-9398-a39ed497f2d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:19.511119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efd872-a2fc-4518-9398-a39ed497f2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:19.511444 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efd872-a2fc-4518-9398-a39ed497f2d2 admin admin] PATH_INFO: `/v3/projects/25b4cf4618d84cbe946c749a1286efed` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:19.512617 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15efd872-a2fc-4518-9398-a39ed497f2d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25b4cf4618d84cbe946c749a1286efed)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:19.515188 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15efd872-a2fc-4518-9398-a39ed497f2d2 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:19.645808 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-15efd872-a2fc-4518-9398-a39ed497f2d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25b4cf4618d84cbe946c749a1286efed', 'request_id': 'req-15efd872-a2fc-4518-9398-a39ed497f2d2'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:19.651020 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:19.656433 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-15efd872-a2fc-4518-9398-a39ed497f2d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25b4cf4618d84cbe946c749a1286efed', 'request_id': 'req-15efd872-a2fc-4518-9398-a39ed497f2d2'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:19.738229 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-15efd872-a2fc-4518-9398-a39ed497f2d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25b4cf4618d84cbe946c749a1286efed', 'request_id': 'req-15efd872-a2fc-4518-9398-a39ed497f2d2'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:19.752515 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-15efd872-a2fc-4518-9398-a39ed497f2d2 admin admin] The token cache is being invalidate because project 25b4cf4618d84cbe946c749a1286efed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:48:19.752811 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-15efd872-a2fc-4518-9398-a39ed497f2d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:19.753538 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-15efd872-a2fc-4518-9398-a39ed497f2d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:19.755072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 993/2000] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:48:19 2022] DELETE /identity/v3/projects/25b4cf4618d84cbe946c749a1286efed => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:19.759537 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7cac2c-6e21-405d-b743-d7e25cd4bf1e service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:19.771846 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7cac2c-6e21-405d-b743-d7e25cd4bf1e service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:19.893957 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696175b-8093-4e83-9992-027ad5e83e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:19.894824 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696175b-8093-4e83-9992-027ad5e83e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:19.895189 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696175b-8093-4e83-9992-027ad5e83e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:19.896178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696175b-8093-4e83-9992-027ad5e83e74 admin admin] PATH_INFO: `/v3/users/eb988a6dde7147cab2cf61523c6128cb` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:19.901087 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2696175b-8093-4e83-9992-027ad5e83e74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb988a6dde7147cab2cf61523c6128cb)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:19.905413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2696175b-8093-4e83-9992-027ad5e83e74 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:20.044084 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:20.174043 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2696175b-8093-4e83-9992-027ad5e83e74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb988a6dde7147cab2cf61523c6128cb'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:20.197151 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:20.261110 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2696175b-8093-4e83-9992-027ad5e83e74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb988a6dde7147cab2cf61523c6128cb'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:20.261842 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2696175b-8093-4e83-9992-027ad5e83e74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb988a6dde7147cab2cf61523c6128cb'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:20.262525 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2696175b-8093-4e83-9992-027ad5e83e74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb988a6dde7147cab2cf61523c6128cb'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:20.274790 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2696175b-8093-4e83-9992-027ad5e83e74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb988a6dde7147cab2cf61523c6128cb'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:20.298302 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1008/2001] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:48:19 2022] DELETE /identity/v3/users/eb988a6dde7147cab2cf61523c6128cb => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:48:20.453980 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efd872-a2fc-4518-9398-a39ed497f2d2 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:20.455577 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-15efd872-a2fc-4518-9398-a39ed497f2d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:20.469817 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efd872-a2fc-4518-9398-a39ed497f2d2 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:20.543702 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05ef3a-69d1-45ea-ad4d-df4f281b20b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:20.544529 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05ef3a-69d1-45ea-ad4d-df4f281b20b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:20.546061 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05ef3a-69d1-45ea-ad4d-df4f281b20b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:20.546184 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05ef3a-69d1-45ea-ad4d-df4f281b20b0 admin admin] PATH_INFO: `/v3/users/c8dc8f4ff34d4c179375ecabadd397e6` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:20.547902 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05ef3a-69d1-45ea-ad4d-df4f281b20b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8dc8f4ff34d4c179375ecabadd397e6)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:20.551074 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05ef3a-69d1-45ea-ad4d-df4f281b20b0 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:20.944581 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-fb05ef3a-69d1-45ea-ad4d-df4f281b20b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8dc8f4ff34d4c179375ecabadd397e6'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:20.945441 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-fb05ef3a-69d1-45ea-ad4d-df4f281b20b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8dc8f4ff34d4c179375ecabadd397e6'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:20.955171 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-fb05ef3a-69d1-45ea-ad4d-df4f281b20b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8dc8f4ff34d4c179375ecabadd397e6'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:20.956004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-fb05ef3a-69d1-45ea-ad4d-df4f281b20b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8dc8f4ff34d4c179375ecabadd397e6'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:20.973430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696175b-8093-4e83-9992-027ad5e83e74 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:20.978397 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2696175b-8093-4e83-9992-027ad5e83e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:20.996070 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696175b-8093-4e83-9992-027ad5e83e74 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:21.005341 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e866e-ef77-4790-8da0-53a54de78696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:21.006035 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e866e-ef77-4790-8da0-53a54de78696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:21.006820 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e866e-ef77-4790-8da0-53a54de78696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:21.006820 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e866e-ef77-4790-8da0-53a54de78696 admin admin] PATH_INFO: `/v3/projects/5754c772827e4e8aa70b1ae0cdc0adc7` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:21.007869 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e866e-ef77-4790-8da0-53a54de78696 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5754c772827e4e8aa70b1ae0cdc0adc7)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:21.009917 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e866e-ef77-4790-8da0-53a54de78696 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:21.092753 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:21.094660 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-fb05ef3a-69d1-45ea-ad4d-df4f281b20b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8dc8f4ff34d4c179375ecabadd397e6'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:21.116064 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 994/2002] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:48:20 2022] DELETE /identity/v3/users/c8dc8f4ff34d4c179375ecabadd397e6 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:21.121266 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2da27c-b533-4361-a079-2da68ec0b671 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:21.121961 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2da27c-b533-4361-a079-2da68ec0b671 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:21.121961 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2da27c-b533-4361-a079-2da68ec0b671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:21.143895 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-dc2da27c-b533-4361-a079-2da68ec0b671 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:21.145202 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-dc2da27c-b533-4361-a079-2da68ec0b671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:21.166726 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8e7e866e-ef77-4790-8da0-53a54de78696 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5754c772827e4e8aa70b1ae0cdc0adc7', 'request_id': 'req-8e7e866e-ef77-4790-8da0-53a54de78696'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:21.176029 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8e7e866e-ef77-4790-8da0-53a54de78696 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5754c772827e4e8aa70b1ae0cdc0adc7', 'request_id': 'req-8e7e866e-ef77-4790-8da0-53a54de78696'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:21.225425 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 995/2003] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:21.238551 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2da27c-b533-4361-a079-2da68ec0b671 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:21.240108 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-dc2da27c-b533-4361-a079-2da68ec0b671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:21.264075 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8e7e866e-ef77-4790-8da0-53a54de78696 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5754c772827e4e8aa70b1ae0cdc0adc7', 'request_id': 'req-8e7e866e-ef77-4790-8da0-53a54de78696'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:21.268197 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:21.288439 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8e7e866e-ef77-4790-8da0-53a54de78696 admin admin] The token cache is being invalidate because project 5754c772827e4e8aa70b1ae0cdc0adc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:48:21.289051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8e7e866e-ef77-4790-8da0-53a54de78696 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:21.290337 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8e7e866e-ef77-4790-8da0-53a54de78696 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:21.297973 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1009/2004] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:48:20 2022] DELETE /identity/v3/projects/5754c772827e4e8aa70b1ae0cdc0adc7 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:48:21.304082 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4c806-5c02-4472-aa95-db960e77b7e5 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:21.307206 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4c806-5c02-4472-aa95-db960e77b7e5 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:21.308138 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4c806-5c02-4472-aa95-db960e77b7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:21.322588 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2da27c-b533-4361-a079-2da68ec0b671 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:21.353073 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-d7e4c806-5c02-4472-aa95-db960e77b7e5 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:21.355777 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d7e4c806-5c02-4472-aa95-db960e77b7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:21.428064 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb57a5d-11d9-4cd7-927d-6d6cb135487a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:21.429036 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb57a5d-11d9-4cd7-927d-6d6cb135487a service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:21.429516 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb57a5d-11d9-4cd7-927d-6d6cb135487a service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:21.429996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb57a5d-11d9-4cd7-927d-6d6cb135487a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:21.433456 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1cb57a5d-11d9-4cd7-927d-6d6cb135487a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:21.526682 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1010/2005] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:48:21.528725 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183dcd1-d99d-4902-b645-7f809ff5173a None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:21.529882 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183dcd1-d99d-4902-b645-7f809ff5173a None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:21.530425 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183dcd1-d99d-4902-b645-7f809ff5173a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:21.554533 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb57a5d-11d9-4cd7-927d-6d6cb135487a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:21.556705 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb57a5d-11d9-4cd7-927d-6d6cb135487a service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:21.562909 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-6183dcd1-d99d-4902-b645-7f809ff5173a None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:21.564955 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6183dcd1-d99d-4902-b645-7f809ff5173a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:21.584773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 996/2006] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:48:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:48:21.591659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1011/2007] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:21.592312 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb57a5d-11d9-4cd7-927d-6d6cb135487a service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:21.619603 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb57a5d-11d9-4cd7-927d-6d6cb135487a service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:21.633999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadd7fb-868e-4db7-a0c8-178dc60379af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:21.634652 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadd7fb-868e-4db7-a0c8-178dc60379af admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:21.634931 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadd7fb-868e-4db7-a0c8-178dc60379af admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:21.635204 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadd7fb-868e-4db7-a0c8-178dc60379af admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:21.635910 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dadd7fb-868e-4db7-a0c8-178dc60379af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:48:21.636216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dadd7fb-868e-4db7-a0c8-178dc60379af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:21.637948 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dadd7fb-868e-4db7-a0c8-178dc60379af admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:21.667149 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 997/2008] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:48:21.672237 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6183dcd1-d99d-4902-b645-7f809ff5173a None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:21.684193 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6183dcd1-d99d-4902-b645-7f809ff5173a None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:21.712463 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc271b63-5ecc-429c-8754-41fec3c030f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:21.713597 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc271b63-5ecc-429c-8754-41fec3c030f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:21.713959 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc271b63-5ecc-429c-8754-41fec3c030f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:21.714218 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc271b63-5ecc-429c-8754-41fec3c030f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:21.714959 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc271b63-5ecc-429c-8754-41fec3c030f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:21.716961 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc271b63-5ecc-429c-8754-41fec3c030f3 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:21.896653 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1012/2009] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:48:21 2022] POST /identity/v3/projects => generated 393 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:48:21.897390 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadd7fb-868e-4db7-a0c8-178dc60379af admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:21.931240 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadd7fb-868e-4db7-a0c8-178dc60379af admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:22.008588 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc271b63-5ecc-429c-8754-41fec3c030f3 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:22.012155 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-dc271b63-5ecc-429c-8754-41fec3c030f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:22.125472 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33f5e0-91e9-4908-9c2a-112682f2f37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:22.126145 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33f5e0-91e9-4908-9c2a-112682f2f37e admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:22.126422 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33f5e0-91e9-4908-9c2a-112682f2f37e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:22.126867 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33f5e0-91e9-4908-9c2a-112682f2f37e admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:22.127578 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33f5e0-91e9-4908-9c2a-112682f2f37e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:22.130014 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33f5e0-91e9-4908-9c2a-112682f2f37e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:22.179395 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc271b63-5ecc-429c-8754-41fec3c030f3 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:22.183796 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23be7a8-c5cd-4776-8a5d-2867763fc237 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:22.184475 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23be7a8-c5cd-4776-8a5d-2867763fc237 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:22.185505 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23be7a8-c5cd-4776-8a5d-2867763fc237 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:22.185794 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23be7a8-c5cd-4776-8a5d-2867763fc237 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:22.187869 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f23be7a8-c5cd-4776-8a5d-2867763fc237 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:22.225193 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:22.270165 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23be7a8-c5cd-4776-8a5d-2867763fc237 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:22.272734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23be7a8-c5cd-4776-8a5d-2867763fc237 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:22.277390 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 998/2010] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:48:21 2022] POST /identity/v3/users => generated 297 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:48:22.283077 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33f5e0-91e9-4908-9c2a-112682f2f37e admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:22.289502 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1013/2011] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:48:22 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:48:22.295952 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33f5e0-91e9-4908-9c2a-112682f2f37e admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:22.306252 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952eb423-36e2-47b2-9f30-51f74f721646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:22.307047 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952eb423-36e2-47b2-9f30-51f74f721646 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:22.307523 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952eb423-36e2-47b2-9f30-51f74f721646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:22.307942 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952eb423-36e2-47b2-9f30-51f74f721646 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:22.308411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23be7a8-c5cd-4776-8a5d-2867763fc237 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:22.308947 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952eb423-36e2-47b2-9f30-51f74f721646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:22.311077 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952eb423-36e2-47b2-9f30-51f74f721646 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:22.314305 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f23be7a8-c5cd-4776-8a5d-2867763fc237 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:22.334062 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 999/2012] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:22.338017 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952eb423-36e2-47b2-9f30-51f74f721646 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:22.345133 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23be7a8-c5cd-4776-8a5d-2867763fc237 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:22.362103 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef285c-636f-452b-9f8b-b8eaf1773a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:22.362777 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef285c-636f-452b-9f8b-b8eaf1773a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:22.363192 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef285c-636f-452b-9f8b-b8eaf1773a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:22.363419 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef285c-636f-452b-9f8b-b8eaf1773a86 admin admin] PATH_INFO: `/v3/projects/298aa829cc5a45d386a0f2790166e288` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:22.365939 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952eb423-36e2-47b2-9f30-51f74f721646 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:22.366691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef285c-636f-452b-9f8b-b8eaf1773a86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=298aa829cc5a45d386a0f2790166e288)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:22.369903 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef285c-636f-452b-9f8b-b8eaf1773a86 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:22.373787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b40c65-6029-4301-93cf-cd94777669c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:22.374428 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b40c65-6029-4301-93cf-cd94777669c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:22.374705 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b40c65-6029-4301-93cf-cd94777669c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:22.375004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b40c65-6029-4301-93cf-cd94777669c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:22.375857 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b40c65-6029-4301-93cf-cd94777669c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:22.377600 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b40c65-6029-4301-93cf-cd94777669c9 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:22.383530 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:22.399339 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1000/2013] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:22.403890 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b40c65-6029-4301-93cf-cd94777669c9 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:22.416082 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b40c65-6029-4301-93cf-cd94777669c9 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:22.423306 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266bcda-7e13-43a0-b342-5117c63a50e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:22.427611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266bcda-7e13-43a0-b342-5117c63a50e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:22.428431 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266bcda-7e13-43a0-b342-5117c63a50e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:22.428431 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266bcda-7e13-43a0-b342-5117c63a50e5 admin admin] PATH_INFO: `/v3/projects/41a298edabd7433a8704950ec587e80b/users/9333d7c0d0ab472284fb44b426effcc8/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:22.449939 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4266bcda-7e13-43a0-b342-5117c63a50e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41a298edabd7433a8704950ec587e80b, user_id=9333d7c0d0ab472284fb44b426effcc8, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:22.455481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4266bcda-7e13-43a0-b342-5117c63a50e5 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:22.527461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1001/2014] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:48:22 2022] PUT /identity/v3/projects/41a298edabd7433a8704950ec587e80b/users/9333d7c0d0ab472284fb44b426effcc8/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:22.540625 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d8ef285c-636f-452b-9f8b-b8eaf1773a86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '298aa829cc5a45d386a0f2790166e288', 'request_id': 'req-d8ef285c-636f-452b-9f8b-b8eaf1773a86'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:22.548266 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012ea4e-a9e1-48e9-9894-2262d5e9359f None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:22.548803 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012ea4e-a9e1-48e9-9894-2262d5e9359f None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:22.549263 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012ea4e-a9e1-48e9-9894-2262d5e9359f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:22.559414 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d8ef285c-636f-452b-9f8b-b8eaf1773a86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '298aa829cc5a45d386a0f2790166e288', 'request_id': 'req-d8ef285c-636f-452b-9f8b-b8eaf1773a86'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:22.608796 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-4012ea4e-a9e1-48e9-9894-2262d5e9359f None None] MFA Rules not processed for user `9333d7c0d0ab472284fb44b426effcc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:22.610312 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4012ea4e-a9e1-48e9-9894-2262d5e9359f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:22.664460 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d8ef285c-636f-452b-9f8b-b8eaf1773a86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '298aa829cc5a45d386a0f2790166e288', 'request_id': 'req-d8ef285c-636f-452b-9f8b-b8eaf1773a86'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:22.684304 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d8ef285c-636f-452b-9f8b-b8eaf1773a86 admin admin] The token cache is being invalidate because project 298aa829cc5a45d386a0f2790166e288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:48:22.684605 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d8ef285c-636f-452b-9f8b-b8eaf1773a86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:22.688424 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d8ef285c-636f-452b-9f8b-b8eaf1773a86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:22.710896 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:22.713814 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1014/2015] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:48:22 2022] DELETE /identity/v3/projects/298aa829cc5a45d386a0f2790166e288 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:48:22.794241 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1002/2016] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:22.794473 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef285c-636f-452b-9f8b-b8eaf1773a86 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:22.796456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d8ef285c-636f-452b-9f8b-b8eaf1773a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:22.989360 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef285c-636f-452b-9f8b-b8eaf1773a86 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:22.998470 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111d3bc-9b50-42ac-9f4a-bdcdc2ad4aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:23.000101 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111d3bc-9b50-42ac-9f4a-bdcdc2ad4aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:23.000723 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111d3bc-9b50-42ac-9f4a-bdcdc2ad4aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:23.001306 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111d3bc-9b50-42ac-9f4a-bdcdc2ad4aa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:23.002681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6111d3bc-9b50-42ac-9f4a-bdcdc2ad4aa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:23.011122 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6111d3bc-9b50-42ac-9f4a-bdcdc2ad4aa9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:23.141247 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1015/2017] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:48:22 2022] POST /identity/v3/projects => generated 391 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:48:23.146733 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012ea4e-a9e1-48e9-9894-2262d5e9359f None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:23.160447 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012ea4e-a9e1-48e9-9894-2262d5e9359f None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:23.271806 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3692ff-8712-47a2-aec8-5f9ab1aaf42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:23.272472 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3692ff-8712-47a2-aec8-5f9ab1aaf42e admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:23.272787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3692ff-8712-47a2-aec8-5f9ab1aaf42e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:23.273027 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3692ff-8712-47a2-aec8-5f9ab1aaf42e admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:23.273720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3692ff-8712-47a2-aec8-5f9ab1aaf42e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:23.275959 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3692ff-8712-47a2-aec8-5f9ab1aaf42e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:23.309444 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:23.441099 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1003/2018] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:48:23 2022] POST /identity/v3/users => generated 302 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:48:23.443458 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111d3bc-9b50-42ac-9f4a-bdcdc2ad4aa9 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:23.467994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111d3bc-9b50-42ac-9f4a-bdcdc2ad4aa9 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:23.486056 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819c356-7e56-49a8-93dd-7471317580da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:23.486719 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819c356-7e56-49a8-93dd-7471317580da admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:23.486997 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819c356-7e56-49a8-93dd-7471317580da admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:23.489037 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819c356-7e56-49a8-93dd-7471317580da admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:23.489837 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819c356-7e56-49a8-93dd-7471317580da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:23.493149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819c356-7e56-49a8-93dd-7471317580da admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:23.514842 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1016/2019] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:23.515464 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3692ff-8712-47a2-aec8-5f9ab1aaf42e admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:23.532707 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3692ff-8712-47a2-aec8-5f9ab1aaf42e admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:23.541550 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7141d9-94b8-459c-8e93-5c7dfa6159f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:23.542258 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7141d9-94b8-459c-8e93-5c7dfa6159f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:23.542609 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7141d9-94b8-459c-8e93-5c7dfa6159f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:23.542896 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7141d9-94b8-459c-8e93-5c7dfa6159f1 admin admin] PATH_INFO: `/v3/projects/32ef4e205c4f4af496daf9f851ed34da/users/1f94c3571e1c45a0a041581b0d1d44c4/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:23.577128 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7141d9-94b8-459c-8e93-5c7dfa6159f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32ef4e205c4f4af496daf9f851ed34da, user_id=1f94c3571e1c45a0a041581b0d1d44c4, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:23.580241 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7141d9-94b8-459c-8e93-5c7dfa6159f1 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:23.731900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1004/2020] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:48:23 2022] PUT /identity/v3/projects/32ef4e205c4f4af496daf9f851ed34da/users/1f94c3571e1c45a0a041581b0d1d44c4/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:48:23.736926 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819c356-7e56-49a8-93dd-7471317580da admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:23.750484 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819c356-7e56-49a8-93dd-7471317580da admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:23.780728 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:23.861038 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ecec9-432c-4f55-a436-1e9b4a3a7deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:23.861998 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ecec9-432c-4f55-a436-1e9b4a3a7deb admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:23.862470 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ecec9-432c-4f55-a436-1e9b4a3a7deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:23.862936 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ecec9-432c-4f55-a436-1e9b4a3a7deb admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:23.863671 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ecec9-432c-4f55-a436-1e9b4a3a7deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:23.865580 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ecec9-432c-4f55-a436-1e9b4a3a7deb admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:23.879199 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1017/2021] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:23.883296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7141d9-94b8-459c-8e93-5c7dfa6159f1 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:23.897316 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7141d9-94b8-459c-8e93-5c7dfa6159f1 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:23.905408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d52443-b75d-4573-8510-a70c3e9abfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:23.906719 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d52443-b75d-4573-8510-a70c3e9abfa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:23.906719 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d52443-b75d-4573-8510-a70c3e9abfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:23.906932 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d52443-b75d-4573-8510-a70c3e9abfa6 admin admin] PATH_INFO: `/v3/projects/32ef4e205c4f4af496daf9f851ed34da/users/1f94c3571e1c45a0a041581b0d1d44c4/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:23.909185 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d52443-b75d-4573-8510-a70c3e9abfa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32ef4e205c4f4af496daf9f851ed34da, user_id=1f94c3571e1c45a0a041581b0d1d44c4, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:23.912210 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d52443-b75d-4573-8510-a70c3e9abfa6 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:23.920692 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:23.924794 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1005/2022] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:48:23 2022] PUT /identity/v3/projects/32ef4e205c4f4af496daf9f851ed34da/users/1f94c3571e1c45a0a041581b0d1d44c4/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:23.937715 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93569e42-e061-459b-861b-aa32894f54e9 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:23.938001 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93569e42-e061-459b-861b-aa32894f54e9 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:23.938288 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93569e42-e061-459b-861b-aa32894f54e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:23.971828 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-93569e42-e061-459b-861b-aa32894f54e9 None None] MFA Rules not processed for user `1f94c3571e1c45a0a041581b0d1d44c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:23.973117 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-93569e42-e061-459b-861b-aa32894f54e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:24.061134 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1018/2023] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:23 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:24.075537 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d52443-b75d-4573-8510-a70c3e9abfa6 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:24.082460 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-51d52443-b75d-4573-8510-a70c3e9abfa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:24.241554 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d52443-b75d-4573-8510-a70c3e9abfa6 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:24.246258 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9588ed-93ff-4a19-833a-c0e8bf329f1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:24.247090 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9588ed-93ff-4a19-833a-c0e8bf329f1c service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:24.247623 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9588ed-93ff-4a19-833a-c0e8bf329f1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:24.248917 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9588ed-93ff-4a19-833a-c0e8bf329f1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:24.259654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9588ed-93ff-4a19-833a-c0e8bf329f1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:24.261383 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9588ed-93ff-4a19-833a-c0e8bf329f1c service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:24.272521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1006/2024] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:48:24 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:48:24.347637 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93569e42-e061-459b-861b-aa32894f54e9 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:24.359917 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93569e42-e061-459b-861b-aa32894f54e9 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:24.365804 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19955e7-0373-42f1-8c1c-dcbc7ca6f9d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:24.366440 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19955e7-0373-42f1-8c1c-dcbc7ca6f9d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:24.366775 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19955e7-0373-42f1-8c1c-dcbc7ca6f9d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:24.367128 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19955e7-0373-42f1-8c1c-dcbc7ca6f9d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:24.462236 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19955e7-0373-42f1-8c1c-dcbc7ca6f9d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:24.463827 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19955e7-0373-42f1-8c1c-dcbc7ca6f9d9 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:24.494010 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1019/2025] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:48:24 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:48:25.189655 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:25.291149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:26.503981 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:27.797601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9588ed-93ff-4a19-833a-c0e8bf329f1c service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:27.800588 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-cc9588ed-93ff-4a19-833a-c0e8bf329f1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:27.939720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9588ed-93ff-4a19-833a-c0e8bf329f1c service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:27.951908 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b0880-2be3-4357-98d0-a5433d2390d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:27.953280 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b0880-2be3-4357-98d0-a5433d2390d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:27.953280 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b0880-2be3-4357-98d0-a5433d2390d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:27.953677 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b0880-2be3-4357-98d0-a5433d2390d2 admin admin] PATH_INFO: `/v3/users/f32daa5f87d245fcb907e14bfea8b191` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:27.957336 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b0880-2be3-4357-98d0-a5433d2390d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f32daa5f87d245fcb907e14bfea8b191)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:27.962529 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b0880-2be3-4357-98d0-a5433d2390d2 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:28.035791 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:28.222279 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-416b0880-2be3-4357-98d0-a5433d2390d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f32daa5f87d245fcb907e14bfea8b191'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:28.223470 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-416b0880-2be3-4357-98d0-a5433d2390d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f32daa5f87d245fcb907e14bfea8b191'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:28.240057 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-416b0880-2be3-4357-98d0-a5433d2390d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f32daa5f87d245fcb907e14bfea8b191'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:28.241274 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-416b0880-2be3-4357-98d0-a5433d2390d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f32daa5f87d245fcb907e14bfea8b191'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:28.366667 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-416b0880-2be3-4357-98d0-a5433d2390d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f32daa5f87d245fcb907e14bfea8b191'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:28.421884 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1007/2026] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:48:27 2022] DELETE /identity/v3/users/f32daa5f87d245fcb907e14bfea8b191 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:28.429636 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75500c9-5b12-43ad-bdc7-a86819a8900b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:28.430449 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75500c9-5b12-43ad-bdc7-a86819a8900b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:28.430815 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75500c9-5b12-43ad-bdc7-a86819a8900b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:28.468293 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-b75500c9-5b12-43ad-bdc7-a86819a8900b None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:28.470937 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b75500c9-5b12-43ad-bdc7-a86819a8900b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:28.518714 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b0880-2be3-4357-98d0-a5433d2390d2 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:28.523748 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-416b0880-2be3-4357-98d0-a5433d2390d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:28.599183 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:28.702326 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1020/2027] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:48:28.721618 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75500c9-5b12-43ad-bdc7-a86819a8900b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:28.734553 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b75500c9-5b12-43ad-bdc7-a86819a8900b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:28.763632 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b0880-2be3-4357-98d0-a5433d2390d2 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:28.792352 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb302b00-ba49-46d4-aaf5-4c4abb05821b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:28.796237 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb302b00-ba49-46d4-aaf5-4c4abb05821b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:28.796237 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb302b00-ba49-46d4-aaf5-4c4abb05821b admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:28.796686 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb302b00-ba49-46d4-aaf5-4c4abb05821b admin admin] PATH_INFO: `/v3/users/64ee405803044ca2af45c63149184891` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:28.799927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb302b00-ba49-46d4-aaf5-4c4abb05821b admin admin] RBAC: Authorizing `identity:delete_user(user_id=64ee405803044ca2af45c63149184891)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:28.803985 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb302b00-ba49-46d4-aaf5-4c4abb05821b admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:28.895079 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75500c9-5b12-43ad-bdc7-a86819a8900b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:28.901579 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc2803-bd4f-4dcf-951a-08c8dd336e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:28.902509 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc2803-bd4f-4dcf-951a-08c8dd336e14 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:28.903402 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc2803-bd4f-4dcf-951a-08c8dd336e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:28.905635 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc2803-bd4f-4dcf-951a-08c8dd336e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:28.922903 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc2803-bd4f-4dcf-951a-08c8dd336e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:28.924797 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc2803-bd4f-4dcf-951a-08c8dd336e14 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:28.939176 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1021/2028] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:48:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:48:29.032151 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:29.034928 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-cb302b00-ba49-46d4-aaf5-4c4abb05821b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64ee405803044ca2af45c63149184891'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:29.037487 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-cb302b00-ba49-46d4-aaf5-4c4abb05821b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64ee405803044ca2af45c63149184891'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:29.052191 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-cb302b00-ba49-46d4-aaf5-4c4abb05821b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64ee405803044ca2af45c63149184891'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:29.053746 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-cb302b00-ba49-46d4-aaf5-4c4abb05821b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64ee405803044ca2af45c63149184891'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:29.141432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-cb302b00-ba49-46d4-aaf5-4c4abb05821b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64ee405803044ca2af45c63149184891'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:29.162142 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1008/2029] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:48:28 2022] DELETE /identity/v3/users/64ee405803044ca2af45c63149184891 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:48:29.764528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc2803-bd4f-4dcf-951a-08c8dd336e14 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:29.766364 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb302b00-ba49-46d4-aaf5-4c4abb05821b admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:29.766808 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-72fc2803-bd4f-4dcf-951a-08c8dd336e14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:29.768721 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-cb302b00-ba49-46d4-aaf5-4c4abb05821b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:29.789838 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc2803-bd4f-4dcf-951a-08c8dd336e14 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:29.946398 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa5408-3c31-49bd-b7f8-7082ee16d5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:29.946585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb302b00-ba49-46d4-aaf5-4c4abb05821b admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:29.947951 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa5408-3c31-49bd-b7f8-7082ee16d5eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:29.948558 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa5408-3c31-49bd-b7f8-7082ee16d5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:29.948856 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa5408-3c31-49bd-b7f8-7082ee16d5eb admin admin] PATH_INFO: `/v3/projects/bf7748550aa74a7bb41ea179ed29143b` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:29.951742 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa5408-3c31-49bd-b7f8-7082ee16d5eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf7748550aa74a7bb41ea179ed29143b)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:29.954292 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa5408-3c31-49bd-b7f8-7082ee16d5eb admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:29.963079 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0348bc-3259-42c4-992d-528ad1cb0cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:29.963885 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0348bc-3259-42c4-992d-528ad1cb0cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:29.964168 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0348bc-3259-42c4-992d-528ad1cb0cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:29.964445 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0348bc-3259-42c4-992d-528ad1cb0cd7 admin admin] PATH_INFO: `/v3/projects/853424302e384abf9e4b188c5850a321` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:29.968271 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0348bc-3259-42c4-992d-528ad1cb0cd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=853424302e384abf9e4b188c5850a321)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:29.970633 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0348bc-3259-42c4-992d-528ad1cb0cd7 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:30.115665 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f3fa5408-3c31-49bd-b7f8-7082ee16d5eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf7748550aa74a7bb41ea179ed29143b', 'request_id': 'req-f3fa5408-3c31-49bd-b7f8-7082ee16d5eb'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:30.125192 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f3fa5408-3c31-49bd-b7f8-7082ee16d5eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf7748550aa74a7bb41ea179ed29143b', 'request_id': 'req-f3fa5408-3c31-49bd-b7f8-7082ee16d5eb'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:30.144295 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0d0348bc-3259-42c4-992d-528ad1cb0cd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '853424302e384abf9e4b188c5850a321', 'request_id': 'req-0d0348bc-3259-42c4-992d-528ad1cb0cd7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:30.153442 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0d0348bc-3259-42c4-992d-528ad1cb0cd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '853424302e384abf9e4b188c5850a321', 'request_id': 'req-0d0348bc-3259-42c4-992d-528ad1cb0cd7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:30.202624 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f3fa5408-3c31-49bd-b7f8-7082ee16d5eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf7748550aa74a7bb41ea179ed29143b', 'request_id': 'req-f3fa5408-3c31-49bd-b7f8-7082ee16d5eb'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:30.203303 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:30.219683 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f3fa5408-3c31-49bd-b7f8-7082ee16d5eb admin admin] The token cache is being invalidate because project bf7748550aa74a7bb41ea179ed29143b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:48:30.220143 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f3fa5408-3c31-49bd-b7f8-7082ee16d5eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:30.221266 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f3fa5408-3c31-49bd-b7f8-7082ee16d5eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:30.223179 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1022/2030] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:48:29 2022] DELETE /identity/v3/projects/bf7748550aa74a7bb41ea179ed29143b => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:30.227468 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa5408-3c31-49bd-b7f8-7082ee16d5eb admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:30.229065 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f3fa5408-3c31-49bd-b7f8-7082ee16d5eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:30.240256 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:30.308497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa5408-3c31-49bd-b7f8-7082ee16d5eb admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:30.326539 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0d0348bc-3259-42c4-992d-528ad1cb0cd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '853424302e384abf9e4b188c5850a321', 'request_id': 'req-0d0348bc-3259-42c4-992d-528ad1cb0cd7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:30.345016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0d0348bc-3259-42c4-992d-528ad1cb0cd7 admin admin] The token cache is being invalidate because project 853424302e384abf9e4b188c5850a321 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:48:30.349889 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0d0348bc-3259-42c4-992d-528ad1cb0cd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:30.349889 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0d0348bc-3259-42c4-992d-528ad1cb0cd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:30.349889 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1009/2031] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:48:29 2022] DELETE /identity/v3/projects/853424302e384abf9e4b188c5850a321 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:30.355727 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40018f0-7185-4623-92a5-3e75dfac1a28 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:30.356303 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40018f0-7185-4623-92a5-3e75dfac1a28 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:30.357197 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40018f0-7185-4623-92a5-3e75dfac1a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:30.380279 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-d40018f0-7185-4623-92a5-3e75dfac1a28 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:30.381566 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d40018f0-7185-4623-92a5-3e75dfac1a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:30.391468 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c29b9-6a79-484b-b903-9d59ba17c4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:30.392292 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c29b9-6a79-484b-b903-9d59ba17c4e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:30.392658 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c29b9-6a79-484b-b903-9d59ba17c4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:30.392959 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c29b9-6a79-484b-b903-9d59ba17c4e5 admin admin] PATH_INFO: `/v3/users/5c0dfe3ac54b4c659b12f5adb0af932a` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:30.394308 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c29b9-6a79-484b-b903-9d59ba17c4e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c0dfe3ac54b4c659b12f5adb0af932a)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:30.396612 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c29b9-6a79-484b-b903-9d59ba17c4e5 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:30.466351 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1010/2032] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:48:30.474295 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc416da-2a61-4184-9086-83e9ae7588ab None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:30.474590 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc416da-2a61-4184-9086-83e9ae7588ab None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:30.474872 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc416da-2a61-4184-9086-83e9ae7588ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:30.498419 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-bcc416da-2a61-4184-9086-83e9ae7588ab None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:30.500013 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-bcc416da-2a61-4184-9086-83e9ae7588ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:30.513919 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1011/2033] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:48:30.515567 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc416da-2a61-4184-9086-83e9ae7588ab None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:30.532727 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc416da-2a61-4184-9086-83e9ae7588ab None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:30.539105 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94315e88-c69f-479d-a5a4-fdcbed186bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:30.540221 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94315e88-c69f-479d-a5a4-fdcbed186bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:30.540656 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94315e88-c69f-479d-a5a4-fdcbed186bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:30.541351 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94315e88-c69f-479d-a5a4-fdcbed186bd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:30.542880 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94315e88-c69f-479d-a5a4-fdcbed186bd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:48:30.543321 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94315e88-c69f-479d-a5a4-fdcbed186bd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:30.547117 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94315e88-c69f-479d-a5a4-fdcbed186bd5 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:30.563408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1012/2034] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:48:30.568000 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94315e88-c69f-479d-a5a4-fdcbed186bd5 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:30.579492 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94315e88-c69f-479d-a5a4-fdcbed186bd5 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:30.587966 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5319d-dbeb-4b24-9833-d88d45d70607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:30.589015 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5319d-dbeb-4b24-9833-d88d45d70607 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:30.589529 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5319d-dbeb-4b24-9833-d88d45d70607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:30.590028 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5319d-dbeb-4b24-9833-d88d45d70607 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:30.591209 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5319d-dbeb-4b24-9833-d88d45d70607 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:30.595294 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5319d-dbeb-4b24-9833-d88d45d70607 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:30.722007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-356c29b9-6a79-484b-b903-9d59ba17c4e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c0dfe3ac54b4c659b12f5adb0af932a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:30.745205 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1013/2035] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:48:30 2022] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:48:30.750347 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5319d-dbeb-4b24-9833-d88d45d70607 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:30.823124 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5319d-dbeb-4b24-9833-d88d45d70607 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:30.828797 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142deed-a057-452f-a287-0e58f49c9f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:30.829451 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142deed-a057-452f-a287-0e58f49c9f2e admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:30.829733 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142deed-a057-452f-a287-0e58f49c9f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:30.830013 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142deed-a057-452f-a287-0e58f49c9f2e admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:30.830946 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142deed-a057-452f-a287-0e58f49c9f2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:30.832995 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142deed-a057-452f-a287-0e58f49c9f2e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:30.865940 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-356c29b9-6a79-484b-b903-9d59ba17c4e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c0dfe3ac54b4c659b12f5adb0af932a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:30.866885 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-356c29b9-6a79-484b-b903-9d59ba17c4e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c0dfe3ac54b4c659b12f5adb0af932a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:30.867607 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-356c29b9-6a79-484b-b903-9d59ba17c4e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c0dfe3ac54b4c659b12f5adb0af932a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:30.877377 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-356c29b9-6a79-484b-b903-9d59ba17c4e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c0dfe3ac54b4c659b12f5adb0af932a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:30.899031 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1023/2036] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:48:30 2022] DELETE /identity/v3/users/5c0dfe3ac54b4c659b12f5adb0af932a => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:48:30.947325 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1014/2037] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:48:30 2022] POST /identity/v3/users => generated 287 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:48:30.954074 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c29b9-6a79-484b-b903-9d59ba17c4e5 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:30.957080 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-356c29b9-6a79-484b-b903-9d59ba17c4e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:31.103672 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c29b9-6a79-484b-b903-9d59ba17c4e5 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:31.117594 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a89b3-0932-4b50-bd40-fa7bb79d1b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:31.118439 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a89b3-0932-4b50-bd40-fa7bb79d1b64 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:31.118821 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a89b3-0932-4b50-bd40-fa7bb79d1b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:31.119279 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a89b3-0932-4b50-bd40-fa7bb79d1b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:31.120131 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a89b3-0932-4b50-bd40-fa7bb79d1b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:31.122366 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a89b3-0932-4b50-bd40-fa7bb79d1b64 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:31.148094 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142deed-a057-452f-a287-0e58f49c9f2e admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:31.148762 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1024/2038] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:31.173287 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142deed-a057-452f-a287-0e58f49c9f2e admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:31.178805 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709abbb-45a7-4228-9376-9bf07e6c0773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:31.179523 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709abbb-45a7-4228-9376-9bf07e6c0773 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:31.179808 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709abbb-45a7-4228-9376-9bf07e6c0773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:31.180085 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709abbb-45a7-4228-9376-9bf07e6c0773 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:31.182323 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709abbb-45a7-4228-9376-9bf07e6c0773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:31.184711 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709abbb-45a7-4228-9376-9bf07e6c0773 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:31.200832 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a89b3-0932-4b50-bd40-fa7bb79d1b64 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:31.201988 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1015/2039] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:31.213527 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a89b3-0932-4b50-bd40-fa7bb79d1b64 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:31.222192 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9614c-74dc-4ff4-8fca-db802952665e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:31.222894 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9614c-74dc-4ff4-8fca-db802952665e admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:31.236172 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9614c-74dc-4ff4-8fca-db802952665e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:31.236341 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9614c-74dc-4ff4-8fca-db802952665e admin admin] PATH_INFO: `/v3/projects/df112574e78a4596b3925d995fb5adba/users/952df9db35fe4fbd89e803fcc41d6006/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:31.261870 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9614c-74dc-4ff4-8fca-db802952665e admin admin] RBAC: Authorizing `identity:create_grant(project_id=df112574e78a4596b3925d995fb5adba, user_id=952df9db35fe4fbd89e803fcc41d6006, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:31.267565 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9614c-74dc-4ff4-8fca-db802952665e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:31.418505 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1025/2040] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:48:31 2022] PUT /identity/v3/projects/df112574e78a4596b3925d995fb5adba/users/952df9db35fe4fbd89e803fcc41d6006/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:31.435880 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82e5ab-2d69-4ca3-a399-09e20f408141 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:31.436428 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82e5ab-2d69-4ca3-a399-09e20f408141 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:31.436936 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82e5ab-2d69-4ca3-a399-09e20f408141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:31.481301 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-5f82e5ab-2d69-4ca3-a399-09e20f408141 None None] MFA Rules not processed for user `952df9db35fe4fbd89e803fcc41d6006`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:31.483512 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5f82e5ab-2d69-4ca3-a399-09e20f408141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:31.580825 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1016/2041] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:31.594840 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9614c-74dc-4ff4-8fca-db802952665e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:31.596876 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e7f9614c-74dc-4ff4-8fca-db802952665e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:31.683858 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82e5ab-2d69-4ca3-a399-09e20f408141 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:31.692414 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5f82e5ab-2d69-4ca3-a399-09e20f408141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:31.698451 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9614c-74dc-4ff4-8fca-db802952665e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:31.713866 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e0a9b-bdbc-4b78-98f6-03ad2843bebd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:31.713866 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e0a9b-bdbc-4b78-98f6-03ad2843bebd service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:31.713866 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e0a9b-bdbc-4b78-98f6-03ad2843bebd service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:31.713866 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e0a9b-bdbc-4b78-98f6-03ad2843bebd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:31.742545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e0a9b-bdbc-4b78-98f6-03ad2843bebd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:31.742545 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e0a9b-bdbc-4b78-98f6-03ad2843bebd service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:31.755851 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1026/2042] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:48:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:48:31.819136 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82e5ab-2d69-4ca3-a399-09e20f408141 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:31.824993 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a21e0d-13c9-4954-8777-16497b303858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:31.829693 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a21e0d-13c9-4954-8777-16497b303858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:31.829693 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a21e0d-13c9-4954-8777-16497b303858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:31.829693 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a21e0d-13c9-4954-8777-16497b303858 admin admin] PATH_INFO: `/v3/projects/3970a72688224cb5abc65c25955c8553` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:31.829693 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a21e0d-13c9-4954-8777-16497b303858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3970a72688224cb5abc65c25955c8553)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:31.845692 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a21e0d-13c9-4954-8777-16497b303858 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:31.902791 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e0a9b-bdbc-4b78-98f6-03ad2843bebd service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:31.907466 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9c5e0a9b-bdbc-4b78-98f6-03ad2843bebd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:31.932931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e0a9b-bdbc-4b78-98f6-03ad2843bebd service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:31.939759 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c0c21-4085-4227-823c-ff6870b29d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:31.940452 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c0c21-4085-4227-823c-ff6870b29d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:31.940743 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c0c21-4085-4227-823c-ff6870b29d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:31.941170 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c0c21-4085-4227-823c-ff6870b29d5b admin admin] PATH_INFO: `/v3/users/9333d7c0d0ab472284fb44b426effcc8` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:31.943067 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c0c21-4085-4227-823c-ff6870b29d5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9333d7c0d0ab472284fb44b426effcc8)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:31.945962 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c0c21-4085-4227-823c-ff6870b29d5b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:31.984718 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-87a21e0d-13c9-4954-8777-16497b303858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3970a72688224cb5abc65c25955c8553', 'request_id': 'req-87a21e0d-13c9-4954-8777-16497b303858'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:31.993274 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-87a21e0d-13c9-4954-8777-16497b303858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3970a72688224cb5abc65c25955c8553', 'request_id': 'req-87a21e0d-13c9-4954-8777-16497b303858'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:32.094762 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-87a21e0d-13c9-4954-8777-16497b303858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3970a72688224cb5abc65c25955c8553', 'request_id': 'req-87a21e0d-13c9-4954-8777-16497b303858'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:32.109973 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-87a21e0d-13c9-4954-8777-16497b303858 admin admin] The token cache is being invalidate because project 3970a72688224cb5abc65c25955c8553 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:48:32.110273 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-87a21e0d-13c9-4954-8777-16497b303858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:32.110966 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-87a21e0d-13c9-4954-8777-16497b303858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:32.112552 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1017/2043] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:48:31 2022] DELETE /identity/v3/projects/3970a72688224cb5abc65c25955c8553 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:32.114175 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a21e0d-13c9-4954-8777-16497b303858 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:32.116074 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-87a21e0d-13c9-4954-8777-16497b303858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:32.194019 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a21e0d-13c9-4954-8777-16497b303858 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:32.204627 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912db3c-4c20-4e3b-bd91-bcbebdead0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:32.205663 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912db3c-4c20-4e3b-bd91-bcbebdead0f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:32.205963 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912db3c-4c20-4e3b-bd91-bcbebdead0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:32.206403 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912db3c-4c20-4e3b-bd91-bcbebdead0f1 admin admin] PATH_INFO: `/v3/users/952df9db35fe4fbd89e803fcc41d6006` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:32.206798 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f47c0c21-4085-4227-823c-ff6870b29d5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9333d7c0d0ab472284fb44b426effcc8'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:32.207761 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912db3c-4c20-4e3b-bd91-bcbebdead0f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=952df9db35fe4fbd89e803fcc41d6006)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:32.210333 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912db3c-4c20-4e3b-bd91-bcbebdead0f1 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:32.289443 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f47c0c21-4085-4227-823c-ff6870b29d5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9333d7c0d0ab472284fb44b426effcc8'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:32.290118 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f47c0c21-4085-4227-823c-ff6870b29d5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9333d7c0d0ab472284fb44b426effcc8'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:32.290751 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f47c0c21-4085-4227-823c-ff6870b29d5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9333d7c0d0ab472284fb44b426effcc8'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:32.299619 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f47c0c21-4085-4227-823c-ff6870b29d5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9333d7c0d0ab472284fb44b426effcc8'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:32.319695 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1027/2044] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:48:31 2022] DELETE /identity/v3/users/9333d7c0d0ab472284fb44b426effcc8 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:48:32.320548 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c0c21-4085-4227-823c-ff6870b29d5b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:32.321885 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f47c0c21-4085-4227-823c-ff6870b29d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:32.338054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:32.396905 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:32.441270 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c0c21-4085-4227-823c-ff6870b29d5b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:32.450128 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e324f1-82e4-47ac-9fc1-efab32f579bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:32.451323 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e324f1-82e4-47ac-9fc1-efab32f579bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:32.451752 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8912db3c-4c20-4e3b-bd91-bcbebdead0f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '952df9db35fe4fbd89e803fcc41d6006'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:32.451944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e324f1-82e4-47ac-9fc1-efab32f579bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:32.452454 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e324f1-82e4-47ac-9fc1-efab32f579bc admin admin] PATH_INFO: `/v3/users/daef8d23cbd14b24a85f282976bcace9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:32.452996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8912db3c-4c20-4e3b-bd91-bcbebdead0f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '952df9db35fe4fbd89e803fcc41d6006'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:32.454688 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e324f1-82e4-47ac-9fc1-efab32f579bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=daef8d23cbd14b24a85f282976bcace9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:32.460301 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e324f1-82e4-47ac-9fc1-efab32f579bc admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:32.466318 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8912db3c-4c20-4e3b-bd91-bcbebdead0f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '952df9db35fe4fbd89e803fcc41d6006'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:32.467531 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8912db3c-4c20-4e3b-bd91-bcbebdead0f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '952df9db35fe4fbd89e803fcc41d6006'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:32.547838 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8912db3c-4c20-4e3b-bd91-bcbebdead0f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '952df9db35fe4fbd89e803fcc41d6006'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:32.582349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1018/2045] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:48:32 2022] DELETE /identity/v3/users/952df9db35fe4fbd89e803fcc41d6006 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:32.585536 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f27ba-6497-4f95-a1cb-221b5ad1ba93 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:32.585908 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f27ba-6497-4f95-a1cb-221b5ad1ba93 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:32.586416 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f27ba-6497-4f95-a1cb-221b5ad1ba93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:32.624663 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-ce5f27ba-6497-4f95-a1cb-221b5ad1ba93 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:32.624663 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ce5f27ba-6497-4f95-a1cb-221b5ad1ba93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:32.710378 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-14e324f1-82e4-47ac-9fc1-efab32f579bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daef8d23cbd14b24a85f282976bcace9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:32.744587 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1019/2046] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:32.745906 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f230336-067f-4651-8624-ac967cc7b0b0 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:32.746226 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f230336-067f-4651-8624-ac967cc7b0b0 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:32.746510 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f230336-067f-4651-8624-ac967cc7b0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:32.772623 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-0f230336-067f-4651-8624-ac967cc7b0b0 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:32.773946 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-0f230336-067f-4651-8624-ac967cc7b0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:32.785773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1020/2047] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:32.785773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f230336-067f-4651-8624-ac967cc7b0b0 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:32.785773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-0f230336-067f-4651-8624-ac967cc7b0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:32.817066 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-14e324f1-82e4-47ac-9fc1-efab32f579bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daef8d23cbd14b24a85f282976bcace9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:32.817703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-14e324f1-82e4-47ac-9fc1-efab32f579bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daef8d23cbd14b24a85f282976bcace9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:32.818595 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-14e324f1-82e4-47ac-9fc1-efab32f579bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daef8d23cbd14b24a85f282976bcace9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:32.833160 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-14e324f1-82e4-47ac-9fc1-efab32f579bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daef8d23cbd14b24a85f282976bcace9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:32.863440 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f230336-067f-4651-8624-ac967cc7b0b0 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:32.867771 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4933ac-f9ac-4d68-9971-757f9b9dbbd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:32.868404 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4933ac-f9ac-4d68-9971-757f9b9dbbd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:32.868685 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4933ac-f9ac-4d68-9971-757f9b9dbbd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:32.868951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4933ac-f9ac-4d68-9971-757f9b9dbbd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:32.870713 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1028/2048] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:48:32 2022] DELETE /identity/v3/users/daef8d23cbd14b24a85f282976bcace9 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:32.870890 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9e4933ac-f9ac-4d68-9971-757f9b9dbbd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:32.872544 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e324f1-82e4-47ac-9fc1-efab32f579bc admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:32.874969 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-14e324f1-82e4-47ac-9fc1-efab32f579bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:32.900645 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4933ac-f9ac-4d68-9971-757f9b9dbbd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:32.903020 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4933ac-f9ac-4d68-9971-757f9b9dbbd7 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:32.915702 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1021/2049] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:48:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:48:32.991124 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e324f1-82e4-47ac-9fc1-efab32f579bc admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:32.997218 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46427b1e-9b42-43fd-8a27-18af4d592dee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:32.998316 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46427b1e-9b42-43fd-8a27-18af4d592dee service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:32.998797 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46427b1e-9b42-43fd-8a27-18af4d592dee service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:32.999463 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46427b1e-9b42-43fd-8a27-18af4d592dee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:33.003157 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-46427b1e-9b42-43fd-8a27-18af4d592dee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:33.078403 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46427b1e-9b42-43fd-8a27-18af4d592dee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:33.080692 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46427b1e-9b42-43fd-8a27-18af4d592dee service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:33.092400 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1029/2050] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:48:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:48:33.234156 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:33.386925 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:33.428280 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4933ac-f9ac-4d68-9971-757f9b9dbbd7 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:33.429943 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9e4933ac-f9ac-4d68-9971-757f9b9dbbd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:33.450689 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4933ac-f9ac-4d68-9971-757f9b9dbbd7 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:33.458092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d6437-76b5-4465-9f61-fb38c5624b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:33.459084 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d6437-76b5-4465-9f61-fb38c5624b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:33.459785 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d6437-76b5-4465-9f61-fb38c5624b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:33.460073 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d6437-76b5-4465-9f61-fb38c5624b0d admin admin] PATH_INFO: `/v3/projects/cc3a873c97914f2cb70dc927183e0334` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:33.461441 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d6437-76b5-4465-9f61-fb38c5624b0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc3a873c97914f2cb70dc927183e0334)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:33.463583 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d6437-76b5-4465-9f61-fb38c5624b0d admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:33.601629 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ee4d6437-76b5-4465-9f61-fb38c5624b0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc3a873c97914f2cb70dc927183e0334', 'request_id': 'req-ee4d6437-76b5-4465-9f61-fb38c5624b0d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:33.624755 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46427b1e-9b42-43fd-8a27-18af4d592dee service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:33.624956 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ee4d6437-76b5-4465-9f61-fb38c5624b0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc3a873c97914f2cb70dc927183e0334', 'request_id': 'req-ee4d6437-76b5-4465-9f61-fb38c5624b0d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:33.625045 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-46427b1e-9b42-43fd-8a27-18af4d592dee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:33.640141 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46427b1e-9b42-43fd-8a27-18af4d592dee service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:33.709206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ee4d6437-76b5-4465-9f61-fb38c5624b0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc3a873c97914f2cb70dc927183e0334', 'request_id': 'req-ee4d6437-76b5-4465-9f61-fb38c5624b0d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:33.720729 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f5197-5cf5-4ea4-9854-26cf22cbae1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:33.721369 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f5197-5cf5-4ea4-9854-26cf22cbae1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:33.721717 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f5197-5cf5-4ea4-9854-26cf22cbae1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:33.721987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f5197-5cf5-4ea4-9854-26cf22cbae1d admin admin] PATH_INFO: `/v3/projects/41a298edabd7433a8704950ec587e80b` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:33.723125 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f5197-5cf5-4ea4-9854-26cf22cbae1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=41a298edabd7433a8704950ec587e80b)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:33.723989 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ee4d6437-76b5-4465-9f61-fb38c5624b0d admin admin] The token cache is being invalidate because project cc3a873c97914f2cb70dc927183e0334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:48:33.724290 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ee4d6437-76b5-4465-9f61-fb38c5624b0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:33.724966 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ee4d6437-76b5-4465-9f61-fb38c5624b0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:33.726710 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1022/2051] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:48:33 2022] DELETE /identity/v3/projects/cc3a873c97914f2cb70dc927183e0334 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:33.731935 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f5197-5cf5-4ea4-9854-26cf22cbae1d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:33.733558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41858b33-7961-482f-9c7e-d15297b0179f None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:33.734043 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41858b33-7961-482f-9c7e-d15297b0179f None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:33.734754 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41858b33-7961-482f-9c7e-d15297b0179f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:33.766169 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-41858b33-7961-482f-9c7e-d15297b0179f None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:33.767544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-41858b33-7961-482f-9c7e-d15297b0179f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:33.776962 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1023/2052] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:48:33.785228 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f416f00-8833-4584-8ab5-dcc755ba9224 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:33.785515 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f416f00-8833-4584-8ab5-dcc755ba9224 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:33.785799 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f416f00-8833-4584-8ab5-dcc755ba9224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:33.808750 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-2f416f00-8833-4584-8ab5-dcc755ba9224 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:33.811482 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2f416f00-8833-4584-8ab5-dcc755ba9224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:33.824918 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1024/2053] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:48:33.831649 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f416f00-8833-4584-8ab5-dcc755ba9224 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:33.849691 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f416f00-8833-4584-8ab5-dcc755ba9224 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:33.862403 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa50cc2-0665-4295-bcbe-25b648f1384e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:33.862403 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa50cc2-0665-4295-bcbe-25b648f1384e admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:33.862403 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa50cc2-0665-4295-bcbe-25b648f1384e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:33.862403 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa50cc2-0665-4295-bcbe-25b648f1384e admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:33.863107 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa50cc2-0665-4295-bcbe-25b648f1384e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:48:33.863283 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa50cc2-0665-4295-bcbe-25b648f1384e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:33.866412 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa50cc2-0665-4295-bcbe-25b648f1384e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:33.908276 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-816f5197-5cf5-4ea4-9854-26cf22cbae1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41a298edabd7433a8704950ec587e80b', 'request_id': 'req-816f5197-5cf5-4ea4-9854-26cf22cbae1d'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:33.910585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1025/2054] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:48:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:48:33.913685 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa50cc2-0665-4295-bcbe-25b648f1384e admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:33.921775 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1aa50cc2-0665-4295-bcbe-25b648f1384e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:33.938840 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-816f5197-5cf5-4ea4-9854-26cf22cbae1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41a298edabd7433a8704950ec587e80b', 'request_id': 'req-816f5197-5cf5-4ea4-9854-26cf22cbae1d'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:33.950366 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa50cc2-0665-4295-bcbe-25b648f1384e admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:33.961901 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:34.032005 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-816f5197-5cf5-4ea4-9854-26cf22cbae1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41a298edabd7433a8704950ec587e80b', 'request_id': 'req-816f5197-5cf5-4ea4-9854-26cf22cbae1d'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:34.041880 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45e0ec-771c-4606-9c6e-f993a5a977f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:34.042861 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45e0ec-771c-4606-9c6e-f993a5a977f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:34.043334 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45e0ec-771c-4606-9c6e-f993a5a977f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:34.043614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45e0ec-771c-4606-9c6e-f993a5a977f6 admin admin] PATH_INFO: `/v3/projects/df112574e78a4596b3925d995fb5adba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:34.045144 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45e0ec-771c-4606-9c6e-f993a5a977f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df112574e78a4596b3925d995fb5adba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:34.047759 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45e0ec-771c-4606-9c6e-f993a5a977f6 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:34.058019 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-816f5197-5cf5-4ea4-9854-26cf22cbae1d admin admin] The token cache is being invalidate because project 41a298edabd7433a8704950ec587e80b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:48:34.059110 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-816f5197-5cf5-4ea4-9854-26cf22cbae1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:34.060652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-816f5197-5cf5-4ea4-9854-26cf22cbae1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:34.064374 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1030/2055] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:48:33 2022] DELETE /identity/v3/projects/41a298edabd7433a8704950ec587e80b => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:34.071473 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f5197-5cf5-4ea4-9854-26cf22cbae1d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:34.074200 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-816f5197-5cf5-4ea4-9854-26cf22cbae1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:34.098817 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f5197-5cf5-4ea4-9854-26cf22cbae1d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:34.107198 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355f386-a37d-446f-bcaa-ca5ee41f8dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:34.108256 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355f386-a37d-446f-bcaa-ca5ee41f8dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:34.108734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355f386-a37d-446f-bcaa-ca5ee41f8dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:34.109200 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355f386-a37d-446f-bcaa-ca5ee41f8dc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:34.110357 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355f386-a37d-446f-bcaa-ca5ee41f8dc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:34.114104 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355f386-a37d-446f-bcaa-ca5ee41f8dc0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:34.210446 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-db45e0ec-771c-4606-9c6e-f993a5a977f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df112574e78a4596b3925d995fb5adba', 'request_id': 'req-db45e0ec-771c-4606-9c6e-f993a5a977f6'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:34.221142 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-db45e0ec-771c-4606-9c6e-f993a5a977f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df112574e78a4596b3925d995fb5adba', 'request_id': 'req-db45e0ec-771c-4606-9c6e-f993a5a977f6'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:34.235613 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1031/2056] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:48:34 2022] POST /identity/v3/projects => generated 367 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:48:34.236675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355f386-a37d-446f-bcaa-ca5ee41f8dc0 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:34.238439 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1355f386-a37d-446f-bcaa-ca5ee41f8dc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:34.313067 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355f386-a37d-446f-bcaa-ca5ee41f8dc0 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:34.318268 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3591729-cdf5-4455-88f4-af318ca9c24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:34.318936 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3591729-cdf5-4455-88f4-af318ca9c24c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:34.319231 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3591729-cdf5-4455-88f4-af318ca9c24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:34.319539 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3591729-cdf5-4455-88f4-af318ca9c24c admin admin] PATH_INFO: `/v3/users/1f94c3571e1c45a0a041581b0d1d44c4` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:34.320803 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3591729-cdf5-4455-88f4-af318ca9c24c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f94c3571e1c45a0a041581b0d1d44c4)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:34.322817 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3591729-cdf5-4455-88f4-af318ca9c24c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:34.341315 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-db45e0ec-771c-4606-9c6e-f993a5a977f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df112574e78a4596b3925d995fb5adba', 'request_id': 'req-db45e0ec-771c-4606-9c6e-f993a5a977f6'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:34.367036 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-db45e0ec-771c-4606-9c6e-f993a5a977f6 admin admin] The token cache is being invalidate because project df112574e78a4596b3925d995fb5adba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:48:34.367720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-db45e0ec-771c-4606-9c6e-f993a5a977f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:34.368837 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-db45e0ec-771c-4606-9c6e-f993a5a977f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:34.371553 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1026/2057] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:48:33 2022] DELETE /identity/v3/projects/df112574e78a4596b3925d995fb5adba => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:34.373677 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45e0ec-771c-4606-9c6e-f993a5a977f6 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:34.376025 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-db45e0ec-771c-4606-9c6e-f993a5a977f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:34.474886 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45e0ec-771c-4606-9c6e-f993a5a977f6 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:34.480343 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc3891-869b-4803-8d66-78b66051b834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:34.480992 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc3891-869b-4803-8d66-78b66051b834 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:34.481279 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc3891-869b-4803-8d66-78b66051b834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:34.481563 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc3891-869b-4803-8d66-78b66051b834 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:34.482268 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc3891-869b-4803-8d66-78b66051b834 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:34.484324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc3891-869b-4803-8d66-78b66051b834 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:34.578861 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f3591729-cdf5-4455-88f4-af318ca9c24c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f94c3571e1c45a0a041581b0d1d44c4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:34.684890 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1027/2058] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:48:34 2022] POST /identity/v3/users => generated 284 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:48:34.687189 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d0ee5-e43a-4b01-bde7-a3a67b93f9f3 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:34.687551 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d0ee5-e43a-4b01-bde7-a3a67b93f9f3 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:34.687935 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d0ee5-e43a-4b01-bde7-a3a67b93f9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:34.712492 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f3591729-cdf5-4455-88f4-af318ca9c24c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f94c3571e1c45a0a041581b0d1d44c4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:34.713389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f3591729-cdf5-4455-88f4-af318ca9c24c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f94c3571e1c45a0a041581b0d1d44c4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:34.714026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-3f4d0ee5-e43a-4b01-bde7-a3a67b93f9f3 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:34.714234 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f3591729-cdf5-4455-88f4-af318ca9c24c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f94c3571e1c45a0a041581b0d1d44c4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:34.715675 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3f4d0ee5-e43a-4b01-bde7-a3a67b93f9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:34.727481 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f3591729-cdf5-4455-88f4-af318ca9c24c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f94c3571e1c45a0a041581b0d1d44c4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:34.728043 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1028/2059] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:34.729477 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d0ee5-e43a-4b01-bde7-a3a67b93f9f3 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:34.731602 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3f4d0ee5-e43a-4b01-bde7-a3a67b93f9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:34.750770 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d0ee5-e43a-4b01-bde7-a3a67b93f9f3 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:34.756560 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b2b5f-39eb-4630-81d5-a4d943c6b3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:34.757321 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b2b5f-39eb-4630-81d5-a4d943c6b3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:34.757660 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b2b5f-39eb-4630-81d5-a4d943c6b3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:34.757996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b2b5f-39eb-4630-81d5-a4d943c6b3e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:34.758718 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1032/2060] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:48:34 2022] DELETE /identity/v3/users/1f94c3571e1c45a0a041581b0d1d44c4 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:34.758986 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b2b5f-39eb-4630-81d5-a4d943c6b3e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:34.761036 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b2b5f-39eb-4630-81d5-a4d943c6b3e2 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:34.761240 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd1dd5-fba8-4d94-8355-0e22c8322a42 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:34.761537 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd1dd5-fba8-4d94-8355-0e22c8322a42 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:34.762117 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd1dd5-fba8-4d94-8355-0e22c8322a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:34.781672 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1029/2061] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:34.785171 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2edd1dd5-fba8-4d94-8355-0e22c8322a42 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:34.786435 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2edd1dd5-fba8-4d94-8355-0e22c8322a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:34.788793 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b2b5f-39eb-4630-81d5-a4d943c6b3e2 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:34.807797 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b2b5f-39eb-4630-81d5-a4d943c6b3e2 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:34.831900 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:34.883469 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1033/2062] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:34.890822 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd1dd5-fba8-4d94-8355-0e22c8322a42 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:34.910648 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd1dd5-fba8-4d94-8355-0e22c8322a42 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:34.918228 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3409e-7f60-41af-bddb-0730d0a31b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:34.919348 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3409e-7f60-41af-bddb-0730d0a31b10 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:34.920309 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3409e-7f60-41af-bddb-0730d0a31b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:34.920476 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a7184-cf48-407d-ac59-bcf4ab9202bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:34.920675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3409e-7f60-41af-bddb-0730d0a31b10 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:34.921111 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a7184-cf48-407d-ac59-bcf4ab9202bf admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:34.921393 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a7184-cf48-407d-ac59-bcf4ab9202bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:34.921637 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3409e-7f60-41af-bddb-0730d0a31b10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:48:34.921742 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a7184-cf48-407d-ac59-bcf4ab9202bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:34.922049 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3409e-7f60-41af-bddb-0730d0a31b10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:34.922380 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a7184-cf48-407d-ac59-bcf4ab9202bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:34.924102 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a7184-cf48-407d-ac59-bcf4ab9202bf admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:34.924403 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3409e-7f60-41af-bddb-0730d0a31b10 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:34.936193 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1030/2063] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:34.941539 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a7184-cf48-407d-ac59-bcf4ab9202bf admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:34.945581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1034/2064] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:48:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:48:34.948956 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3409e-7f60-41af-bddb-0730d0a31b10 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:34.958810 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a7184-cf48-407d-ac59-bcf4ab9202bf admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:34.960286 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3409e-7f60-41af-bddb-0730d0a31b10 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:34.964155 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af11d18-6019-4877-9f1b-a1c4b056b17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:34.965044 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af11d18-6019-4877-9f1b-a1c4b056b17c admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:34.965326 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af11d18-6019-4877-9f1b-a1c4b056b17c admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:34.965509 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e6180-b392-4cb9-b9ae-62e52edb8ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:34.965669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af11d18-6019-4877-9f1b-a1c4b056b17c admin admin] PATH_INFO: `/v3/projects/98c0a6ed5cc64c57b40f9c0e25c9ab44/users/4447b2ebaa4841d09ffbd2aff7940c10/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:34.966038 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e6180-b392-4cb9-b9ae-62e52edb8ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:34.966429 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e6180-b392-4cb9-b9ae-62e52edb8ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:34.967223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e6180-b392-4cb9-b9ae-62e52edb8ea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:34.967907 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e6180-b392-4cb9-b9ae-62e52edb8ea0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:34.969908 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e6180-b392-4cb9-b9ae-62e52edb8ea0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:34.985243 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af11d18-6019-4877-9f1b-a1c4b056b17c admin admin] RBAC: Authorizing `identity:create_grant(project_id=98c0a6ed5cc64c57b40f9c0e25c9ab44, user_id=4447b2ebaa4841d09ffbd2aff7940c10, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:34.991155 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af11d18-6019-4877-9f1b-a1c4b056b17c admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:35.081410 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1035/2065] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:48:34 2022] POST /identity/v3/projects => generated 403 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:48:35.088523 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e6180-b392-4cb9-b9ae-62e52edb8ea0 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:35.119080 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1031/2066] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:48:34 2022] PUT /identity/v3/projects/98c0a6ed5cc64c57b40f9c0e25c9ab44/users/4447b2ebaa4841d09ffbd2aff7940c10/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:35.130385 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d30c2f-8dc2-4989-9277-adf475d059d9 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:35.130669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d30c2f-8dc2-4989-9277-adf475d059d9 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:35.130951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d30c2f-8dc2-4989-9277-adf475d059d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:35.189633 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:35.200094 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-c4d30c2f-8dc2-4989-9277-adf475d059d9 None None] MFA Rules not processed for user `4447b2ebaa4841d09ffbd2aff7940c10`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:35.202352 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c4d30c2f-8dc2-4989-9277-adf475d059d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:35.224618 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e6180-b392-4cb9-b9ae-62e52edb8ea0 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:35.298534 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1032/2067] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:48:35.306186 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae9082-076a-4193-80dc-9720e803ac20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:35.306829 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae9082-076a-4193-80dc-9720e803ac20 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:35.307112 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae9082-076a-4193-80dc-9720e803ac20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:35.307525 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae9082-076a-4193-80dc-9720e803ac20 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:35.308105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae9082-076a-4193-80dc-9720e803ac20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:35.311671 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae9082-076a-4193-80dc-9720e803ac20 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:35.319779 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d30c2f-8dc2-4989-9277-adf475d059d9 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:35.321381 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c4d30c2f-8dc2-4989-9277-adf475d059d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:35.439620 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1036/2068] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:48:35 2022] POST /identity/v3/users => generated 302 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:48:35.441344 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae9082-076a-4193-80dc-9720e803ac20 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:35.443548 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a2ae9082-076a-4193-80dc-9720e803ac20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:35.473017 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d30c2f-8dc2-4989-9277-adf475d059d9 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:35.474035 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae9082-076a-4193-80dc-9720e803ac20 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:35.479765 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eeb1e6-f3a1-4be5-ad0e-fb3b60f82bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:35.480320 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0ddac-5d94-44f8-a582-ddde6440964e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7690af0cd266458f9cdd799c98ff5bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:35.480641 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eeb1e6-f3a1-4be5-ad0e-fb3b60f82bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:35.480950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eeb1e6-f3a1-4be5-ad0e-fb3b60f82bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:35.481224 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eeb1e6-f3a1-4be5-ad0e-fb3b60f82bb3 admin admin] PATH_INFO: `/v3/projects/32ef4e205c4f4af496daf9f851ed34da` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:35.481462 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0ddac-5d94-44f8-a582-ddde6440964e service glance] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:35.481965 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0ddac-5d94-44f8-a582-ddde6440964e service glance] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:35.483019 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0ddac-5d94-44f8-a582-ddde6440964e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:35.483163 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eeb1e6-f3a1-4be5-ad0e-fb3b60f82bb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32ef4e205c4f4af496daf9f851ed34da)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:35.485153 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eeb1e6-f3a1-4be5-ad0e-fb3b60f82bb3 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:35.497723 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0ddac-5d94-44f8-a582-ddde6440964e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:35.499755 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0ddac-5d94-44f8-a582-ddde6440964e service glance] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:35.511801 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1033/2069] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:48:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:48:35.513939 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0ddac-5d94-44f8-a582-ddde6440964e service glance] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:35.532506 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0ddac-5d94-44f8-a582-ddde6440964e service glance] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:35.540268 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3404af-a5aa-4302-a8ee-5897598ead3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:35.541046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3404af-a5aa-4302-a8ee-5897598ead3e admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:35.541329 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3404af-a5aa-4302-a8ee-5897598ead3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:35.541611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3404af-a5aa-4302-a8ee-5897598ead3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:35.542375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3404af-a5aa-4302-a8ee-5897598ead3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:35.544163 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3404af-a5aa-4302-a8ee-5897598ead3e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:35.557888 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1034/2070] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:35.564185 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3404af-a5aa-4302-a8ee-5897598ead3e admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:35.578290 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3404af-a5aa-4302-a8ee-5897598ead3e admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:35.587465 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8404e60-fea1-4c9f-b5c1-98ff6704b0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:35.588612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8404e60-fea1-4c9f-b5c1-98ff6704b0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:35.589086 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8404e60-fea1-4c9f-b5c1-98ff6704b0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:35.589574 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8404e60-fea1-4c9f-b5c1-98ff6704b0d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:35.595451 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8404e60-fea1-4c9f-b5c1-98ff6704b0d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:35.597373 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8404e60-fea1-4c9f-b5c1-98ff6704b0d4 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:35.619152 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1035/2071] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:35.625069 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8404e60-fea1-4c9f-b5c1-98ff6704b0d4 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:35.630136 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:35.637762 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-20eeb1e6-f3a1-4be5-ad0e-fb3b60f82bb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32ef4e205c4f4af496daf9f851ed34da', 'request_id': 'req-20eeb1e6-f3a1-4be5-ad0e-fb3b60f82bb3'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:35.641413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8404e60-fea1-4c9f-b5c1-98ff6704b0d4 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:35.650907 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-20eeb1e6-f3a1-4be5-ad0e-fb3b60f82bb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32ef4e205c4f4af496daf9f851ed34da', 'request_id': 'req-20eeb1e6-f3a1-4be5-ad0e-fb3b60f82bb3'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:35.731934 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38c682-b4df-45e3-8db7-c879639dc3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:35.731934 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38c682-b4df-45e3-8db7-c879639dc3e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:35.731934 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38c682-b4df-45e3-8db7-c879639dc3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:35.731934 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38c682-b4df-45e3-8db7-c879639dc3e4 admin admin] PATH_INFO: `/v3/projects/7d456e0d40394c1cb4935d047af02a17/users/6094b08b21ea449eb3d43c4a02336965/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:35.753907 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38c682-b4df-45e3-8db7-c879639dc3e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d456e0d40394c1cb4935d047af02a17, user_id=6094b08b21ea449eb3d43c4a02336965, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:35.758798 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38c682-b4df-45e3-8db7-c879639dc3e4 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:35.806182 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-20eeb1e6-f3a1-4be5-ad0e-fb3b60f82bb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32ef4e205c4f4af496daf9f851ed34da', 'request_id': 'req-20eeb1e6-f3a1-4be5-ad0e-fb3b60f82bb3'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:35.821237 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-20eeb1e6-f3a1-4be5-ad0e-fb3b60f82bb3 admin admin] The token cache is being invalidate because project 32ef4e205c4f4af496daf9f851ed34da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:48:35.821843 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-20eeb1e6-f3a1-4be5-ad0e-fb3b60f82bb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:35.828827 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-20eeb1e6-f3a1-4be5-ad0e-fb3b60f82bb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:35.828827 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1037/2072] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:48:35 2022] DELETE /identity/v3/projects/32ef4e205c4f4af496daf9f851ed34da => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:35.832760 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561b647-6426-4f77-8f60-27419886b0de None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:35.833200 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561b647-6426-4f77-8f60-27419886b0de None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:35.833870 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561b647-6426-4f77-8f60-27419886b0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:35.865377 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-b561b647-6426-4f77-8f60-27419886b0de None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:35.865377 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b561b647-6426-4f77-8f60-27419886b0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:35.885113 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1038/2073] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:48:35.886994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724c87d-cb1b-44a6-8613-8b06306f281d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:35.887428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724c87d-cb1b-44a6-8613-8b06306f281d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:35.887799 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724c87d-cb1b-44a6-8613-8b06306f281d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:35.913268 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1036/2074] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:48:35 2022] PUT /identity/v3/projects/7d456e0d40394c1cb4935d047af02a17/users/6094b08b21ea449eb3d43c4a02336965/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:35.916230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c724c87d-cb1b-44a6-8613-8b06306f281d None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:35.917484 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c724c87d-cb1b-44a6-8613-8b06306f281d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:35.937812 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f4701-57d3-4ebe-9d96-2e534344b98c None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:35.938218 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f4701-57d3-4ebe-9d96-2e534344b98c None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:35.938689 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f4701-57d3-4ebe-9d96-2e534344b98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:35.989144 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-ce9f4701-57d3-4ebe-9d96-2e534344b98c None None] MFA Rules not processed for user `6094b08b21ea449eb3d43c4a02336965`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:35.991094 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ce9f4701-57d3-4ebe-9d96-2e534344b98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:36.008493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1039/2075] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:36.015010 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724c87d-cb1b-44a6-8613-8b06306f281d None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:36.030149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724c87d-cb1b-44a6-8613-8b06306f281d None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:36.036059 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d768e95-a57e-451b-94eb-af594e59c9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:36.036786 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d768e95-a57e-451b-94eb-af594e59c9ed admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:36.037212 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d768e95-a57e-451b-94eb-af594e59c9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:36.037667 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d768e95-a57e-451b-94eb-af594e59c9ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:36.038513 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d768e95-a57e-451b-94eb-af594e59c9ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:48:36.038987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d768e95-a57e-451b-94eb-af594e59c9ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:36.041184 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d768e95-a57e-451b-94eb-af594e59c9ed admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:36.060735 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1040/2076] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:48:36.067078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d768e95-a57e-451b-94eb-af594e59c9ed admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:36.073026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:36.082400 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d768e95-a57e-451b-94eb-af594e59c9ed admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:36.091044 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67798f-7615-402b-b0dc-0ee1177a4b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:36.092254 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67798f-7615-402b-b0dc-0ee1177a4b18 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:36.092700 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67798f-7615-402b-b0dc-0ee1177a4b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:36.093146 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67798f-7615-402b-b0dc-0ee1177a4b18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:36.094310 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67798f-7615-402b-b0dc-0ee1177a4b18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:36.100329 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67798f-7615-402b-b0dc-0ee1177a4b18 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:36.112366 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1037/2077] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:35 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:36.117835 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f4701-57d3-4ebe-9d96-2e534344b98c None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:36.119861 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ce9f4701-57d3-4ebe-9d96-2e534344b98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:36.135309 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f4701-57d3-4ebe-9d96-2e534344b98c None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:36.143240 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ee3a1-3c68-4b90-a805-6a76271d9b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:36.144385 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ee3a1-3c68-4b90-a805-6a76271d9b2b admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:36.144889 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ee3a1-3c68-4b90-a805-6a76271d9b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:36.145294 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ee3a1-3c68-4b90-a805-6a76271d9b2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:36.146439 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ee3a1-3c68-4b90-a805-6a76271d9b2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:36.150688 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ee3a1-3c68-4b90-a805-6a76271d9b2b admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:36.254873 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1041/2078] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:48:36 2022] POST /identity/v3/projects => generated 379 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:48:36.261319 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67798f-7615-402b-b0dc-0ee1177a4b18 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:36.288965 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1038/2079] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:48:36 2022] POST /identity/v3/projects => generated 403 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:48:36.290684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ee3a1-3c68-4b90-a805-6a76271d9b2b admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:36.339535 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67798f-7615-402b-b0dc-0ee1177a4b18 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:36.397290 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ee3a1-3c68-4b90-a805-6a76271d9b2b admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:36.405325 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429251c3-f977-472a-b4f6-1e9dc55e9ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:36.408389 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429251c3-f977-472a-b4f6-1e9dc55e9ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:36.408389 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429251c3-f977-472a-b4f6-1e9dc55e9ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:36.408389 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429251c3-f977-472a-b4f6-1e9dc55e9ca0 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:36.408389 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429251c3-f977-472a-b4f6-1e9dc55e9ca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:36.412214 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429251c3-f977-472a-b4f6-1e9dc55e9ca0 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:36.425649 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cc6a3-5327-4542-99ea-ba6d84d539f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:36.426205 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cc6a3-5327-4542-99ea-ba6d84d539f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:36.426491 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cc6a3-5327-4542-99ea-ba6d84d539f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:36.426778 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cc6a3-5327-4542-99ea-ba6d84d539f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:36.427502 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731cc6a3-5327-4542-99ea-ba6d84d539f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:36.429810 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731cc6a3-5327-4542-99ea-ba6d84d539f2 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:36.538136 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1039/2080] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:48:36 2022] POST /identity/v3/users => generated 308 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:48:36.546210 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429251c3-f977-472a-b4f6-1e9dc55e9ca0 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:36.564336 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429251c3-f977-472a-b4f6-1e9dc55e9ca0 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:36.569235 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be4992-46ae-4394-bee1-4cc34967f5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:36.570310 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be4992-46ae-4394-bee1-4cc34967f5ed admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:36.570484 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:36.570760 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be4992-46ae-4394-bee1-4cc34967f5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:36.571205 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be4992-46ae-4394-bee1-4cc34967f5ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:36.572411 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be4992-46ae-4394-bee1-4cc34967f5ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:36.577734 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be4992-46ae-4394-bee1-4cc34967f5ed admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:36.588029 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1042/2081] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:48:36 2022] POST /identity/v3/users => generated 290 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:48:36.605125 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1040/2082] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:36.611874 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be4992-46ae-4394-bee1-4cc34967f5ed admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:36.618472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cc6a3-5327-4542-99ea-ba6d84d539f2 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:36.639585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be4992-46ae-4394-bee1-4cc34967f5ed admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:36.647293 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cc6a3-5327-4542-99ea-ba6d84d539f2 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:36.650784 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26e159-621c-42c2-be50-d8b13406d963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:36.652556 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26e159-621c-42c2-be50-d8b13406d963 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:36.663011 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26e159-621c-42c2-be50-d8b13406d963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:36.663011 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26e159-621c-42c2-be50-d8b13406d963 admin admin] PATH_INFO: `/v3/projects/9ac4c5b824e94a65b5c5771ba6e588ef/users/3e41518ecd9f4edc9e4f8f21ab36081e/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:36.663449 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3d10c-9de8-49f5-8851-f3010b48cef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:36.663449 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3d10c-9de8-49f5-8851-f3010b48cef0 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:36.663449 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3d10c-9de8-49f5-8851-f3010b48cef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:36.663449 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3d10c-9de8-49f5-8851-f3010b48cef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:36.663822 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3d10c-9de8-49f5-8851-f3010b48cef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:36.665108 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3d10c-9de8-49f5-8851-f3010b48cef0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:36.693026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26e159-621c-42c2-be50-d8b13406d963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac4c5b824e94a65b5c5771ba6e588ef, user_id=3e41518ecd9f4edc9e4f8f21ab36081e, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:36.696688 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26e159-621c-42c2-be50-d8b13406d963 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:36.715039 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1043/2083] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:36.733515 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3d10c-9de8-49f5-8851-f3010b48cef0 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:36.754950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3d10c-9de8-49f5-8851-f3010b48cef0 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:36.764628 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407311ab-3452-448b-b8aa-2c5b02c6d9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:36.765718 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407311ab-3452-448b-b8aa-2c5b02c6d9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:36.766223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407311ab-3452-448b-b8aa-2c5b02c6d9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:36.766710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407311ab-3452-448b-b8aa-2c5b02c6d9b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:36.768067 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407311ab-3452-448b-b8aa-2c5b02c6d9b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:36.771437 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407311ab-3452-448b-b8aa-2c5b02c6d9b8 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:36.794552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1044/2084] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:36.796792 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407311ab-3452-448b-b8aa-2c5b02c6d9b8 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:36.807450 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1041/2085] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:48:36 2022] PUT /identity/v3/projects/9ac4c5b824e94a65b5c5771ba6e588ef/users/3e41518ecd9f4edc9e4f8f21ab36081e/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:48:36.809333 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26e159-621c-42c2-be50-d8b13406d963 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:36.819406 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407311ab-3452-448b-b8aa-2c5b02c6d9b8 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:36.906800 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26e159-621c-42c2-be50-d8b13406d963 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:36.912806 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870f247-28eb-4be8-baf3-12c617c913ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:36.913436 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870f247-28eb-4be8-baf3-12c617c913ee admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:36.913715 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870f247-28eb-4be8-baf3-12c617c913ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:36.913983 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870f247-28eb-4be8-baf3-12c617c913ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:36.914637 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870f247-28eb-4be8-baf3-12c617c913ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:36.916523 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870f247-28eb-4be8-baf3-12c617c913ee admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:36.920851 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7efaf-4884-4268-a20a-a23b7ed20445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:36.923859 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7efaf-4884-4268-a20a-a23b7ed20445 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:36.923859 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7efaf-4884-4268-a20a-a23b7ed20445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:36.923859 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7efaf-4884-4268-a20a-a23b7ed20445 admin admin] PATH_INFO: `/v3/projects/50a3976393304fba993b9691f902d7e1/users/1b9c4b45778b474b8bca24e655edb830/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:36.927985 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1042/2086] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:36.932537 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870f247-28eb-4be8-baf3-12c617c913ee admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:36.940669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a7efaf-4884-4268-a20a-a23b7ed20445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50a3976393304fba993b9691f902d7e1, user_id=1b9c4b45778b474b8bca24e655edb830, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:36.943720 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a7efaf-4884-4268-a20a-a23b7ed20445 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:36.944076 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870f247-28eb-4be8-baf3-12c617c913ee admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:36.949268 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab829766-953f-4381-af68-43744939139c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:36.951560 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab829766-953f-4381-af68-43744939139c admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:36.951560 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab829766-953f-4381-af68-43744939139c admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:36.951560 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab829766-953f-4381-af68-43744939139c admin admin] PATH_INFO: `/v3/projects/9ac4c5b824e94a65b5c5771ba6e588ef/users/3e41518ecd9f4edc9e4f8f21ab36081e/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:36.953927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab829766-953f-4381-af68-43744939139c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac4c5b824e94a65b5c5771ba6e588ef, user_id=3e41518ecd9f4edc9e4f8f21ab36081e, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:36.956858 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab829766-953f-4381-af68-43744939139c admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:36.970652 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1043/2087] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:48:36 2022] PUT /identity/v3/projects/9ac4c5b824e94a65b5c5771ba6e588ef/users/3e41518ecd9f4edc9e4f8f21ab36081e/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:48:36.981827 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930f671-e654-4569-80ec-c1cd9b4c0684 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:36.982134 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930f671-e654-4569-80ec-c1cd9b4c0684 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:36.982417 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930f671-e654-4569-80ec-c1cd9b4c0684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:37.014494 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-d930f671-e654-4569-80ec-c1cd9b4c0684 None None] MFA Rules not processed for user `3e41518ecd9f4edc9e4f8f21ab36081e`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:37.016073 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d930f671-e654-4569-80ec-c1cd9b4c0684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:37.092555 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:37.097837 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1044/2088] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:36 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:48:37.108913 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930f671-e654-4569-80ec-c1cd9b4c0684 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:37.110415 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d930f671-e654-4569-80ec-c1cd9b4c0684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:37.184220 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1045/2089] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:48:36 2022] PUT /identity/v3/projects/50a3976393304fba993b9691f902d7e1/users/1b9c4b45778b474b8bca24e655edb830/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:37.190164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930f671-e654-4569-80ec-c1cd9b4c0684 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:37.191108 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a5f1c-0bc8-41e4-b230-478c2018d5d3 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:37.191416 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a5f1c-0bc8-41e4-b230-478c2018d5d3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:37.191710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a5f1c-0bc8-41e4-b230-478c2018d5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:37.234519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-ab2a5f1c-0bc8-41e4-b230-478c2018d5d3 None None] MFA Rules not processed for user `1b9c4b45778b474b8bca24e655edb830`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:37.235888 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ab2a5f1c-0bc8-41e4-b230-478c2018d5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:37.253359 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52cbcc8-105c-436c-9986-a7cf142c640d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:37.254053 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52cbcc8-105c-436c-9986-a7cf142c640d service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:37.254645 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52cbcc8-105c-436c-9986-a7cf142c640d service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:37.255146 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52cbcc8-105c-436c-9986-a7cf142c640d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:37.337705 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1046/2090] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:37.346816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a5f1c-0bc8-41e4-b230-478c2018d5d3 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:37.368957 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52cbcc8-105c-436c-9986-a7cf142c640d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:37.371048 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52cbcc8-105c-436c-9986-a7cf142c640d service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:37.383200 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1045/2091] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:48:37 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:48:37.449029 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:37.469538 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a5f1c-0bc8-41e4-b230-478c2018d5d3 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:37.480629 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18f619-e024-4903-8ada-bf00014a5c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:37.483581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18f619-e024-4903-8ada-bf00014a5c09 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:37.484057 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18f619-e024-4903-8ada-bf00014a5c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:37.484855 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18f619-e024-4903-8ada-bf00014a5c09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:37.485548 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18f619-e024-4903-8ada-bf00014a5c09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:37.490230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18f619-e024-4903-8ada-bf00014a5c09 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:37.513784 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:37.600485 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52cbcc8-105c-436c-9986-a7cf142c640d service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:37.615670 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52cbcc8-105c-436c-9986-a7cf142c640d service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:37.621372 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e80121-e3ae-44a0-880a-a45db031c520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:37.622030 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e80121-e3ae-44a0-880a-a45db031c520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:37.622460 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e80121-e3ae-44a0-880a-a45db031c520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:37.623170 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e80121-e3ae-44a0-880a-a45db031c520 admin admin] PATH_INFO: `/v3/users/6094b08b21ea449eb3d43c4a02336965` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:37.627591 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e80121-e3ae-44a0-880a-a45db031c520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6094b08b21ea449eb3d43c4a02336965)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:37.627591 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e80121-e3ae-44a0-880a-a45db031c520 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:37.675148 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1047/2092] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:48:37 2022] POST /identity/v3/projects => generated 383 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:48:37.677387 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18f619-e024-4903-8ada-bf00014a5c09 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:37.799651 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18f619-e024-4903-8ada-bf00014a5c09 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:37.808895 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd8fa4-3ebc-423c-8064-e6c8694fe07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:37.810061 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd8fa4-3ebc-423c-8064-e6c8694fe07a admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:37.810979 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd8fa4-3ebc-423c-8064-e6c8694fe07a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:37.811437 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd8fa4-3ebc-423c-8064-e6c8694fe07a admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:37.812380 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd8fa4-3ebc-423c-8064-e6c8694fe07a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:37.815075 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd8fa4-3ebc-423c-8064-e6c8694fe07a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:37.985721 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:37.988656 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-99e80121-e3ae-44a0-880a-a45db031c520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6094b08b21ea449eb3d43c4a02336965'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:37.990069 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-99e80121-e3ae-44a0-880a-a45db031c520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6094b08b21ea449eb3d43c4a02336965'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:37.992377 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1048/2093] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:48:37 2022] POST /identity/v3/users => generated 298 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:48:37.998141 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd8fa4-3ebc-423c-8064-e6c8694fe07a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:38.006068 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-99e80121-e3ae-44a0-880a-a45db031c520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6094b08b21ea449eb3d43c4a02336965'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:38.007198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-99e80121-e3ae-44a0-880a-a45db031c520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6094b08b21ea449eb3d43c4a02336965'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:38.012828 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd8fa4-3ebc-423c-8064-e6c8694fe07a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:38.020342 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2e65b-bc5e-42f0-89d3-ad983c20b23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:38.021348 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2e65b-bc5e-42f0-89d3-ad983c20b23f admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:38.021851 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2e65b-bc5e-42f0-89d3-ad983c20b23f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:38.022321 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2e65b-bc5e-42f0-89d3-ad983c20b23f admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:38.023283 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af2e65b-bc5e-42f0-89d3-ad983c20b23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:38.025131 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af2e65b-bc5e-42f0-89d3-ad983c20b23f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:38.039405 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1049/2094] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:48:38.045047 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2e65b-bc5e-42f0-89d3-ad983c20b23f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:38.047163 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4af2e65b-bc5e-42f0-89d3-ad983c20b23f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:38.072945 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2e65b-bc5e-42f0-89d3-ad983c20b23f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:38.083047 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf3dbd-e208-4042-acf5-58d0d8972edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:38.084565 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf3dbd-e208-4042-acf5-58d0d8972edc admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:38.085465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf3dbd-e208-4042-acf5-58d0d8972edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:38.086070 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf3dbd-e208-4042-acf5-58d0d8972edc admin admin] PATH_INFO: `/v3/projects/2873e8e45f26489fba10279f3a7adaa4/users/02a9404f27064d3dae88f2f1af2d9cb4/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:38.090824 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:38.120539 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-99e80121-e3ae-44a0-880a-a45db031c520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6094b08b21ea449eb3d43c4a02336965'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:38.120785 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf3dbd-e208-4042-acf5-58d0d8972edc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2873e8e45f26489fba10279f3a7adaa4, user_id=02a9404f27064d3dae88f2f1af2d9cb4, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:38.127152 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf3dbd-e208-4042-acf5-58d0d8972edc admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:38.151642 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1046/2095] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:48:37 2022] DELETE /identity/v3/users/6094b08b21ea449eb3d43c4a02336965 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:38.164381 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89772eca-7f29-4924-968c-1dceee155136 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:38.164657 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89772eca-7f29-4924-968c-1dceee155136 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:38.164927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89772eca-7f29-4924-968c-1dceee155136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:38.188144 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-89772eca-7f29-4924-968c-1dceee155136 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:38.190916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-89772eca-7f29-4924-968c-1dceee155136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:38.270843 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1047/2096] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:48:38.288544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89772eca-7f29-4924-968c-1dceee155136 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:38.290752 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-89772eca-7f29-4924-968c-1dceee155136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:38.294057 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1050/2097] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:48:38 2022] PUT /identity/v3/projects/2873e8e45f26489fba10279f3a7adaa4/users/02a9404f27064d3dae88f2f1af2d9cb4/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:48:38.300858 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf3dbd-e208-4042-acf5-58d0d8972edc admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:38.379996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89772eca-7f29-4924-968c-1dceee155136 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:38.400409 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:38.412874 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf3dbd-e208-4042-acf5-58d0d8972edc admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:38.421803 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed47ea-f6a8-4590-ac7e-41202c638d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:38.423189 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed47ea-f6a8-4590-ac7e-41202c638d0e admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:38.423189 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed47ea-f6a8-4590-ac7e-41202c638d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:38.423544 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed47ea-f6a8-4590-ac7e-41202c638d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:38.424838 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed47ea-f6a8-4590-ac7e-41202c638d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:38.428511 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed47ea-f6a8-4590-ac7e-41202c638d0e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:38.450746 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1051/2098] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:48:38.457588 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed47ea-f6a8-4590-ac7e-41202c638d0e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:38.487503 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:38.505838 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed47ea-f6a8-4590-ac7e-41202c638d0e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:38.514275 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224613c9-7384-406d-991b-083e13d5f7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:38.514585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a5a30-a73d-490c-869e-192e264930e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:38.515450 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224613c9-7384-406d-991b-083e13d5f7bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:38.515821 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224613c9-7384-406d-991b-083e13d5f7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:38.516021 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a5a30-a73d-490c-869e-192e264930e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:38.516269 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224613c9-7384-406d-991b-083e13d5f7bf admin admin] PATH_INFO: `/v3/projects/2873e8e45f26489fba10279f3a7adaa4/users/02a9404f27064d3dae88f2f1af2d9cb4/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:38.516650 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a5a30-a73d-490c-869e-192e264930e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:38.517227 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a5a30-a73d-490c-869e-192e264930e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:38.519237 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224613c9-7384-406d-991b-083e13d5f7bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2873e8e45f26489fba10279f3a7adaa4, user_id=02a9404f27064d3dae88f2f1af2d9cb4, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:38.523970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224613c9-7384-406d-991b-083e13d5f7bf admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:38.533708 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a5a30-a73d-490c-869e-192e264930e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:38.535469 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a5a30-a73d-490c-869e-192e264930e4 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:38.544246 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1052/2099] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:48:38 2022] PUT /identity/v3/projects/2873e8e45f26489fba10279f3a7adaa4/users/02a9404f27064d3dae88f2f1af2d9cb4/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:38.550124 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1048/2100] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:48:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:48:38.579434 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5dc01-5204-498b-b163-72ec99dc8366 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:38.579918 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5dc01-5204-498b-b163-72ec99dc8366 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:38.580390 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5dc01-5204-498b-b163-72ec99dc8366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:38.629326 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-8ab5dc01-5204-498b-b163-72ec99dc8366 None None] MFA Rules not processed for user `02a9404f27064d3dae88f2f1af2d9cb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:38.630962 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8ab5dc01-5204-498b-b163-72ec99dc8366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:38.730913 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1053/2101] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:38.743881 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a5a30-a73d-490c-869e-192e264930e4 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:38.745510 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c82a5a30-a73d-490c-869e-192e264930e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:38.829861 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a5a30-a73d-490c-869e-192e264930e4 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:38.946912 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596872e-87d2-4e4d-86f1-2abd90cf09f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:38.948170 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596872e-87d2-4e4d-86f1-2abd90cf09f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:38.948656 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596872e-87d2-4e4d-86f1-2abd90cf09f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:38.949147 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596872e-87d2-4e4d-86f1-2abd90cf09f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:38.972209 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:38.977013 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e596872e-87d2-4e4d-86f1-2abd90cf09f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:38.980000 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e596872e-87d2-4e4d-86f1-2abd90cf09f9 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:38.999976 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1049/2102] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:48:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:48:39.214148 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5dc01-5204-498b-b163-72ec99dc8366 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:39.214148 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8ab5dc01-5204-498b-b163-72ec99dc8366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:39.260690 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:39.280168 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596872e-87d2-4e4d-86f1-2abd90cf09f9 service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:39.295417 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596872e-87d2-4e4d-86f1-2abd90cf09f9 service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:39.302879 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbbfa13-f151-49c6-b20c-81804b3592be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:39.303726 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbbfa13-f151-49c6-b20c-81804b3592be service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:39.308551 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbbfa13-f151-49c6-b20c-81804b3592be service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:39.308551 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbbfa13-f151-49c6-b20c-81804b3592be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:39.308551 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-bfbbfa13-f151-49c6-b20c-81804b3592be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:39.371706 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5dc01-5204-498b-b163-72ec99dc8366 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:39.380739 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b3aed-d709-4a4d-af76-6f5b615f8da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:39.382206 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b3aed-d709-4a4d-af76-6f5b615f8da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:39.382373 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b3aed-d709-4a4d-af76-6f5b615f8da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:39.383118 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b3aed-d709-4a4d-af76-6f5b615f8da8 admin admin] PATH_INFO: `/v3/projects/7d456e0d40394c1cb4935d047af02a17` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:39.385409 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b3aed-d709-4a4d-af76-6f5b615f8da8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d456e0d40394c1cb4935d047af02a17)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:39.389905 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b3aed-d709-4a4d-af76-6f5b615f8da8 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:39.410202 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbbfa13-f151-49c6-b20c-81804b3592be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:39.412088 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbbfa13-f151-49c6-b20c-81804b3592be service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:39.433977 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1050/2103] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:48:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:48:39.550132 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f49b3aed-d709-4a4d-af76-6f5b615f8da8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d456e0d40394c1cb4935d047af02a17', 'request_id': 'req-f49b3aed-d709-4a4d-af76-6f5b615f8da8'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:39.556882 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f49b3aed-d709-4a4d-af76-6f5b615f8da8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d456e0d40394c1cb4935d047af02a17', 'request_id': 'req-f49b3aed-d709-4a4d-af76-6f5b615f8da8'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:39.696720 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f49b3aed-d709-4a4d-af76-6f5b615f8da8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d456e0d40394c1cb4935d047af02a17', 'request_id': 'req-f49b3aed-d709-4a4d-af76-6f5b615f8da8'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:39.713804 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f49b3aed-d709-4a4d-af76-6f5b615f8da8 admin admin] The token cache is being invalidate because project 7d456e0d40394c1cb4935d047af02a17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:48:39.714182 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f49b3aed-d709-4a4d-af76-6f5b615f8da8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:39.717149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f49b3aed-d709-4a4d-af76-6f5b615f8da8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:39.717149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1054/2104] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:48:39 2022] DELETE /identity/v3/projects/7d456e0d40394c1cb4935d047af02a17 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:39.720992 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbbfa13-f151-49c6-b20c-81804b3592be service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:39.733739 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbbfa13-f151-49c6-b20c-81804b3592be service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:39.814373 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75752c0a-cd13-4d42-97ad-536f48a98d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:39.817274 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75752c0a-cd13-4d42-97ad-536f48a98d4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:39.817601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75752c0a-cd13-4d42-97ad-536f48a98d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:39.817844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75752c0a-cd13-4d42-97ad-536f48a98d4f admin admin] PATH_INFO: `/v3/users/3e41518ecd9f4edc9e4f8f21ab36081e` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:39.820587 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75752c0a-cd13-4d42-97ad-536f48a98d4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e41518ecd9f4edc9e4f8f21ab36081e)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:39.822665 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75752c0a-cd13-4d42-97ad-536f48a98d4f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:40.072456 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:40.127773 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b3aed-d709-4a4d-af76-6f5b615f8da8 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:40.129193 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-75752c0a-cd13-4d42-97ad-536f48a98d4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e41518ecd9f4edc9e4f8f21ab36081e'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:40.130477 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-75752c0a-cd13-4d42-97ad-536f48a98d4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e41518ecd9f4edc9e4f8f21ab36081e'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:40.137005 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f49b3aed-d709-4a4d-af76-6f5b615f8da8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:40.145801 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-75752c0a-cd13-4d42-97ad-536f48a98d4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e41518ecd9f4edc9e4f8f21ab36081e'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:40.146962 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-75752c0a-cd13-4d42-97ad-536f48a98d4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e41518ecd9f4edc9e4f8f21ab36081e'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:40.154146 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b3aed-d709-4a4d-af76-6f5b615f8da8 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:40.159733 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd8d88-379c-484a-947f-8b851fe166fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:40.160389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd8d88-379c-484a-947f-8b851fe166fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:40.160674 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd8d88-379c-484a-947f-8b851fe166fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:40.160958 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd8d88-379c-484a-947f-8b851fe166fe admin admin] PATH_INFO: `/v3/users/1b9c4b45778b474b8bca24e655edb830` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:40.162182 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd8d88-379c-484a-947f-8b851fe166fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b9c4b45778b474b8bca24e655edb830)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:40.164318 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd8d88-379c-484a-947f-8b851fe166fe admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:40.298581 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-75752c0a-cd13-4d42-97ad-536f48a98d4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e41518ecd9f4edc9e4f8f21ab36081e'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:40.327935 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1051/2105] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:48:39 2022] DELETE /identity/v3/users/3e41518ecd9f4edc9e4f8f21ab36081e => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:40.440775 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9edd8d88-379c-484a-947f-8b851fe166fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b9c4b45778b474b8bca24e655edb830'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:40.532218 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9edd8d88-379c-484a-947f-8b851fe166fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b9c4b45778b474b8bca24e655edb830'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:40.533340 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9edd8d88-379c-484a-947f-8b851fe166fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b9c4b45778b474b8bca24e655edb830'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:40.534325 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9edd8d88-379c-484a-947f-8b851fe166fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b9c4b45778b474b8bca24e655edb830'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:40.566393 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9edd8d88-379c-484a-947f-8b851fe166fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b9c4b45778b474b8bca24e655edb830'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:40.569075 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:40.619664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1055/2106] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:48:40 2022] DELETE /identity/v3/users/1b9c4b45778b474b8bca24e655edb830 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:48:40.628083 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784430d6-59ba-45ee-8b1e-7c3f3aeb7656 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:40.628605 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784430d6-59ba-45ee-8b1e-7c3f3aeb7656 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:40.639123 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784430d6-59ba-45ee-8b1e-7c3f3aeb7656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:40.669100 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-784430d6-59ba-45ee-8b1e-7c3f3aeb7656 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:40.689289 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-784430d6-59ba-45ee-8b1e-7c3f3aeb7656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:40.838363 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1052/2107] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:40.849882 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd8d88-379c-484a-947f-8b851fe166fe admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:40.851452 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9edd8d88-379c-484a-947f-8b851fe166fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:40.923721 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd8d88-379c-484a-947f-8b851fe166fe admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:40.927908 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f03a06-b2f5-4c89-8230-891bfdbb9b6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:40.928624 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f03a06-b2f5-4c89-8230-891bfdbb9b6c service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:40.928906 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f03a06-b2f5-4c89-8230-891bfdbb9b6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:40.929185 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f03a06-b2f5-4c89-8230-891bfdbb9b6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:40.941141 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f03a06-b2f5-4c89-8230-891bfdbb9b6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:40.942729 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f03a06-b2f5-4c89-8230-891bfdbb9b6c service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:40.953732 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784430d6-59ba-45ee-8b1e-7c3f3aeb7656 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:40.953732 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-784430d6-59ba-45ee-8b1e-7c3f3aeb7656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:40.955599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1056/2108] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:48:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:48:40.969604 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784430d6-59ba-45ee-8b1e-7c3f3aeb7656 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:40.984211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e4676-e3d9-43b0-94e3-e8e417fdaea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:40.984884 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e4676-e3d9-43b0-94e3-e8e417fdaea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:40.985255 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e4676-e3d9-43b0-94e3-e8e417fdaea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:40.985444 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e4676-e3d9-43b0-94e3-e8e417fdaea5 admin admin] PATH_INFO: `/v3/projects/9ac4c5b824e94a65b5c5771ba6e588ef` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:40.986715 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e4676-e3d9-43b0-94e3-e8e417fdaea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ac4c5b824e94a65b5c5771ba6e588ef)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:40.988889 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e4676-e3d9-43b0-94e3-e8e417fdaea5 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:41.157469 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e95e4676-e3d9-43b0-94e3-e8e417fdaea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ac4c5b824e94a65b5c5771ba6e588ef', 'request_id': 'req-e95e4676-e3d9-43b0-94e3-e8e417fdaea5'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:41.165272 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e95e4676-e3d9-43b0-94e3-e8e417fdaea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ac4c5b824e94a65b5c5771ba6e588ef', 'request_id': 'req-e95e4676-e3d9-43b0-94e3-e8e417fdaea5'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:41.236027 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e95e4676-e3d9-43b0-94e3-e8e417fdaea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ac4c5b824e94a65b5c5771ba6e588ef', 'request_id': 'req-e95e4676-e3d9-43b0-94e3-e8e417fdaea5'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:41.254253 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e95e4676-e3d9-43b0-94e3-e8e417fdaea5 admin admin] The token cache is being invalidate because project 9ac4c5b824e94a65b5c5771ba6e588ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:48:41.254712 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e95e4676-e3d9-43b0-94e3-e8e417fdaea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:41.255783 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e95e4676-e3d9-43b0-94e3-e8e417fdaea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:41.257863 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1053/2109] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:48:40 2022] DELETE /identity/v3/projects/9ac4c5b824e94a65b5c5771ba6e588ef => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:41.265242 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff9045-f572-47bc-94de-9988e82344db None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:41.265534 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff9045-f572-47bc-94de-9988e82344db None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:41.265926 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff9045-f572-47bc-94de-9988e82344db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:41.291179 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-6dff9045-f572-47bc-94de-9988e82344db None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:41.292649 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6dff9045-f572-47bc-94de-9988e82344db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:41.378964 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1057/2110] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:48:41.391280 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371c68e-7c21-466b-b525-2acd75110d1c None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:41.391995 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371c68e-7c21-466b-b525-2acd75110d1c None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:41.392433 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371c68e-7c21-466b-b525-2acd75110d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:41.417646 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-1371c68e-7c21-466b-b525-2acd75110d1c None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:41.419164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1371c68e-7c21-466b-b525-2acd75110d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:41.431372 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1054/2111] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:41.435766 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff9045-f572-47bc-94de-9988e82344db None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:41.447940 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff9045-f572-47bc-94de-9988e82344db None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:41.453153 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e23384-4542-4e62-a531-417052dcca05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:41.453780 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e23384-4542-4e62-a531-417052dcca05 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:41.454049 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e23384-4542-4e62-a531-417052dcca05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:41.454320 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e23384-4542-4e62-a531-417052dcca05 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:41.454980 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e23384-4542-4e62-a531-417052dcca05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:48:41.455315 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e23384-4542-4e62-a531-417052dcca05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:41.456973 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e23384-4542-4e62-a531-417052dcca05 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:41.470598 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1058/2112] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:48:41.475708 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371c68e-7c21-466b-b525-2acd75110d1c None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:41.486641 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371c68e-7c21-466b-b525-2acd75110d1c None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:41.493160 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d139b93-6796-4b22-9f62-25a6a5b02f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:41.493819 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d139b93-6796-4b22-9f62-25a6a5b02f3e admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:41.494148 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d139b93-6796-4b22-9f62-25a6a5b02f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:41.494427 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d139b93-6796-4b22-9f62-25a6a5b02f3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:41.495416 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d139b93-6796-4b22-9f62-25a6a5b02f3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:41.497413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d139b93-6796-4b22-9f62-25a6a5b02f3e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:41.515155 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:41.739871 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1055/2113] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:48:41 2022] POST /identity/v3/projects => generated 361 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:48:41.744193 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e23384-4542-4e62-a531-417052dcca05 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:41.755844 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e23384-4542-4e62-a531-417052dcca05 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:41.803572 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d139b93-6796-4b22-9f62-25a6a5b02f3e admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:41.804086 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-8d139b93-6796-4b22-9f62-25a6a5b02f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:41.844042 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404afb0c-07de-4ff5-ad70-c96fa8071123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:41.844672 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404afb0c-07de-4ff5-ad70-c96fa8071123 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:41.844959 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404afb0c-07de-4ff5-ad70-c96fa8071123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:41.845313 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404afb0c-07de-4ff5-ad70-c96fa8071123 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:41.845925 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404afb0c-07de-4ff5-ad70-c96fa8071123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:41.848045 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404afb0c-07de-4ff5-ad70-c96fa8071123 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:41.916341 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d139b93-6796-4b22-9f62-25a6a5b02f3e admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:41.924916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d995e-4632-435a-92dc-c64ac3e6d659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:41.933039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d995e-4632-435a-92dc-c64ac3e6d659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:41.933039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d995e-4632-435a-92dc-c64ac3e6d659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:41.933039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d995e-4632-435a-92dc-c64ac3e6d659 admin admin] PATH_INFO: `/v3/projects/50a3976393304fba993b9691f902d7e1` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:41.933039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d995e-4632-435a-92dc-c64ac3e6d659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50a3976393304fba993b9691f902d7e1)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:41.934325 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d995e-4632-435a-92dc-c64ac3e6d659 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:41.959323 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:41.979568 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1059/2114] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:48:41 2022] POST /identity/v3/users => generated 281 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:48:41.984516 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404afb0c-07de-4ff5-ad70-c96fa8071123 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:42.015310 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404afb0c-07de-4ff5-ad70-c96fa8071123 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:42.024988 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac93993-7528-4e28-90b7-48d7b5ea928b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:42.025558 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac93993-7528-4e28-90b7-48d7b5ea928b admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:42.026089 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac93993-7528-4e28-90b7-48d7b5ea928b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:42.026630 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac93993-7528-4e28-90b7-48d7b5ea928b admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:42.028609 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac93993-7528-4e28-90b7-48d7b5ea928b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:42.031760 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac93993-7528-4e28-90b7-48d7b5ea928b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:42.053885 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1060/2115] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:42.054638 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac93993-7528-4e28-90b7-48d7b5ea928b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:42.077978 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac93993-7528-4e28-90b7-48d7b5ea928b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:42.085472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491248c-c49e-41a7-af48-4fc339b43099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:42.087936 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491248c-c49e-41a7-af48-4fc339b43099 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:42.087936 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491248c-c49e-41a7-af48-4fc339b43099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:42.088870 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491248c-c49e-41a7-af48-4fc339b43099 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:42.090268 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491248c-c49e-41a7-af48-4fc339b43099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:42.092610 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491248c-c49e-41a7-af48-4fc339b43099 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:42.117238 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1061/2116] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:48:42.124257 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491248c-c49e-41a7-af48-4fc339b43099 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:42.144340 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491248c-c49e-41a7-af48-4fc339b43099 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:42.154635 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce49ae8-4b10-4918-8cb1-30a7d034f6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:42.156440 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce49ae8-4b10-4918-8cb1-30a7d034f6eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:42.157374 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce49ae8-4b10-4918-8cb1-30a7d034f6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:42.158392 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce49ae8-4b10-4918-8cb1-30a7d034f6eb admin admin] PATH_INFO: `/v3/projects/99ee3fe9f0834d258aad473f5c211802/users/5c32bfec2bf54840aa31579c50f66499/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:42.210929 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce49ae8-4b10-4918-8cb1-30a7d034f6eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=99ee3fe9f0834d258aad473f5c211802, user_id=5c32bfec2bf54840aa31579c50f66499, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:42.215902 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4c2d995e-4632-435a-92dc-c64ac3e6d659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50a3976393304fba993b9691f902d7e1', 'request_id': 'req-4c2d995e-4632-435a-92dc-c64ac3e6d659'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:42.223775 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce49ae8-4b10-4918-8cb1-30a7d034f6eb admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:42.233819 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4c2d995e-4632-435a-92dc-c64ac3e6d659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50a3976393304fba993b9691f902d7e1', 'request_id': 'req-4c2d995e-4632-435a-92dc-c64ac3e6d659'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:42.309353 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1062/2117] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:48:42 2022] PUT /identity/v3/projects/99ee3fe9f0834d258aad473f5c211802/users/5c32bfec2bf54840aa31579c50f66499/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:42.320736 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef13776-5f4d-45a4-98e7-677c90b1343d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:42.321018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef13776-5f4d-45a4-98e7-677c90b1343d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:42.321294 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef13776-5f4d-45a4-98e7-677c90b1343d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:42.355519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-8ef13776-5f4d-45a4-98e7-677c90b1343d None None] MFA Rules not processed for user `5c32bfec2bf54840aa31579c50f66499`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:42.356812 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8ef13776-5f4d-45a4-98e7-677c90b1343d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:42.366669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4c2d995e-4632-435a-92dc-c64ac3e6d659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50a3976393304fba993b9691f902d7e1', 'request_id': 'req-4c2d995e-4632-435a-92dc-c64ac3e6d659'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:42.391869 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4c2d995e-4632-435a-92dc-c64ac3e6d659 admin admin] The token cache is being invalidate because project 50a3976393304fba993b9691f902d7e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:48:42.392194 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4c2d995e-4632-435a-92dc-c64ac3e6d659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:42.392885 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4c2d995e-4632-435a-92dc-c64ac3e6d659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:42.394781 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1056/2118] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:48:41 2022] DELETE /identity/v3/projects/50a3976393304fba993b9691f902d7e1 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:42.400516 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d995e-4632-435a-92dc-c64ac3e6d659 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:42.402165 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4c2d995e-4632-435a-92dc-c64ac3e6d659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:42.457844 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1063/2119] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:48:42.464593 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef13776-5f4d-45a4-98e7-677c90b1343d None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:42.466391 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8ef13776-5f4d-45a4-98e7-677c90b1343d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:42.492125 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d995e-4632-435a-92dc-c64ac3e6d659 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:42.574526 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef13776-5f4d-45a4-98e7-677c90b1343d None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:42.578409 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3556033-64d2-4c3e-a28e-e4433a9d37e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:42.579765 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3556033-64d2-4c3e-a28e-e4433a9d37e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:42.580346 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3556033-64d2-4c3e-a28e-e4433a9d37e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:42.581035 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e582db-72fd-4840-9c51-e0fc96ee0b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:42.581167 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3556033-64d2-4c3e-a28e-e4433a9d37e6 admin admin] PATH_INFO: `/v3/users/02a9404f27064d3dae88f2f1af2d9cb4` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:42.582126 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e582db-72fd-4840-9c51-e0fc96ee0b05 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:42.582635 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e582db-72fd-4840-9c51-e0fc96ee0b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:42.583131 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e582db-72fd-4840-9c51-e0fc96ee0b05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:42.585147 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3556033-64d2-4c3e-a28e-e4433a9d37e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02a9404f27064d3dae88f2f1af2d9cb4)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:42.585257 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e582db-72fd-4840-9c51-e0fc96ee0b05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:42.587770 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3556033-64d2-4c3e-a28e-e4433a9d37e6 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:42.588654 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e582db-72fd-4840-9c51-e0fc96ee0b05 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:42.712519 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:42.722180 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1064/2120] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:48:42 2022] POST /identity/v3/projects => generated 365 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:48:42.726971 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e582db-72fd-4840-9c51-e0fc96ee0b05 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:42.831372 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e582db-72fd-4840-9c51-e0fc96ee0b05 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:42.839661 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14027cee-68f2-4c6e-84bf-060ee60da98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:42.840677 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14027cee-68f2-4c6e-84bf-060ee60da98f admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:42.841137 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14027cee-68f2-4c6e-84bf-060ee60da98f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:42.841601 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14027cee-68f2-4c6e-84bf-060ee60da98f admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:42.842655 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14027cee-68f2-4c6e-84bf-060ee60da98f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:42.845966 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14027cee-68f2-4c6e-84bf-060ee60da98f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:42.881318 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a3556033-64d2-4c3e-a28e-e4433a9d37e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02a9404f27064d3dae88f2f1af2d9cb4'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:42.882829 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a3556033-64d2-4c3e-a28e-e4433a9d37e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02a9404f27064d3dae88f2f1af2d9cb4'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:42.894431 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a3556033-64d2-4c3e-a28e-e4433a9d37e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02a9404f27064d3dae88f2f1af2d9cb4'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:42.895220 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a3556033-64d2-4c3e-a28e-e4433a9d37e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02a9404f27064d3dae88f2f1af2d9cb4'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:42.932798 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1065/2121] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:48:42 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:48:42.938599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14027cee-68f2-4c6e-84bf-060ee60da98f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:42.941480 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-14027cee-68f2-4c6e-84bf-060ee60da98f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:42.962942 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14027cee-68f2-4c6e-84bf-060ee60da98f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:42.968707 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99675d4a-ee47-4946-9f22-881ca715bf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:42.969334 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99675d4a-ee47-4946-9f22-881ca715bf6e admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:42.969611 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99675d4a-ee47-4946-9f22-881ca715bf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:42.969892 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99675d4a-ee47-4946-9f22-881ca715bf6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:42.970703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99675d4a-ee47-4946-9f22-881ca715bf6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:42.973289 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99675d4a-ee47-4946-9f22-881ca715bf6e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:42.987546 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1066/2122] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:48:42.995662 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99675d4a-ee47-4946-9f22-881ca715bf6e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:43.012407 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99675d4a-ee47-4946-9f22-881ca715bf6e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:43.016923 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a3556033-64d2-4c3e-a28e-e4433a9d37e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02a9404f27064d3dae88f2f1af2d9cb4'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:43.022740 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b5c5b-26bf-4446-9bda-569230d9d49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:43.023703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b5c5b-26bf-4446-9bda-569230d9d49f admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:43.024146 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b5c5b-26bf-4446-9bda-569230d9d49f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:43.024581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b5c5b-26bf-4446-9bda-569230d9d49f admin admin] PATH_INFO: `/v3/projects/727a50e0a72b4b0e93b69a271289a229/users/16831bf01fc344d3b7cb29ec396fc9b7/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:43.043961 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b5c5b-26bf-4446-9bda-569230d9d49f admin admin] RBAC: Authorizing `identity:create_grant(project_id=727a50e0a72b4b0e93b69a271289a229, user_id=16831bf01fc344d3b7cb29ec396fc9b7, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:43.046535 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1057/2123] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:48:42 2022] DELETE /identity/v3/users/02a9404f27064d3dae88f2f1af2d9cb4 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:43.046826 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b5c5b-26bf-4446-9bda-569230d9d49f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:43.144131 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1067/2124] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:48:42 2022] PUT /identity/v3/projects/727a50e0a72b4b0e93b69a271289a229/users/16831bf01fc344d3b7cb29ec396fc9b7/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:48:43.148246 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3556033-64d2-4c3e-a28e-e4433a9d37e6 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:43.266458 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:43.267897 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3556033-64d2-4c3e-a28e-e4433a9d37e6 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:43.382022 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8ce2d-15e0-45a8-a968-6515bd9e84eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:43.383569 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8ce2d-15e0-45a8-a968-6515bd9e84eb admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:43.384348 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8ce2d-15e0-45a8-a968-6515bd9e84eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:43.385048 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8ce2d-15e0-45a8-a968-6515bd9e84eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:43.386475 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8ce2d-15e0-45a8-a968-6515bd9e84eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:43.390026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8ce2d-15e0-45a8-a968-6515bd9e84eb admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:43.418850 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1058/2125] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:43.421694 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b5c5b-26bf-4446-9bda-569230d9d49f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:43.440921 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b5c5b-26bf-4446-9bda-569230d9d49f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:43.450274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72793eb8-cfea-4542-8d13-3de9be139d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:43.451419 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72793eb8-cfea-4542-8d13-3de9be139d6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:43.452112 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72793eb8-cfea-4542-8d13-3de9be139d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:43.452809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72793eb8-cfea-4542-8d13-3de9be139d6b admin admin] PATH_INFO: `/v3/projects/727a50e0a72b4b0e93b69a271289a229/users/16831bf01fc344d3b7cb29ec396fc9b7/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:43.457504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72793eb8-cfea-4542-8d13-3de9be139d6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=727a50e0a72b4b0e93b69a271289a229, user_id=16831bf01fc344d3b7cb29ec396fc9b7, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:43.464735 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72793eb8-cfea-4542-8d13-3de9be139d6b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:43.498669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1068/2126] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:48:43 2022] PUT /identity/v3/projects/727a50e0a72b4b0e93b69a271289a229/users/16831bf01fc344d3b7cb29ec396fc9b7/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:48:43.518241 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8e6bc-7021-499a-9c54-9a7c3d0a30bd None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:43.518792 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8e6bc-7021-499a-9c54-9a7c3d0a30bd None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:43.519103 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8e6bc-7021-499a-9c54-9a7c3d0a30bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:43.577319 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-ecd8e6bc-7021-499a-9c54-9a7c3d0a30bd None None] MFA Rules not processed for user `16831bf01fc344d3b7cb29ec396fc9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:43.583049 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ecd8e6bc-7021-499a-9c54-9a7c3d0a30bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:43.687218 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72793eb8-cfea-4542-8d13-3de9be139d6b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:43.689812 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-72793eb8-cfea-4542-8d13-3de9be139d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:43.712951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1059/2127] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:43 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:43.724622 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8e6bc-7021-499a-9c54-9a7c3d0a30bd None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:43.733490 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ecd8e6bc-7021-499a-9c54-9a7c3d0a30bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:43.805739 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72793eb8-cfea-4542-8d13-3de9be139d6b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:43.817606 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8e6bc-7021-499a-9c54-9a7c3d0a30bd None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:43.820100 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e173109-98d1-45e9-beaa-05dbdee4057b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:43.820889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e173109-98d1-45e9-beaa-05dbdee4057b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:43.821257 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e173109-98d1-45e9-beaa-05dbdee4057b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:43.821622 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e173109-98d1-45e9-beaa-05dbdee4057b admin admin] PATH_INFO: `/v3/projects/2873e8e45f26489fba10279f3a7adaa4` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:43.822687 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07666a3-d296-4472-b86a-7f42af05932a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:43.823372 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e173109-98d1-45e9-beaa-05dbdee4057b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2873e8e45f26489fba10279f3a7adaa4)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:43.823544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07666a3-d296-4472-b86a-7f42af05932a service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:43.828990 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07666a3-d296-4472-b86a-7f42af05932a service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:43.828990 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07666a3-d296-4472-b86a-7f42af05932a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:43.829342 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e173109-98d1-45e9-beaa-05dbdee4057b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:43.837641 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07666a3-d296-4472-b86a-7f42af05932a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:43.839523 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07666a3-d296-4472-b86a-7f42af05932a service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:43.856302 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1060/2128] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:48:43 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:48:43.976354 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:43.996659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4e173109-98d1-45e9-beaa-05dbdee4057b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2873e8e45f26489fba10279f3a7adaa4', 'request_id': 'req-4e173109-98d1-45e9-beaa-05dbdee4057b'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:44.009759 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4e173109-98d1-45e9-beaa-05dbdee4057b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2873e8e45f26489fba10279f3a7adaa4', 'request_id': 'req-4e173109-98d1-45e9-beaa-05dbdee4057b'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:44.080176 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4e173109-98d1-45e9-beaa-05dbdee4057b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2873e8e45f26489fba10279f3a7adaa4', 'request_id': 'req-4e173109-98d1-45e9-beaa-05dbdee4057b'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:44.094272 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4e173109-98d1-45e9-beaa-05dbdee4057b admin admin] The token cache is being invalidate because project 2873e8e45f26489fba10279f3a7adaa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:48:44.094572 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4e173109-98d1-45e9-beaa-05dbdee4057b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:44.095271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4e173109-98d1-45e9-beaa-05dbdee4057b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:44.096845 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1069/2129] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:48:43 2022] DELETE /identity/v3/projects/2873e8e45f26489fba10279f3a7adaa4 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:44.103790 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af25e1-c0c3-4612-8072-062022a602c7 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:44.104428 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af25e1-c0c3-4612-8072-062022a602c7 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:44.104428 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af25e1-c0c3-4612-8072-062022a602c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:44.131939 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e173109-98d1-45e9-beaa-05dbdee4057b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:44.132926 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-53af25e1-c0c3-4612-8072-062022a602c7 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:44.133675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4e173109-98d1-45e9-beaa-05dbdee4057b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:44.135005 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-53af25e1-c0c3-4612-8072-062022a602c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:44.168750 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:44.218918 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1061/2130] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:48:44.219598 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e173109-98d1-45e9-beaa-05dbdee4057b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:44.223826 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a89cb6-af94-4172-86ae-4d52e2d0891e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:44.224648 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a89cb6-af94-4172-86ae-4d52e2d0891e service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:44.225009 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a89cb6-af94-4172-86ae-4d52e2d0891e service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:44.225413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a89cb6-af94-4172-86ae-4d52e2d0891e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:44.227674 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc257022-ff70-43c4-8b49-3723c0506d66 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:44.227999 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-55a89cb6-af94-4172-86ae-4d52e2d0891e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:44.228721 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc257022-ff70-43c4-8b49-3723c0506d66 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:44.229370 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc257022-ff70-43c4-8b49-3723c0506d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:44.264517 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-fc257022-ff70-43c4-8b49-3723c0506d66 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:44.265796 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-fc257022-ff70-43c4-8b49-3723c0506d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:44.280773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1062/2131] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:44.286797 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc257022-ff70-43c4-8b49-3723c0506d66 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:44.303685 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc257022-ff70-43c4-8b49-3723c0506d66 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:44.315188 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c85851-594a-420e-bae5-7a0ddc7c01cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:44.316252 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c85851-594a-420e-bae5-7a0ddc7c01cf admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:44.316745 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c85851-594a-420e-bae5-7a0ddc7c01cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:44.317169 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c85851-594a-420e-bae5-7a0ddc7c01cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:44.318680 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c85851-594a-420e-bae5-7a0ddc7c01cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:48:44.319482 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c85851-594a-420e-bae5-7a0ddc7c01cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:44.322362 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c85851-594a-420e-bae5-7a0ddc7c01cf admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:44.342137 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a89cb6-af94-4172-86ae-4d52e2d0891e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:44.346246 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1063/2132] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:48:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:48:44.346437 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a89cb6-af94-4172-86ae-4d52e2d0891e service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:44.348942 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c85851-594a-420e-bae5-7a0ddc7c01cf admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:44.367658 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1070/2133] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:48:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:48:44.368558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c85851-594a-420e-bae5-7a0ddc7c01cf admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:44.377292 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b46fd9-8ebc-4eb1-b334-dcdca5c91083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:44.378255 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b46fd9-8ebc-4eb1-b334-dcdca5c91083 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:44.378828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b46fd9-8ebc-4eb1-b334-dcdca5c91083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:44.379844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b46fd9-8ebc-4eb1-b334-dcdca5c91083 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:44.383321 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b46fd9-8ebc-4eb1-b334-dcdca5c91083 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:44.386151 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:44.388786 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b46fd9-8ebc-4eb1-b334-dcdca5c91083 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:44.602898 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1064/2134] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:48:44 2022] POST /identity/v3/projects => generated 385 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:48:44.608320 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a89cb6-af94-4172-86ae-4d52e2d0891e service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:44.627490 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a89cb6-af94-4172-86ae-4d52e2d0891e service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:44.751912 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf46a0-9145-4c24-9753-cb7fcd4132df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:44.753553 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf46a0-9145-4c24-9753-cb7fcd4132df admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:44.754023 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf46a0-9145-4c24-9753-cb7fcd4132df admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:44.754459 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf46a0-9145-4c24-9753-cb7fcd4132df admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:44.755434 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf46a0-9145-4c24-9753-cb7fcd4132df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:44.758061 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf46a0-9145-4c24-9753-cb7fcd4132df admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:44.933688 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1071/2135] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:48:44 2022] POST /identity/v3/users => generated 293 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:48:44.938780 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b46fd9-8ebc-4eb1-b334-dcdca5c91083 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:44.951617 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b46fd9-8ebc-4eb1-b334-dcdca5c91083 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:44.956958 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45468332-2558-4c46-9e8e-26b4d836ca9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:44.957593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45468332-2558-4c46-9e8e-26b4d836ca9b admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:44.957874 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45468332-2558-4c46-9e8e-26b4d836ca9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:44.958300 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45468332-2558-4c46-9e8e-26b4d836ca9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:44.959186 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45468332-2558-4c46-9e8e-26b4d836ca9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:44.960888 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45468332-2558-4c46-9e8e-26b4d836ca9b admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:44.973635 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1065/2136] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:48:44.977988 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf46a0-9145-4c24-9753-cb7fcd4132df admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:44.991411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf46a0-9145-4c24-9753-cb7fcd4132df admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:44.998090 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909e306-f302-4f93-9a82-fcb4dfe96e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:44.998758 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909e306-f302-4f93-9a82-fcb4dfe96e35 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:44.999022 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909e306-f302-4f93-9a82-fcb4dfe96e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:44.999289 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909e306-f302-4f93-9a82-fcb4dfe96e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:45.000039 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909e306-f302-4f93-9a82-fcb4dfe96e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:45.001627 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909e306-f302-4f93-9a82-fcb4dfe96e35 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:45.016322 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1072/2137] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:45.020948 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45468332-2558-4c46-9e8e-26b4d836ca9b admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:45.037683 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45468332-2558-4c46-9e8e-26b4d836ca9b admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:45.045126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d74eb-6f55-4ca6-911a-b5541a631409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:45.052556 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d74eb-6f55-4ca6-911a-b5541a631409 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:45.052556 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d74eb-6f55-4ca6-911a-b5541a631409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:45.052556 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d74eb-6f55-4ca6-911a-b5541a631409 admin admin] PATH_INFO: `/v3/projects/733b661b3df9403ab7304f96f688cddd/users/3c05248cb6204eaca0b435cd120683a4/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:45.075879 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d74eb-6f55-4ca6-911a-b5541a631409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=733b661b3df9403ab7304f96f688cddd, user_id=3c05248cb6204eaca0b435cd120683a4, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:45.079945 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d74eb-6f55-4ca6-911a-b5541a631409 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:45.178909 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1066/2138] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:48:45 2022] PUT /identity/v3/projects/733b661b3df9403ab7304f96f688cddd/users/3c05248cb6204eaca0b435cd120683a4/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:45.191446 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10860fea-5da8-4a4d-ac65-d2c961840ab4 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:45.191709 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10860fea-5da8-4a4d-ac65-d2c961840ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:45.191993 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10860fea-5da8-4a4d-ac65-d2c961840ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:45.224884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-10860fea-5da8-4a4d-ac65-d2c961840ab4 None None] MFA Rules not processed for user `3c05248cb6204eaca0b435cd120683a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:45.226527 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-10860fea-5da8-4a4d-ac65-d2c961840ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:45.257448 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:45.332733 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1073/2139] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:48:45.346574 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d74eb-6f55-4ca6-911a-b5541a631409 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:45.429780 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d74eb-6f55-4ca6-911a-b5541a631409 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:45.442252 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85536b4-7120-4db0-999c-4180aaa6d676 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:45.443078 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85536b4-7120-4db0-999c-4180aaa6d676 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:45.443411 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85536b4-7120-4db0-999c-4180aaa6d676 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:45.443727 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85536b4-7120-4db0-999c-4180aaa6d676 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:45.453265 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85536b4-7120-4db0-999c-4180aaa6d676 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:45.454818 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85536b4-7120-4db0-999c-4180aaa6d676 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:45.465374 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1067/2140] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:48:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:48:45.567313 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f3c9f-b1de-4543-93e3-c8cb0e6504f3 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:45.567783 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f3c9f-b1de-4543-93e3-c8cb0e6504f3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:45.568238 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f3c9f-b1de-4543-93e3-c8cb0e6504f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:45.598929 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-764f3c9f-b1de-4543-93e3-c8cb0e6504f3 None None] MFA Rules not processed for user `c80fcafb1c34439b93873e1291a4eaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:45.600213 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-764f3c9f-b1de-4543-93e3-c8cb0e6504f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:45.668844 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1074/2141] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:48:48.845359 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85536b4-7120-4db0-999c-4180aaa6d676 service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:48.847702 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f85536b4-7120-4db0-999c-4180aaa6d676 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:48.948733 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85536b4-7120-4db0-999c-4180aaa6d676 service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:48.954588 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc76317-e9a5-45b9-b9fb-de2f75873185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:48.955281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc76317-e9a5-45b9-b9fb-de2f75873185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:48.955568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc76317-e9a5-45b9-b9fb-de2f75873185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:48.955846 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc76317-e9a5-45b9-b9fb-de2f75873185 admin admin] PATH_INFO: `/v3/users/5c32bfec2bf54840aa31579c50f66499` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:48.957083 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc76317-e9a5-45b9-b9fb-de2f75873185 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c32bfec2bf54840aa31579c50f66499)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:48.959516 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc76317-e9a5-45b9-b9fb-de2f75873185 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:49.234094 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-bdc76317-e9a5-45b9-b9fb-de2f75873185 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c32bfec2bf54840aa31579c50f66499'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:49.235471 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-bdc76317-e9a5-45b9-b9fb-de2f75873185 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c32bfec2bf54840aa31579c50f66499'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:49.238486 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:49.249218 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-bdc76317-e9a5-45b9-b9fb-de2f75873185 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c32bfec2bf54840aa31579c50f66499'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:49.250003 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-bdc76317-e9a5-45b9-b9fb-de2f75873185 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c32bfec2bf54840aa31579c50f66499'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:49.367553 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-bdc76317-e9a5-45b9-b9fb-de2f75873185 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c32bfec2bf54840aa31579c50f66499'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:49.402152 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1068/2142] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:48:48 2022] DELETE /identity/v3/users/5c32bfec2bf54840aa31579c50f66499 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:49.409587 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3869e-ef27-40f4-a5e6-3c44b34eb15b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:49.410138 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3869e-ef27-40f4-a5e6-3c44b34eb15b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:49.410574 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3869e-ef27-40f4-a5e6-3c44b34eb15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:49.437786 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-19b3869e-ef27-40f4-a5e6-3c44b34eb15b None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:49.439035 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-19b3869e-ef27-40f4-a5e6-3c44b34eb15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:49.536082 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1075/2143] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:49.548580 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc76317-e9a5-45b9-b9fb-de2f75873185 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:49.551093 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-bdc76317-e9a5-45b9-b9fb-de2f75873185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:49.649734 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc76317-e9a5-45b9-b9fb-de2f75873185 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:49.657657 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31b3fd-1902-4746-ab8f-7397e238ded7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:49.657657 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31b3fd-1902-4746-ab8f-7397e238ded7 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:49.658258 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31b3fd-1902-4746-ab8f-7397e238ded7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:49.658709 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31b3fd-1902-4746-ab8f-7397e238ded7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:49.674881 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31b3fd-1902-4746-ab8f-7397e238ded7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:49.678279 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31b3fd-1902-4746-ab8f-7397e238ded7 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:49.699647 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1069/2144] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:48:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:48:50.238890 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3869e-ef27-40f4-a5e6-3c44b34eb15b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:50.240312 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-19b3869e-ef27-40f4-a5e6-3c44b34eb15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:50.277253 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3869e-ef27-40f4-a5e6-3c44b34eb15b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:50.290634 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12c352-db8e-47ca-a9c5-2610010bc619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:50.292265 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12c352-db8e-47ca-a9c5-2610010bc619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:50.292686 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12c352-db8e-47ca-a9c5-2610010bc619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:50.293055 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12c352-db8e-47ca-a9c5-2610010bc619 admin admin] PATH_INFO: `/v3/projects/99ee3fe9f0834d258aad473f5c211802` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:50.295287 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12c352-db8e-47ca-a9c5-2610010bc619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99ee3fe9f0834d258aad473f5c211802)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:50.297905 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12c352-db8e-47ca-a9c5-2610010bc619 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:50.512224 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-aa12c352-db8e-47ca-a9c5-2610010bc619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99ee3fe9f0834d258aad473f5c211802', 'request_id': 'req-aa12c352-db8e-47ca-a9c5-2610010bc619'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:50.522571 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-aa12c352-db8e-47ca-a9c5-2610010bc619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99ee3fe9f0834d258aad473f5c211802', 'request_id': 'req-aa12c352-db8e-47ca-a9c5-2610010bc619'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:50.531071 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:50.662785 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-aa12c352-db8e-47ca-a9c5-2610010bc619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99ee3fe9f0834d258aad473f5c211802', 'request_id': 'req-aa12c352-db8e-47ca-a9c5-2610010bc619'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:50.678520 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-aa12c352-db8e-47ca-a9c5-2610010bc619 admin admin] The token cache is being invalidate because project 99ee3fe9f0834d258aad473f5c211802 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:48:50.679062 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-aa12c352-db8e-47ca-a9c5-2610010bc619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:50.680944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-aa12c352-db8e-47ca-a9c5-2610010bc619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:50.686523 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1076/2145] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:48:50 2022] DELETE /identity/v3/projects/99ee3fe9f0834d258aad473f5c211802 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:50.691993 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31b3fd-1902-4746-ab8f-7397e238ded7 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:50.718465 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31b3fd-1902-4746-ab8f-7397e238ded7 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:50.837078 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b138007-5b91-48c0-ae81-98c64acaf172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:50.843986 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b138007-5b91-48c0-ae81-98c64acaf172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:50.843986 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b138007-5b91-48c0-ae81-98c64acaf172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:50.843986 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b138007-5b91-48c0-ae81-98c64acaf172 admin admin] PATH_INFO: `/v3/users/16831bf01fc344d3b7cb29ec396fc9b7` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:50.843986 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b138007-5b91-48c0-ae81-98c64acaf172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16831bf01fc344d3b7cb29ec396fc9b7)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:50.846636 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b138007-5b91-48c0-ae81-98c64acaf172 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:51.121964 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-6b138007-5b91-48c0-ae81-98c64acaf172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16831bf01fc344d3b7cb29ec396fc9b7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:51.123374 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-6b138007-5b91-48c0-ae81-98c64acaf172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16831bf01fc344d3b7cb29ec396fc9b7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:51.133199 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-6b138007-5b91-48c0-ae81-98c64acaf172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16831bf01fc344d3b7cb29ec396fc9b7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:51.134072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-6b138007-5b91-48c0-ae81-98c64acaf172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16831bf01fc344d3b7cb29ec396fc9b7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:51.228805 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-6b138007-5b91-48c0-ae81-98c64acaf172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16831bf01fc344d3b7cb29ec396fc9b7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:51.238166 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:51.254073 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1070/2146] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:48:50 2022] DELETE /identity/v3/users/16831bf01fc344d3b7cb29ec396fc9b7 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:52.000567 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12c352-db8e-47ca-a9c5-2610010bc619 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:52.002839 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-aa12c352-db8e-47ca-a9c5-2610010bc619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:52.032098 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12c352-db8e-47ca-a9c5-2610010bc619 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:52.104730 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a382d-938b-4e00-8ec1-11e19e580c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:52.106691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a382d-938b-4e00-8ec1-11e19e580c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:52.107143 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a382d-938b-4e00-8ec1-11e19e580c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:52.107446 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a382d-938b-4e00-8ec1-11e19e580c66 admin admin] PATH_INFO: `/v3/projects/727a50e0a72b4b0e93b69a271289a229` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:52.108661 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a382d-938b-4e00-8ec1-11e19e580c66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=727a50e0a72b4b0e93b69a271289a229)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:52.110901 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a382d-938b-4e00-8ec1-11e19e580c66 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:52.246934 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-167a382d-938b-4e00-8ec1-11e19e580c66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '727a50e0a72b4b0e93b69a271289a229', 'request_id': 'req-167a382d-938b-4e00-8ec1-11e19e580c66'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:52.253948 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-167a382d-938b-4e00-8ec1-11e19e580c66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '727a50e0a72b4b0e93b69a271289a229', 'request_id': 'req-167a382d-938b-4e00-8ec1-11e19e580c66'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:52.383209 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-167a382d-938b-4e00-8ec1-11e19e580c66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '727a50e0a72b4b0e93b69a271289a229', 'request_id': 'req-167a382d-938b-4e00-8ec1-11e19e580c66'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:52.399506 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-167a382d-938b-4e00-8ec1-11e19e580c66 admin admin] The token cache is being invalidate because project 727a50e0a72b4b0e93b69a271289a229 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:48:52.399878 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-167a382d-938b-4e00-8ec1-11e19e580c66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:52.400609 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-167a382d-938b-4e00-8ec1-11e19e580c66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:52.402362 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1077/2147] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:48:51 2022] DELETE /identity/v3/projects/727a50e0a72b4b0e93b69a271289a229 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:52.412175 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd614f9-0ca0-451d-b381-13b2ebeb21f1 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:52.412778 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd614f9-0ca0-451d-b381-13b2ebeb21f1 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:52.412778 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd614f9-0ca0-451d-b381-13b2ebeb21f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:52.434398 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-7bd614f9-0ca0-451d-b381-13b2ebeb21f1 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:52.436239 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7bd614f9-0ca0-451d-b381-13b2ebeb21f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:52.536903 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1071/2148] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:52.549492 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615b926-de27-4508-93d9-8cc4b142e72b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:52.550023 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615b926-de27-4508-93d9-8cc4b142e72b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:52.550471 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615b926-de27-4508-93d9-8cc4b142e72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:52.598870 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-5615b926-de27-4508-93d9-8cc4b142e72b None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:52.601142 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5615b926-de27-4508-93d9-8cc4b142e72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:52.611835 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1078/2149] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:52.618512 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd614f9-0ca0-451d-b381-13b2ebeb21f1 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:52.637486 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd614f9-0ca0-451d-b381-13b2ebeb21f1 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:52.650077 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a0cae-10af-4bea-a277-39d4dec62b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:52.651485 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a0cae-10af-4bea-a277-39d4dec62b0e admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:52.652081 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a0cae-10af-4bea-a277-39d4dec62b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:52.652791 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a0cae-10af-4bea-a277-39d4dec62b0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:52.654290 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a0cae-10af-4bea-a277-39d4dec62b0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:48:52.654885 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a0cae-10af-4bea-a277-39d4dec62b0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:52.657597 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a0cae-10af-4bea-a277-39d4dec62b0e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:52.695239 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1072/2150] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:48:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:48:52.696562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615b926-de27-4508-93d9-8cc4b142e72b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:52.710277 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615b926-de27-4508-93d9-8cc4b142e72b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:52.717095 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6096822-8740-4e00-8203-040e73a1e24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:52.717726 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6096822-8740-4e00-8203-040e73a1e24a admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:52.718008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6096822-8740-4e00-8203-040e73a1e24a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:52.718274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6096822-8740-4e00-8203-040e73a1e24a admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:52.719025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6096822-8740-4e00-8203-040e73a1e24a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:52.721206 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6096822-8740-4e00-8203-040e73a1e24a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:52.945431 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1079/2151] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:48:52 2022] POST /identity/v3/projects => generated 375 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:48:52.950154 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a0cae-10af-4bea-a277-39d4dec62b0e admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:52.961978 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a0cae-10af-4bea-a277-39d4dec62b0e admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:53.074245 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3818d6c-bca1-4979-a6b4-8738ebb96f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:53.075099 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3818d6c-bca1-4979-a6b4-8738ebb96f15 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:53.076185 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3818d6c-bca1-4979-a6b4-8738ebb96f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:53.076849 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3818d6c-bca1-4979-a6b4-8738ebb96f15 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:53.077698 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3818d6c-bca1-4979-a6b4-8738ebb96f15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:53.080253 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3818d6c-bca1-4979-a6b4-8738ebb96f15 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:53.308598 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1073/2152] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:48:52 2022] POST /identity/v3/users => generated 288 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:48:53.313526 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6096822-8740-4e00-8203-040e73a1e24a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:53.331075 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6096822-8740-4e00-8203-040e73a1e24a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:53.339069 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46985f-14ac-46c6-80a9-8218f8048bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:53.340165 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46985f-14ac-46c6-80a9-8218f8048bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:53.340668 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46985f-14ac-46c6-80a9-8218f8048bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:53.341171 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46985f-14ac-46c6-80a9-8218f8048bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:53.342302 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46985f-14ac-46c6-80a9-8218f8048bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:53.345297 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46985f-14ac-46c6-80a9-8218f8048bf9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:53.357369 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1080/2153] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:53.361447 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3818d6c-bca1-4979-a6b4-8738ebb96f15 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:53.374120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3818d6c-bca1-4979-a6b4-8738ebb96f15 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:53.379066 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d589d8-b028-4a1e-9ccb-003507031892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:53.379700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d589d8-b028-4a1e-9ccb-003507031892 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:53.379984 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d589d8-b028-4a1e-9ccb-003507031892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:53.380265 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d589d8-b028-4a1e-9ccb-003507031892 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:53.380920 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d589d8-b028-4a1e-9ccb-003507031892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:53.382554 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d589d8-b028-4a1e-9ccb-003507031892 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:53.396021 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1074/2154] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:53.400597 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46985f-14ac-46c6-80a9-8218f8048bf9 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:53.414833 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46985f-14ac-46c6-80a9-8218f8048bf9 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:53.423439 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1274f24-1118-4828-a077-f227a0131a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:53.424565 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1274f24-1118-4828-a077-f227a0131a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:53.434523 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1274f24-1118-4828-a077-f227a0131a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:53.434523 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1274f24-1118-4828-a077-f227a0131a33 admin admin] PATH_INFO: `/v3/projects/4f0e1a0a6fd54407a9e7119d6826b97e/users/36d8bf20c6f8473f8d1eebad19b50455/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:53.444877 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1274f24-1118-4828-a077-f227a0131a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f0e1a0a6fd54407a9e7119d6826b97e, user_id=36d8bf20c6f8473f8d1eebad19b50455, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:53.447769 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1274f24-1118-4828-a077-f227a0131a33 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:53.588274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1081/2155] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:48:53 2022] PUT /identity/v3/projects/4f0e1a0a6fd54407a9e7119d6826b97e/users/36d8bf20c6f8473f8d1eebad19b50455/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:53.599685 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdfb2b-165b-4cfb-8aa5-bb0dc1e6f179 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:53.600416 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdfb2b-165b-4cfb-8aa5-bb0dc1e6f179 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:53.600416 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdfb2b-165b-4cfb-8aa5-bb0dc1e6f179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:53.633814 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-bfbdfb2b-165b-4cfb-8aa5-bb0dc1e6f179 None None] MFA Rules not processed for user `36d8bf20c6f8473f8d1eebad19b50455`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:53.635087 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-bfbdfb2b-165b-4cfb-8aa5-bb0dc1e6f179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:53.693923 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:53.723870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1075/2156] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:48:53.728700 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1274f24-1118-4828-a077-f227a0131a33 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:53.752698 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:53.817772 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1274f24-1118-4828-a077-f227a0131a33 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:53.827660 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abff9ea-0a80-4cfc-9167-db20f67d7f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:53.828567 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abff9ea-0a80-4cfc-9167-db20f67d7f49 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:53.829038 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abff9ea-0a80-4cfc-9167-db20f67d7f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:53.829518 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abff9ea-0a80-4cfc-9167-db20f67d7f49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:53.837509 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abff9ea-0a80-4cfc-9167-db20f67d7f49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:53.837509 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abff9ea-0a80-4cfc-9167-db20f67d7f49 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:54.012706 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1082/2157] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:48:53 2022] POST /identity/v3/projects => generated 375 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:48:54.020286 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdfb2b-165b-4cfb-8aa5-bb0dc1e6f179 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:54.043964 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdfb2b-165b-4cfb-8aa5-bb0dc1e6f179 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:54.192457 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991b08b-080c-4a0f-8862-2729a8cea2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:54.196263 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991b08b-080c-4a0f-8862-2729a8cea2a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:54.197183 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991b08b-080c-4a0f-8862-2729a8cea2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:54.198671 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991b08b-080c-4a0f-8862-2729a8cea2a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:54.201000 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991b08b-080c-4a0f-8862-2729a8cea2a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:54.207835 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991b08b-080c-4a0f-8862-2729a8cea2a1 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:54.332668 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1076/2158] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:48:54 2022] POST /identity/v3/users => generated 294 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:48:54.334145 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abff9ea-0a80-4cfc-9167-db20f67d7f49 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:54.362796 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abff9ea-0a80-4cfc-9167-db20f67d7f49 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:54.368459 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f87aa-e125-471a-9c35-717eb71934f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:54.369084 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f87aa-e125-471a-9c35-717eb71934f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:54.369560 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f87aa-e125-471a-9c35-717eb71934f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:54.370191 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f87aa-e125-471a-9c35-717eb71934f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:54.370887 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f87aa-e125-471a-9c35-717eb71934f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:54.373225 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f87aa-e125-471a-9c35-717eb71934f2 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:54.390549 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1083/2159] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:54.396236 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991b08b-080c-4a0f-8862-2729a8cea2a1 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:54.419951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991b08b-080c-4a0f-8862-2729a8cea2a1 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:54.446432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4d5fb-b107-407c-bf97-f4e7af6a7a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:54.447137 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4d5fb-b107-407c-bf97-f4e7af6a7a49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:54.447522 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4d5fb-b107-407c-bf97-f4e7af6a7a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:54.448107 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4d5fb-b107-407c-bf97-f4e7af6a7a49 admin admin] PATH_INFO: `/v3/projects/63259f3d072f43cd988c5663c28bad93/users/297c7ec7517f4283aa611ed76dd30580/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:54.469996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4d5fb-b107-407c-bf97-f4e7af6a7a49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63259f3d072f43cd988c5663c28bad93, user_id=297c7ec7517f4283aa611ed76dd30580, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:54.473793 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4d5fb-b107-407c-bf97-f4e7af6a7a49 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:54.569562 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1077/2160] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:48:54 2022] PUT /identity/v3/projects/63259f3d072f43cd988c5663c28bad93/users/297c7ec7517f4283aa611ed76dd30580/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:54.579041 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f87aa-e125-471a-9c35-717eb71934f2 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:54.627116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f87aa-e125-471a-9c35-717eb71934f2 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:54.739694 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6326e4-8636-4cab-9412-d53dcb61a3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:54.740346 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6326e4-8636-4cab-9412-d53dcb61a3dd admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:54.740628 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6326e4-8636-4cab-9412-d53dcb61a3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:54.740993 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6326e4-8636-4cab-9412-d53dcb61a3dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:54.741722 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6326e4-8636-4cab-9412-d53dcb61a3dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:54.743696 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6326e4-8636-4cab-9412-d53dcb61a3dd admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:54.758193 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1084/2161] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:54.765008 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4d5fb-b107-407c-bf97-f4e7af6a7a49 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:54.776350 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4d5fb-b107-407c-bf97-f4e7af6a7a49 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:54.781596 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3150e8e-b726-496c-a01c-75d2213dc8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:54.782436 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3150e8e-b726-496c-a01c-75d2213dc8d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:54.782966 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3150e8e-b726-496c-a01c-75d2213dc8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:54.783466 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3150e8e-b726-496c-a01c-75d2213dc8d6 admin admin] PATH_INFO: `/v3/projects/63259f3d072f43cd988c5663c28bad93/users/297c7ec7517f4283aa611ed76dd30580/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:54.785810 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3150e8e-b726-496c-a01c-75d2213dc8d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63259f3d072f43cd988c5663c28bad93, user_id=297c7ec7517f4283aa611ed76dd30580, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:54.788767 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3150e8e-b726-496c-a01c-75d2213dc8d6 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:54.801073 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1078/2162] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:48:54 2022] PUT /identity/v3/projects/63259f3d072f43cd988c5663c28bad93/users/297c7ec7517f4283aa611ed76dd30580/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:54.820180 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fc3cb-83b5-4622-b25d-4e72fb88b65c None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:54.820542 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fc3cb-83b5-4622-b25d-4e72fb88b65c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:54.820828 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fc3cb-83b5-4622-b25d-4e72fb88b65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:54.855697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-9c5fc3cb-83b5-4622-b25d-4e72fb88b65c None None] MFA Rules not processed for user `297c7ec7517f4283aa611ed76dd30580`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:54.857119 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9c5fc3cb-83b5-4622-b25d-4e72fb88b65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:54.945635 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1085/2163] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:54.958595 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3150e8e-b726-496c-a01c-75d2213dc8d6 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:54.961075 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b3150e8e-b726-496c-a01c-75d2213dc8d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:55.028261 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3150e8e-b726-496c-a01c-75d2213dc8d6 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:55.032755 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b33dca-9075-49ac-a162-20ec3842446a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:55.033389 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b33dca-9075-49ac-a162-20ec3842446a service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:55.033674 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b33dca-9075-49ac-a162-20ec3842446a service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:55.033951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b33dca-9075-49ac-a162-20ec3842446a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:55.096672 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:55.107504 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b33dca-9075-49ac-a162-20ec3842446a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:55.110022 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b33dca-9075-49ac-a162-20ec3842446a service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:55.119706 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1079/2164] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:48:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:48:56.108634 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5fc3cb-83b5-4622-b25d-4e72fb88b65c None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:56.110242 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9c5fc3cb-83b5-4622-b25d-4e72fb88b65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:56.125443 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:56.197534 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5fc3cb-83b5-4622-b25d-4e72fb88b65c None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:56.205732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0aa63-d510-4780-bea8-b4488a605d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:56.206469 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0aa63-d510-4780-bea8-b4488a605d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:56.206819 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0aa63-d510-4780-bea8-b4488a605d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:56.207137 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0aa63-d510-4780-bea8-b4488a605d68 admin admin] PATH_INFO: `/v3/users/3c05248cb6204eaca0b435cd120683a4` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:56.208450 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0aa63-d510-4780-bea8-b4488a605d68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c05248cb6204eaca0b435cd120683a4)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:56.210874 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0aa63-d510-4780-bea8-b4488a605d68 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:56.512670 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2da0aa63-d510-4780-bea8-b4488a605d68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c05248cb6204eaca0b435cd120683a4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:56.609778 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2da0aa63-d510-4780-bea8-b4488a605d68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c05248cb6204eaca0b435cd120683a4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:56.610908 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2da0aa63-d510-4780-bea8-b4488a605d68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c05248cb6204eaca0b435cd120683a4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:56.611822 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2da0aa63-d510-4780-bea8-b4488a605d68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c05248cb6204eaca0b435cd120683a4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:56.623826 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2da0aa63-d510-4780-bea8-b4488a605d68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c05248cb6204eaca0b435cd120683a4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:56.655979 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1086/2165] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:48:56 2022] DELETE /identity/v3/users/3c05248cb6204eaca0b435cd120683a4 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:56.661810 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae603bc-a6a9-49ba-bc99-4ed9c79b6e8c None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:56.662399 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae603bc-a6a9-49ba-bc99-4ed9c79b6e8c None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:56.662793 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae603bc-a6a9-49ba-bc99-4ed9c79b6e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:56.712050 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-6ae603bc-a6a9-49ba-bc99-4ed9c79b6e8c None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:56.714115 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6ae603bc-a6a9-49ba-bc99-4ed9c79b6e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:56.804805 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1080/2166] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:56.825995 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0aa63-d510-4780-bea8-b4488a605d68 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:56.838884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2da0aa63-d510-4780-bea8-b4488a605d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:56.913093 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0aa63-d510-4780-bea8-b4488a605d68 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:56.919865 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c6f35-1257-4a39-a29f-3bef7ff0d527 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:56.920513 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c6f35-1257-4a39-a29f-3bef7ff0d527 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:56.921093 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c6f35-1257-4a39-a29f-3bef7ff0d527 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:56.921570 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c6f35-1257-4a39-a29f-3bef7ff0d527 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:56.938583 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c6f35-1257-4a39-a29f-3bef7ff0d527 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:56.941048 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c6f35-1257-4a39-a29f-3bef7ff0d527 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:56.979931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1087/2167] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:48:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:48:57.625137 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae603bc-a6a9-49ba-bc99-4ed9c79b6e8c None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:57.626822 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6ae603bc-a6a9-49ba-bc99-4ed9c79b6e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:57.652880 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae603bc-a6a9-49ba-bc99-4ed9c79b6e8c None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:57.653118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1325d4-000a-4067-b473-8d5abb0ce8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:57.654023 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1325d4-000a-4067-b473-8d5abb0ce8b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:57.654474 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1325d4-000a-4067-b473-8d5abb0ce8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:57.654902 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1325d4-000a-4067-b473-8d5abb0ce8b8 admin admin] PATH_INFO: `/v3/projects/733b661b3df9403ab7304f96f688cddd` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:57.656976 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1325d4-000a-4067-b473-8d5abb0ce8b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=733b661b3df9403ab7304f96f688cddd)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:57.659192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1325d4-000a-4067-b473-8d5abb0ce8b8 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:57.804446 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5b1325d4-000a-4067-b473-8d5abb0ce8b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '733b661b3df9403ab7304f96f688cddd', 'request_id': 'req-5b1325d4-000a-4067-b473-8d5abb0ce8b8'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:57.811894 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5b1325d4-000a-4067-b473-8d5abb0ce8b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '733b661b3df9403ab7304f96f688cddd', 'request_id': 'req-5b1325d4-000a-4067-b473-8d5abb0ce8b8'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:58.495193 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5b1325d4-000a-4067-b473-8d5abb0ce8b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '733b661b3df9403ab7304f96f688cddd', 'request_id': 'req-5b1325d4-000a-4067-b473-8d5abb0ce8b8'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:58.524336 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5b1325d4-000a-4067-b473-8d5abb0ce8b8 admin admin] The token cache is being invalidate because project 733b661b3df9403ab7304f96f688cddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:48:58.524934 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5b1325d4-000a-4067-b473-8d5abb0ce8b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:58.526789 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5b1325d4-000a-4067-b473-8d5abb0ce8b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:48:58.530770 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1081/2168] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:48:57 2022] DELETE /identity/v3/projects/733b661b3df9403ab7304f96f688cddd => generated 0 bytes in 906 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:58.537919 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42a3f2-94df-4a01-9411-34fc6e1e188a None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:58.539207 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42a3f2-94df-4a01-9411-34fc6e1e188a None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:58.539782 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42a3f2-94df-4a01-9411-34fc6e1e188a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:58.577291 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-0c42a3f2-94df-4a01-9411-34fc6e1e188a None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:58.579224 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0c42a3f2-94df-4a01-9411-34fc6e1e188a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:58.614747 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:58.649897 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1088/2169] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:58.658105 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26013ef3-a8d4-4a48-9f0a-b29dc625211b None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:58.658469 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26013ef3-a8d4-4a48-9f0a-b29dc625211b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:58.658653 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26013ef3-a8d4-4a48-9f0a-b29dc625211b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:58.702174 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-26013ef3-a8d4-4a48-9f0a-b29dc625211b None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:58.703836 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-26013ef3-a8d4-4a48-9f0a-b29dc625211b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:58.714013 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1082/2170] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:48:58.720043 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42a3f2-94df-4a01-9411-34fc6e1e188a None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:58.732823 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42a3f2-94df-4a01-9411-34fc6e1e188a None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:58.740562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421fed59-5108-47b6-a30d-41df389a0106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:58.740562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fed59-5108-47b6-a30d-41df389a0106 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:58.740562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fed59-5108-47b6-a30d-41df389a0106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:58.740562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fed59-5108-47b6-a30d-41df389a0106 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:58.740974 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421fed59-5108-47b6-a30d-41df389a0106 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:48:58.740974 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421fed59-5108-47b6-a30d-41df389a0106 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:58.742716 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421fed59-5108-47b6-a30d-41df389a0106 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:58.761730 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1089/2171] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:48:58.766386 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26013ef3-a8d4-4a48-9f0a-b29dc625211b None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:58.776423 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26013ef3-a8d4-4a48-9f0a-b29dc625211b None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:58.781600 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d77347-8081-4163-965d-7d49766b89a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:58.782242 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d77347-8081-4163-965d-7d49766b89a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:58.782527 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d77347-8081-4163-965d-7d49766b89a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:58.782808 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d77347-8081-4163-965d-7d49766b89a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:58.783494 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d77347-8081-4163-965d-7d49766b89a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:58.785481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d77347-8081-4163-965d-7d49766b89a7 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:58.951413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421fed59-5108-47b6-a30d-41df389a0106 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:58.955975 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1083/2172] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:48:58 2022] POST /identity/v3/projects => generated 377 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:48:58.981431 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421fed59-5108-47b6-a30d-41df389a0106 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:59.095173 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42efee-1876-46f3-82e3-9c2cee305358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:59.096481 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42efee-1876-46f3-82e3-9c2cee305358 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:59.097563 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42efee-1876-46f3-82e3-9c2cee305358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:59.098250 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42efee-1876-46f3-82e3-9c2cee305358 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:59.099471 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42efee-1876-46f3-82e3-9c2cee305358 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:59.102971 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42efee-1876-46f3-82e3-9c2cee305358 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:59.219009 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1090/2173] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:48:58 2022] POST /identity/v3/users => generated 289 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:48:59.226309 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d77347-8081-4163-965d-7d49766b89a7 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:59.258956 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d77347-8081-4163-965d-7d49766b89a7 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:59.268055 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ac6a8-1670-422c-8479-285995537d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:59.269252 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ac6a8-1670-422c-8479-285995537d1d admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:59.269898 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ac6a8-1670-422c-8479-285995537d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:59.270413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ac6a8-1670-422c-8479-285995537d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:59.271641 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ac6a8-1670-422c-8479-285995537d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:59.274331 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ac6a8-1670-422c-8479-285995537d1d admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:59.292469 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1084/2174] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:59.296272 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42efee-1876-46f3-82e3-9c2cee305358 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:59.315479 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42efee-1876-46f3-82e3-9c2cee305358 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:59.322837 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfecfe2-e9b3-4d62-83fd-683208862b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:59.323906 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfecfe2-e9b3-4d62-83fd-683208862b61 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:59.324374 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfecfe2-e9b3-4d62-83fd-683208862b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:59.329478 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfecfe2-e9b3-4d62-83fd-683208862b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:59.329478 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfecfe2-e9b3-4d62-83fd-683208862b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:59.329478 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfecfe2-e9b3-4d62-83fd-683208862b61 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:59.349924 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1091/2175] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:48:59.354205 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ac6a8-1670-422c-8479-285995537d1d admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:48:59.365888 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ac6a8-1670-422c-8479-285995537d1d admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:48:59.372720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff4a0c-f516-4fd0-9e9e-2f8359e0202a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:48:59.374388 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff4a0c-f516-4fd0-9e9e-2f8359e0202a admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:59.375003 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff4a0c-f516-4fd0-9e9e-2f8359e0202a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:59.376015 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff4a0c-f516-4fd0-9e9e-2f8359e0202a admin admin] PATH_INFO: `/v3/projects/c2262f898bf347a597af6b167bfbbf53/users/a403acad7caf44b490759d3e9c0548ab/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:59.399930 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff4a0c-f516-4fd0-9e9e-2f8359e0202a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2262f898bf347a597af6b167bfbbf53, user_id=a403acad7caf44b490759d3e9c0548ab, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:48:59.406589 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff4a0c-f516-4fd0-9e9e-2f8359e0202a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:48:59.531752 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1085/2176] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:48:59 2022] PUT /identity/v3/projects/c2262f898bf347a597af6b167bfbbf53/users/a403acad7caf44b490759d3e9c0548ab/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:48:59.543067 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c1099-91d0-4e35-ab8c-70f3fe0ce441 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:48:59.543842 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c1099-91d0-4e35-ab8c-70f3fe0ce441 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:48:59.543842 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c1099-91d0-4e35-ab8c-70f3fe0ce441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:48:59.578034 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-0d8c1099-91d0-4e35-ab8c-70f3fe0ce441 None None] MFA Rules not processed for user `a403acad7caf44b490759d3e9c0548ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:48:59.579514 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0d8c1099-91d0-4e35-ab8c-70f3fe0ce441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:48:59.686307 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1092/2177] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:48:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:49:00.098296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff4a0c-f516-4fd0-9e9e-2f8359e0202a admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:00.102621 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-32ff4a0c-f516-4fd0-9e9e-2f8359e0202a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:00.131192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:00.202333 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c1099-91d0-4e35-ab8c-70f3fe0ce441 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:00.204289 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0d8c1099-91d0-4e35-ab8c-70f3fe0ce441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:00.208685 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff4a0c-f516-4fd0-9e9e-2f8359e0202a admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:00.213434 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd1af8-4cc3-4229-8bc7-e27c99dcbf52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:00.214319 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd1af8-4cc3-4229-8bc7-e27c99dcbf52 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:00.214319 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd1af8-4cc3-4229-8bc7-e27c99dcbf52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:00.214667 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd1af8-4cc3-4229-8bc7-e27c99dcbf52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:00.218597 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c1099-91d0-4e35-ab8c-70f3fe0ce441 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:00.222161 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf238d8-a739-4f59-b922-611265fe3c64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:00.222777 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf238d8-a739-4f59-b922-611265fe3c64 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:00.223055 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf238d8-a739-4f59-b922-611265fe3c64 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:00.223363 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf238d8-a739-4f59-b922-611265fe3c64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:00.225492 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-abf238d8-a739-4f59-b922-611265fe3c64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:00.236400 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd1af8-4cc3-4229-8bc7-e27c99dcbf52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:00.238100 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd1af8-4cc3-4229-8bc7-e27c99dcbf52 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:00.250075 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1086/2178] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:49:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:49:00.315302 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf238d8-a739-4f59-b922-611265fe3c64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:00.316932 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf238d8-a739-4f59-b922-611265fe3c64 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:00.328942 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1093/2179] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:49:00 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:49:01.855410 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:10.713857 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd1af8-4cc3-4229-8bc7-e27c99dcbf52 service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:10.715685 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e7bd1af8-4cc3-4229-8bc7-e27c99dcbf52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:10.833541 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd1af8-4cc3-4229-8bc7-e27c99dcbf52 service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:10.843655 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946ff26-1e91-40a8-b565-8e22492f3130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:10.844808 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946ff26-1e91-40a8-b565-8e22492f3130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:10.845594 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946ff26-1e91-40a8-b565-8e22492f3130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:10.846082 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946ff26-1e91-40a8-b565-8e22492f3130 admin admin] PATH_INFO: `/v3/users/4447b2ebaa4841d09ffbd2aff7940c10` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:10.848400 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946ff26-1e91-40a8-b565-8e22492f3130 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4447b2ebaa4841d09ffbd2aff7940c10)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:10.852371 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946ff26-1e91-40a8-b565-8e22492f3130 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:11.088272 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5946ff26-1e91-40a8-b565-8e22492f3130 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4447b2ebaa4841d09ffbd2aff7940c10'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:11.088976 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5946ff26-1e91-40a8-b565-8e22492f3130 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4447b2ebaa4841d09ffbd2aff7940c10'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:11.099018 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5946ff26-1e91-40a8-b565-8e22492f3130 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4447b2ebaa4841d09ffbd2aff7940c10'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:11.100016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5946ff26-1e91-40a8-b565-8e22492f3130 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4447b2ebaa4841d09ffbd2aff7940c10'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:11.189578 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5946ff26-1e91-40a8-b565-8e22492f3130 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4447b2ebaa4841d09ffbd2aff7940c10'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:11.220680 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1087/2180] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:49:10 2022] DELETE /identity/v3/users/4447b2ebaa4841d09ffbd2aff7940c10 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:49:11.226231 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94622d46-0de6-4409-88e4-a5a46879d9c0 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:11.232054 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94622d46-0de6-4409-88e4-a5a46879d9c0 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:11.232054 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94622d46-0de6-4409-88e4-a5a46879d9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:11.250404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-94622d46-0de6-4409-88e4-a5a46879d9c0 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:11.251933 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-94622d46-0de6-4409-88e4-a5a46879d9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:11.338693 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1094/2181] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:49:11.351567 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946ff26-1e91-40a8-b565-8e22492f3130 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:11.353337 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5946ff26-1e91-40a8-b565-8e22492f3130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:11.408559 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:11.483638 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946ff26-1e91-40a8-b565-8e22492f3130 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:11.505777 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa180a4-09e5-4230-8c6d-6a4884069bae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:11.508207 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa180a4-09e5-4230-8c6d-6a4884069bae service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:11.508207 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa180a4-09e5-4230-8c6d-6a4884069bae service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:11.508207 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa180a4-09e5-4230-8c6d-6a4884069bae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:11.541776 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa180a4-09e5-4230-8c6d-6a4884069bae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:11.550367 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa180a4-09e5-4230-8c6d-6a4884069bae service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:11.586752 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1088/2182] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:49:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:49:12.457078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94622d46-0de6-4409-88e4-a5a46879d9c0 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:12.459566 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-94622d46-0de6-4409-88e4-a5a46879d9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:12.505472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94622d46-0de6-4409-88e4-a5a46879d9c0 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:12.516956 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa21a1e-606c-4a38-8124-9ce6f5a3edfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:12.518029 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa21a1e-606c-4a38-8124-9ce6f5a3edfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:12.518884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa21a1e-606c-4a38-8124-9ce6f5a3edfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:12.519306 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa21a1e-606c-4a38-8124-9ce6f5a3edfd admin admin] PATH_INFO: `/v3/projects/98c0a6ed5cc64c57b40f9c0e25c9ab44` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:12.521879 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa21a1e-606c-4a38-8124-9ce6f5a3edfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=98c0a6ed5cc64c57b40f9c0e25c9ab44)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:12.525760 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa21a1e-606c-4a38-8124-9ce6f5a3edfd admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:12.751627 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-afa21a1e-606c-4a38-8124-9ce6f5a3edfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98c0a6ed5cc64c57b40f9c0e25c9ab44', 'request_id': 'req-afa21a1e-606c-4a38-8124-9ce6f5a3edfd'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:12.754120 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-afa21a1e-606c-4a38-8124-9ce6f5a3edfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98c0a6ed5cc64c57b40f9c0e25c9ab44', 'request_id': 'req-afa21a1e-606c-4a38-8124-9ce6f5a3edfd'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:12.920653 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-afa21a1e-606c-4a38-8124-9ce6f5a3edfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98c0a6ed5cc64c57b40f9c0e25c9ab44', 'request_id': 'req-afa21a1e-606c-4a38-8124-9ce6f5a3edfd'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:12.943525 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-afa21a1e-606c-4a38-8124-9ce6f5a3edfd admin admin] The token cache is being invalidate because project 98c0a6ed5cc64c57b40f9c0e25c9ab44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:49:12.943852 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-afa21a1e-606c-4a38-8124-9ce6f5a3edfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:12.944521 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-afa21a1e-606c-4a38-8124-9ce6f5a3edfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:12.946304 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1095/2183] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:49:12 2022] DELETE /identity/v3/projects/98c0a6ed5cc64c57b40f9c0e25c9ab44 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:49:12.952178 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86c447-464d-44cf-8806-f0a7bcdbb1fa None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:12.964603 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86c447-464d-44cf-8806-f0a7bcdbb1fa None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:12.964603 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86c447-464d-44cf-8806-f0a7bcdbb1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:12.975667 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-6e86c447-464d-44cf-8806-f0a7bcdbb1fa None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:12.976932 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6e86c447-464d-44cf-8806-f0a7bcdbb1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:13.056837 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1089/2184] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:49:13.065549 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfe526-fb82-4d63-ad29-f73a66ac87ce None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:13.065815 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfe526-fb82-4d63-ad29-f73a66ac87ce None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:13.069544 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfe526-fb82-4d63-ad29-f73a66ac87ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:13.089192 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-13bfe526-fb82-4d63-ad29-f73a66ac87ce None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:13.094977 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-13bfe526-fb82-4d63-ad29-f73a66ac87ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:13.113407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86c447-464d-44cf-8806-f0a7bcdbb1fa None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:13.113643 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1096/2185] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:49:13.126372 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86c447-464d-44cf-8806-f0a7bcdbb1fa None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:13.132465 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5549b91-9eec-439c-812e-761515b13413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:13.133467 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5549b91-9eec-439c-812e-761515b13413 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:13.138194 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5549b91-9eec-439c-812e-761515b13413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:13.138194 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5549b91-9eec-439c-812e-761515b13413 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:13.138194 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5549b91-9eec-439c-812e-761515b13413 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:49:13.138194 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5549b91-9eec-439c-812e-761515b13413 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:13.138194 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5549b91-9eec-439c-812e-761515b13413 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:13.151820 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1090/2186] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:49:13.157072 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfe526-fb82-4d63-ad29-f73a66ac87ce None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:13.169748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfe526-fb82-4d63-ad29-f73a66ac87ce None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:13.176042 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bbc0e3-e40f-4fd2-beb1-50c6e7b260a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:13.176798 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbc0e3-e40f-4fd2-beb1-50c6e7b260a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:13.177336 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbc0e3-e40f-4fd2-beb1-50c6e7b260a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:13.177762 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbc0e3-e40f-4fd2-beb1-50c6e7b260a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:13.178757 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bbc0e3-e40f-4fd2-beb1-50c6e7b260a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:13.181062 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bbc0e3-e40f-4fd2-beb1-50c6e7b260a0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:13.349527 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1097/2187] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:49:13 2022] POST /identity/v3/projects => generated 375 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:49:13.351461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5549b91-9eec-439c-812e-761515b13413 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:13.373949 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5549b91-9eec-439c-812e-761515b13413 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:13.502818 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65819747-8834-4e7a-8b40-1422259254f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:13.504014 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65819747-8834-4e7a-8b40-1422259254f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:13.504576 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65819747-8834-4e7a-8b40-1422259254f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:13.505132 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65819747-8834-4e7a-8b40-1422259254f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:13.507077 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65819747-8834-4e7a-8b40-1422259254f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:13.511862 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65819747-8834-4e7a-8b40-1422259254f4 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:13.683569 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1091/2188] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:49:13 2022] POST /identity/v3/users => generated 288 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:49:13.694263 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bbc0e3-e40f-4fd2-beb1-50c6e7b260a0 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:13.708327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bbc0e3-e40f-4fd2-beb1-50c6e7b260a0 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:13.717189 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db3fbd-f9c4-45d2-ac61-74b0518894ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:13.717918 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db3fbd-f9c4-45d2-ac61-74b0518894ad admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:13.718125 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db3fbd-f9c4-45d2-ac61-74b0518894ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:13.718549 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db3fbd-f9c4-45d2-ac61-74b0518894ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:13.719352 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db3fbd-f9c4-45d2-ac61-74b0518894ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:13.720798 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db3fbd-f9c4-45d2-ac61-74b0518894ad admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:13.732876 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1098/2189] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:49:13.739267 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65819747-8834-4e7a-8b40-1422259254f4 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:13.755159 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65819747-8834-4e7a-8b40-1422259254f4 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:13.762192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d707fd-0f25-4028-b969-55b99880df42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:13.762992 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d707fd-0f25-4028-b969-55b99880df42 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:13.763382 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d707fd-0f25-4028-b969-55b99880df42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:13.768359 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d707fd-0f25-4028-b969-55b99880df42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:13.768359 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d707fd-0f25-4028-b969-55b99880df42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:13.768359 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d707fd-0f25-4028-b969-55b99880df42 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:13.785619 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1092/2190] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:49:13.793255 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db3fbd-f9c4-45d2-ac61-74b0518894ad admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:13.816958 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db3fbd-f9c4-45d2-ac61-74b0518894ad admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:13.827843 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ecbfb7-2db3-4690-ab1e-cde5d6a4a16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:13.829103 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecbfb7-2db3-4690-ab1e-cde5d6a4a16f admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:13.829902 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecbfb7-2db3-4690-ab1e-cde5d6a4a16f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:13.830685 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecbfb7-2db3-4690-ab1e-cde5d6a4a16f admin admin] PATH_INFO: `/v3/projects/bdffcae01caa495e853b0573c1e8c630/users/75aa8304dc4440ffbec7f74110e61ed1/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:13.839125 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:13.884376 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ecbfb7-2db3-4690-ab1e-cde5d6a4a16f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdffcae01caa495e853b0573c1e8c630, user_id=75aa8304dc4440ffbec7f74110e61ed1, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:13.898512 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ecbfb7-2db3-4690-ab1e-cde5d6a4a16f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:14.030929 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1099/2191] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:49:13 2022] PUT /identity/v3/projects/bdffcae01caa495e853b0573c1e8c630/users/75aa8304dc4440ffbec7f74110e61ed1/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:49:14.042338 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ab430-f491-4dfb-98c0-69148008fd07 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:14.043274 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ab430-f491-4dfb-98c0-69148008fd07 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:14.043274 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ab430-f491-4dfb-98c0-69148008fd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:14.090764 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-070ab430-f491-4dfb-98c0-69148008fd07 None None] MFA Rules not processed for user `75aa8304dc4440ffbec7f74110e61ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:14.092490 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-070ab430-f491-4dfb-98c0-69148008fd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:14.136032 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:14.194430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1093/2192] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:49:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:49:14.328733 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ecbfb7-2db3-4690-ab1e-cde5d6a4a16f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:14.333783 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a8ecbfb7-2db3-4690-ab1e-cde5d6a4a16f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:14.449420 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ecbfb7-2db3-4690-ab1e-cde5d6a4a16f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:14.456989 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a93730-105b-4bf3-b8a4-26f5c2a77e87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:14.458285 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a93730-105b-4bf3-b8a4-26f5c2a77e87 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:14.458878 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a93730-105b-4bf3-b8a4-26f5c2a77e87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:14.459824 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a93730-105b-4bf3-b8a4-26f5c2a77e87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:14.482037 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a93730-105b-4bf3-b8a4-26f5c2a77e87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:14.485180 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a93730-105b-4bf3-b8a4-26f5c2a77e87 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:14.515370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1100/2193] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:49:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:49:16.732740 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be6cef-de79-4861-853a-c349fec53713 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:16.733527 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be6cef-de79-4861-853a-c349fec53713 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:16.733527 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be6cef-de79-4861-853a-c349fec53713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:16.757572 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-c6be6cef-de79-4861-853a-c349fec53713 None None] MFA Rules not processed for user `75aa8304dc4440ffbec7f74110e61ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:16.758940 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c6be6cef-de79-4861-853a-c349fec53713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:16.767829 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1094/2194] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:49:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:49:17.710650 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebc5d5-8745-47a1-97a2-3df1f444a786 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:17.711617 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebc5d5-8745-47a1-97a2-3df1f444a786 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:17.711892 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebc5d5-8745-47a1-97a2-3df1f444a786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:17.741127 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-19ebc5d5-8745-47a1-97a2-3df1f444a786 None None] MFA Rules not processed for user `84fcccb19a5e43ac9da5d7ca501563e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:17.745917 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-19ebc5d5-8745-47a1-97a2-3df1f444a786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:17.860683 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1101/2195] 10.222.0.26 () {58 vars in 1009 bytes} [Sun Sep 11 08:49:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:49:17.920122 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be6cef-de79-4861-853a-c349fec53713 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:17.922459 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c6be6cef-de79-4861-853a-c349fec53713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:18.037732 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be6cef-de79-4861-853a-c349fec53713 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:18.043379 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41b48d-9292-4453-806f-15fb0f1a85b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a4f25df9724d34afdd6a41e719546a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:18.044641 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41b48d-9292-4453-806f-15fb0f1a85b2 service swift] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:18.045844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41b48d-9292-4453-806f-15fb0f1a85b2 service swift] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:18.046189 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41b48d-9292-4453-806f-15fb0f1a85b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:18.057044 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41b48d-9292-4453-806f-15fb0f1a85b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:18.057736 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41b48d-9292-4453-806f-15fb0f1a85b2 service swift] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:18.068041 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1095/2196] 10.222.0.26 () {60 vars in 1384 bytes} [Sun Sep 11 08:49:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 08:49:20.358900 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ebc5d5-8745-47a1-97a2-3df1f444a786 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:20.362813 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-19ebc5d5-8745-47a1-97a2-3df1f444a786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:20.566747 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ebc5d5-8745-47a1-97a2-3df1f444a786 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:20.579195 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5864922-dc90-423f-8954-ece36ec57251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:20.579195 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5864922-dc90-423f-8954-ece36ec57251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:20.579195 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5864922-dc90-423f-8954-ece36ec57251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:20.579908 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5864922-dc90-423f-8954-ece36ec57251 admin admin] PATH_INFO: `/v3/users/36d8bf20c6f8473f8d1eebad19b50455` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:20.582520 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5864922-dc90-423f-8954-ece36ec57251 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36d8bf20c6f8473f8d1eebad19b50455)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:20.588123 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5864922-dc90-423f-8954-ece36ec57251 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:20.951321 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:20.972826 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e5864922-dc90-423f-8954-ece36ec57251 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36d8bf20c6f8473f8d1eebad19b50455'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:21.141610 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e5864922-dc90-423f-8954-ece36ec57251 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36d8bf20c6f8473f8d1eebad19b50455'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:21.142993 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e5864922-dc90-423f-8954-ece36ec57251 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36d8bf20c6f8473f8d1eebad19b50455'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:21.143824 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e5864922-dc90-423f-8954-ece36ec57251 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36d8bf20c6f8473f8d1eebad19b50455'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:21.156063 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e5864922-dc90-423f-8954-ece36ec57251 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36d8bf20c6f8473f8d1eebad19b50455'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:21.206714 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1102/2197] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:49:20 2022] DELETE /identity/v3/users/36d8bf20c6f8473f8d1eebad19b50455 => generated 0 bytes in 851 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:49:21.215041 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e24e3-5580-4ff0-aa4f-6dba4aa4d9c4 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:21.218287 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e24e3-5580-4ff0-aa4f-6dba4aa4d9c4 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:21.218762 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e24e3-5580-4ff0-aa4f-6dba4aa4d9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:21.266338 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-bf2e24e3-5580-4ff0-aa4f-6dba4aa4d9c4 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:21.268119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-bf2e24e3-5580-4ff0-aa4f-6dba4aa4d9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:21.417413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1096/2198] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:49:21.426082 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5864922-dc90-423f-8954-ece36ec57251 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:21.427738 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e5864922-dc90-423f-8954-ece36ec57251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:21.577116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5864922-dc90-423f-8954-ece36ec57251 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:21.587212 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e099c3d-9807-4969-b478-5a7af31a4e58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:21.588948 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e099c3d-9807-4969-b478-5a7af31a4e58 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:21.589846 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e099c3d-9807-4969-b478-5a7af31a4e58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:21.591085 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e099c3d-9807-4969-b478-5a7af31a4e58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:21.611582 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e099c3d-9807-4969-b478-5a7af31a4e58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:21.614883 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e099c3d-9807-4969-b478-5a7af31a4e58 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:21.630941 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1103/2199] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:49:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:49:22.788087 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e24e3-5580-4ff0-aa4f-6dba4aa4d9c4 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:22.789746 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-bf2e24e3-5580-4ff0-aa4f-6dba4aa4d9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:22.804728 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e24e3-5580-4ff0-aa4f-6dba4aa4d9c4 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:22.813332 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455eba3-67d5-434e-9105-d172d0b199e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:22.814348 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455eba3-67d5-434e-9105-d172d0b199e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:22.814872 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455eba3-67d5-434e-9105-d172d0b199e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:22.815484 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455eba3-67d5-434e-9105-d172d0b199e8 admin admin] PATH_INFO: `/v3/projects/4f0e1a0a6fd54407a9e7119d6826b97e` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:22.817250 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455eba3-67d5-434e-9105-d172d0b199e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f0e1a0a6fd54407a9e7119d6826b97e)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:22.821407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455eba3-67d5-434e-9105-d172d0b199e8 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:23.117419 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:23.123787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5455eba3-67d5-434e-9105-d172d0b199e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f0e1a0a6fd54407a9e7119d6826b97e', 'request_id': 'req-5455eba3-67d5-434e-9105-d172d0b199e8'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:23.138558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5455eba3-67d5-434e-9105-d172d0b199e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f0e1a0a6fd54407a9e7119d6826b97e', 'request_id': 'req-5455eba3-67d5-434e-9105-d172d0b199e8'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:23.328028 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5455eba3-67d5-434e-9105-d172d0b199e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f0e1a0a6fd54407a9e7119d6826b97e', 'request_id': 'req-5455eba3-67d5-434e-9105-d172d0b199e8'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:23.357576 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5455eba3-67d5-434e-9105-d172d0b199e8 admin admin] The token cache is being invalidate because project 4f0e1a0a6fd54407a9e7119d6826b97e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:49:23.357867 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5455eba3-67d5-434e-9105-d172d0b199e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:23.359222 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5455eba3-67d5-434e-9105-d172d0b199e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:23.366414 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1097/2200] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:49:22 2022] DELETE /identity/v3/projects/4f0e1a0a6fd54407a9e7119d6826b97e => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:49:23.373167 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e099c3d-9807-4969-b478-5a7af31a4e58 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:23.430471 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e099c3d-9807-4969-b478-5a7af31a4e58 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:23.565164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455eba3-67d5-434e-9105-d172d0b199e8 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:23.567712 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5455eba3-67d5-434e-9105-d172d0b199e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:23.574775 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db421d9e-0591-49b9-868f-a98990aefcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:23.577144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db421d9e-0591-49b9-868f-a98990aefcb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:23.577144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db421d9e-0591-49b9-868f-a98990aefcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:23.577144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db421d9e-0591-49b9-868f-a98990aefcb6 admin admin] PATH_INFO: `/v3/users/297c7ec7517f4283aa611ed76dd30580` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:23.578863 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db421d9e-0591-49b9-868f-a98990aefcb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=297c7ec7517f4283aa611ed76dd30580)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:23.581306 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db421d9e-0591-49b9-868f-a98990aefcb6 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:23.617410 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455eba3-67d5-434e-9105-d172d0b199e8 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:23.631368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c6bd3-bcb0-4d96-875d-84976fdf43d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:23.632535 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c6bd3-bcb0-4d96-875d-84976fdf43d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:23.633031 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c6bd3-bcb0-4d96-875d-84976fdf43d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:23.633570 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c6bd3-bcb0-4d96-875d-84976fdf43d2 admin admin] PATH_INFO: `/v3/users/a403acad7caf44b490759d3e9c0548ab` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:23.635476 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c6bd3-bcb0-4d96-875d-84976fdf43d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a403acad7caf44b490759d3e9c0548ab)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:23.638265 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c6bd3-bcb0-4d96-875d-84976fdf43d2 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:23.981732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-db421d9e-0591-49b9-868f-a98990aefcb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '297c7ec7517f4283aa611ed76dd30580'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:23.986192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ac0c6bd3-bcb0-4d96-875d-84976fdf43d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a403acad7caf44b490759d3e9c0548ab'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:23.987717 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ac0c6bd3-bcb0-4d96-875d-84976fdf43d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a403acad7caf44b490759d3e9c0548ab'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:24.019265 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ac0c6bd3-bcb0-4d96-875d-84976fdf43d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a403acad7caf44b490759d3e9c0548ab'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:24.022691 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ac0c6bd3-bcb0-4d96-875d-84976fdf43d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a403acad7caf44b490759d3e9c0548ab'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:24.089468 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-db421d9e-0591-49b9-868f-a98990aefcb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '297c7ec7517f4283aa611ed76dd30580'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:24.090948 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-db421d9e-0591-49b9-868f-a98990aefcb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '297c7ec7517f4283aa611ed76dd30580'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:24.091722 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-db421d9e-0591-49b9-868f-a98990aefcb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '297c7ec7517f4283aa611ed76dd30580'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:24.096469 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:24.106187 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-db421d9e-0591-49b9-868f-a98990aefcb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '297c7ec7517f4283aa611ed76dd30580'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:24.148385 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1104/2201] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:49:23 2022] DELETE /identity/v3/users/297c7ec7517f4283aa611ed76dd30580 => generated 0 bytes in 778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:49:24.218431 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ac0c6bd3-bcb0-4d96-875d-84976fdf43d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a403acad7caf44b490759d3e9c0548ab'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:24.266130 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1098/2202] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:49:23 2022] DELETE /identity/v3/users/a403acad7caf44b490759d3e9c0548ab => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:49:24.274233 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103babb-f55d-41c0-a56e-66112b4ad4f7 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:24.274233 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103babb-f55d-41c0-a56e-66112b4ad4f7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:24.274233 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103babb-f55d-41c0-a56e-66112b4ad4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:24.297917 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-6103babb-f55d-41c0-a56e-66112b4ad4f7 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:24.299213 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6103babb-f55d-41c0-a56e-66112b4ad4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:24.404629 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1105/2203] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:49:24.452578 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c6bd3-bcb0-4d96-875d-84976fdf43d2 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:24.455956 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ac0c6bd3-bcb0-4d96-875d-84976fdf43d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:24.641696 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c6bd3-bcb0-4d96-875d-84976fdf43d2 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:24.660949 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860b511-7218-4996-8db0-e8cae01006b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:24.669283 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860b511-7218-4996-8db0-e8cae01006b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:24.670363 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860b511-7218-4996-8db0-e8cae01006b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:24.671342 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860b511-7218-4996-8db0-e8cae01006b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:24.732405 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860b511-7218-4996-8db0-e8cae01006b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:24.742441 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860b511-7218-4996-8db0-e8cae01006b7 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:24.795941 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1099/2204] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:49:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:49:25.952314 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d898113-7b5a-4d65-a662-8a4948cb288f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:25.953439 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d898113-7b5a-4d65-a662-8a4948cb288f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:25.953952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d898113-7b5a-4d65-a662-8a4948cb288f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:26.013349 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2d898113-7b5a-4d65-a662-8a4948cb288f None None] MFA Rules not processed for user `84fcccb19a5e43ac9da5d7ca501563e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:26.016520 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2d898113-7b5a-4d65-a662-8a4948cb288f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:26.165337 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1106/2205] 10.222.0.26 () {58 vars in 1009 bytes} [Sun Sep 11 08:49:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:49:26.246300 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860b511-7218-4996-8db0-e8cae01006b7 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:26.248019 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-8860b511-7218-4996-8db0-e8cae01006b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:26.299126 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d898113-7b5a-4d65-a662-8a4948cb288f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:26.301551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2d898113-7b5a-4d65-a662-8a4948cb288f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:26.349023 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d898113-7b5a-4d65-a662-8a4948cb288f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:26.362947 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457d4df-cd0b-4af6-8d5d-e9d37fb72491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:26.364549 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457d4df-cd0b-4af6-8d5d-e9d37fb72491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:26.366817 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457d4df-cd0b-4af6-8d5d-e9d37fb72491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:26.367050 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457d4df-cd0b-4af6-8d5d-e9d37fb72491 admin admin] PATH_INFO: `/v3/projects/63259f3d072f43cd988c5663c28bad93` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:26.374547 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457d4df-cd0b-4af6-8d5d-e9d37fb72491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63259f3d072f43cd988c5663c28bad93)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:26.382805 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457d4df-cd0b-4af6-8d5d-e9d37fb72491 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:26.401105 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:26.442659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860b511-7218-4996-8db0-e8cae01006b7 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:26.450887 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eec03f-8d26-4433-8b17-9f44131f8e9f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a4f25df9724d34afdd6a41e719546a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:26.456068 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eec03f-8d26-4433-8b17-9f44131f8e9f service swift] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:26.456691 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eec03f-8d26-4433-8b17-9f44131f8e9f service swift] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:26.457213 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eec03f-8d26-4433-8b17-9f44131f8e9f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:26.472834 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eec03f-8d26-4433-8b17-9f44131f8e9f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:26.475135 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eec03f-8d26-4433-8b17-9f44131f8e9f service swift] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:26.489789 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1100/2206] 10.222.0.26 () {60 vars in 1384 bytes} [Sun Sep 11 08:49:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 11 08:49:26.493302 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eec03f-8d26-4433-8b17-9f44131f8e9f service swift] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:26.495106 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f5eec03f-8d26-4433-8b17-9f44131f8e9f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:26.553386 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eec03f-8d26-4433-8b17-9f44131f8e9f service swift] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:26.591684 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3457d4df-cd0b-4af6-8d5d-e9d37fb72491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63259f3d072f43cd988c5663c28bad93', 'request_id': 'req-3457d4df-cd0b-4af6-8d5d-e9d37fb72491'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:26.602005 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3457d4df-cd0b-4af6-8d5d-e9d37fb72491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63259f3d072f43cd988c5663c28bad93', 'request_id': 'req-3457d4df-cd0b-4af6-8d5d-e9d37fb72491'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:26.723553 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3457d4df-cd0b-4af6-8d5d-e9d37fb72491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63259f3d072f43cd988c5663c28bad93', 'request_id': 'req-3457d4df-cd0b-4af6-8d5d-e9d37fb72491'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:26.753350 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3457d4df-cd0b-4af6-8d5d-e9d37fb72491 admin admin] The token cache is being invalidate because project 63259f3d072f43cd988c5663c28bad93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:49:26.753898 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3457d4df-cd0b-4af6-8d5d-e9d37fb72491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:26.754687 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3457d4df-cd0b-4af6-8d5d-e9d37fb72491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:26.760814 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1107/2207] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:49:26 2022] DELETE /identity/v3/projects/63259f3d072f43cd988c5663c28bad93 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:49:26.763045 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84618dba-6f86-4f44-a5e1-d907256e1338 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:26.763529 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84618dba-6f86-4f44-a5e1-d907256e1338 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:26.763912 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84618dba-6f86-4f44-a5e1-d907256e1338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:26.764057 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744df91-6714-4f1d-a5de-c0e50efb612e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:26.765183 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744df91-6714-4f1d-a5de-c0e50efb612e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:26.765656 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744df91-6714-4f1d-a5de-c0e50efb612e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:26.766167 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744df91-6714-4f1d-a5de-c0e50efb612e admin admin] PATH_INFO: `/v3/projects/c2262f898bf347a597af6b167bfbbf53` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:26.774102 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:26.775971 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744df91-6714-4f1d-a5de-c0e50efb612e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2262f898bf347a597af6b167bfbbf53)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:26.785123 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744df91-6714-4f1d-a5de-c0e50efb612e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:26.792067 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-84618dba-6f86-4f44-a5e1-d907256e1338 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:26.795445 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-84618dba-6f86-4f44-a5e1-d907256e1338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:26.805941 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1108/2208] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:49:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:49:26.816392 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0534a8-604f-48c4-adea-64cf9f53eb7b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:26.820490 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0534a8-604f-48c4-adea-64cf9f53eb7b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:26.820490 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0534a8-604f-48c4-adea-64cf9f53eb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:26.878557 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-8d0534a8-604f-48c4-adea-64cf9f53eb7b None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:26.880689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8d0534a8-604f-48c4-adea-64cf9f53eb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:26.938497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1109/2209] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:49:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:49:26.938497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a56f7-8a33-42fe-9b9d-8b45aaff4c29 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:26.938497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a56f7-8a33-42fe-9b9d-8b45aaff4c29 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:26.938497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a56f7-8a33-42fe-9b9d-8b45aaff4c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:26.997412 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-b45a56f7-8a33-42fe-9b9d-8b45aaff4c29 None None] MFA Rules not processed for user `0c035b3b70c340bf9f52df64449adf5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:26.998903 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b45a56f7-8a33-42fe-9b9d-8b45aaff4c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:27.087831 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2744df91-6714-4f1d-a5de-c0e50efb612e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2262f898bf347a597af6b167bfbbf53', 'request_id': 'req-2744df91-6714-4f1d-a5de-c0e50efb612e'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:27.129542 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2744df91-6714-4f1d-a5de-c0e50efb612e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2262f898bf347a597af6b167bfbbf53', 'request_id': 'req-2744df91-6714-4f1d-a5de-c0e50efb612e'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:27.187527 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1110/2210] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:49:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:49:27.190262 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a56f7-8a33-42fe-9b9d-8b45aaff4c29 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:27.233438 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2744df91-6714-4f1d-a5de-c0e50efb612e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2262f898bf347a597af6b167bfbbf53', 'request_id': 'req-2744df91-6714-4f1d-a5de-c0e50efb612e'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:27.311786 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2744df91-6714-4f1d-a5de-c0e50efb612e admin admin] The token cache is being invalidate because project c2262f898bf347a597af6b167bfbbf53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:49:27.314310 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2744df91-6714-4f1d-a5de-c0e50efb612e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:27.317505 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2744df91-6714-4f1d-a5de-c0e50efb612e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:27.330264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1101/2211] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:49:26 2022] DELETE /identity/v3/projects/c2262f898bf347a597af6b167bfbbf53 => generated 0 bytes in 832 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:49:27.333262 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679a751-63c1-406f-b9f5-befa57651531 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:27.334221 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679a751-63c1-406f-b9f5-befa57651531 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:27.335321 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679a751-63c1-406f-b9f5-befa57651531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:27.392703 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-9679a751-63c1-406f-b9f5-befa57651531 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:27.402981 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9679a751-63c1-406f-b9f5-befa57651531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:27.405067 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a56f7-8a33-42fe-9b9d-8b45aaff4c29 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:27.415201 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb0f6a-8c5f-49b3-85b4-071dad57385f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:27.415201 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb0f6a-8c5f-49b3-85b4-071dad57385f admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:27.415201 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb0f6a-8c5f-49b3-85b4-071dad57385f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:27.415201 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb0f6a-8c5f-49b3-85b4-071dad57385f admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:27.416592 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb0f6a-8c5f-49b3-85b4-071dad57385f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:49:27.416592 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb0f6a-8c5f-49b3-85b4-071dad57385f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:27.417942 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb0f6a-8c5f-49b3-85b4-071dad57385f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:27.444969 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1111/2212] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:49:27.446621 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb0f6a-8c5f-49b3-85b4-071dad57385f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:27.453938 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9dfb0f6a-8c5f-49b3-85b4-071dad57385f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:27.463236 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1102/2213] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:49:27.478259 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab11344-f1de-428a-b8a4-b644b9703254 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:27.478577 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab11344-f1de-428a-b8a4-b644b9703254 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:27.478740 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab11344-f1de-428a-b8a4-b644b9703254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:27.490617 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb0f6a-8c5f-49b3-85b4-071dad57385f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:27.501888 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b316ce3-ed13-4829-988c-41ef4decab0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:27.503779 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b316ce3-ed13-4829-988c-41ef4decab0b admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:27.504714 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b316ce3-ed13-4829-988c-41ef4decab0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:27.505611 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b316ce3-ed13-4829-988c-41ef4decab0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:27.507600 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b316ce3-ed13-4829-988c-41ef4decab0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:27.512838 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b316ce3-ed13-4829-988c-41ef4decab0b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:27.545693 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-6ab11344-f1de-428a-b8a4-b644b9703254 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:27.547741 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6ab11344-f1de-428a-b8a4-b644b9703254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:27.572688 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1103/2214] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:49:27.579100 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab11344-f1de-428a-b8a4-b644b9703254 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:27.603900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab11344-f1de-428a-b8a4-b644b9703254 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:27.617451 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb414025-1f7b-4272-a2a2-d203f120908c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:27.618747 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb414025-1f7b-4272-a2a2-d203f120908c admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:27.619206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb414025-1f7b-4272-a2a2-d203f120908c admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:27.619754 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb414025-1f7b-4272-a2a2-d203f120908c admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:27.620713 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb414025-1f7b-4272-a2a2-d203f120908c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:49:27.621900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb414025-1f7b-4272-a2a2-d203f120908c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:27.624950 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb414025-1f7b-4272-a2a2-d203f120908c admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:27.664504 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1104/2215] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:49:27.671189 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb414025-1f7b-4272-a2a2-d203f120908c admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:27.689020 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1112/2216] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:49:27 2022] POST /identity/v3/projects => generated 385 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:49:27.694251 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b316ce3-ed13-4829-988c-41ef4decab0b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:27.695935 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb414025-1f7b-4272-a2a2-d203f120908c admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:27.843358 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:27.930413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0393e-a18d-40da-8975-299a12c2ef84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:27.933279 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0393e-a18d-40da-8975-299a12c2ef84 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:27.945450 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0393e-a18d-40da-8975-299a12c2ef84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:27.945450 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0393e-a18d-40da-8975-299a12c2ef84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:27.945450 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0393e-a18d-40da-8975-299a12c2ef84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:27.948166 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0393e-a18d-40da-8975-299a12c2ef84 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:28.051909 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b316ce3-ed13-4829-988c-41ef4decab0b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:28.060522 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a688033-4be6-4e2b-9401-2f3325fa9122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:28.061636 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a688033-4be6-4e2b-9401-2f3325fa9122 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:28.062157 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a688033-4be6-4e2b-9401-2f3325fa9122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:28.062774 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a688033-4be6-4e2b-9401-2f3325fa9122 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:28.064254 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a688033-4be6-4e2b-9401-2f3325fa9122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:28.068540 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a688033-4be6-4e2b-9401-2f3325fa9122 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:28.093235 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:28.120780 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1105/2217] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:49:27 2022] POST /identity/v3/projects => generated 389 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:49:28.126924 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0393e-a18d-40da-8975-299a12c2ef84 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:28.259758 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1113/2218] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:49:27 2022] POST /identity/v3/users => generated 293 bytes in 566 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:49:28.261806 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a688033-4be6-4e2b-9401-2f3325fa9122 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:28.328275 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a688033-4be6-4e2b-9401-2f3325fa9122 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:28.387151 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0393e-a18d-40da-8975-299a12c2ef84 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:28.395136 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1da7bd-63fe-45e2-b8ab-e33f9ad45435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:28.397084 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1da7bd-63fe-45e2-b8ab-e33f9ad45435 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:28.398046 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1da7bd-63fe-45e2-b8ab-e33f9ad45435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:28.400600 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1da7bd-63fe-45e2-b8ab-e33f9ad45435 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:28.418501 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1da7bd-63fe-45e2-b8ab-e33f9ad45435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:28.429196 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1da7bd-63fe-45e2-b8ab-e33f9ad45435 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:28.487019 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3897d-eae6-4ba2-8d25-d2067506bb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:28.510994 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3897d-eae6-4ba2-8d25-d2067506bb15 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:28.531577 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3897d-eae6-4ba2-8d25-d2067506bb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:28.540421 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3897d-eae6-4ba2-8d25-d2067506bb15 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:28.540421 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3897d-eae6-4ba2-8d25-d2067506bb15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:28.564146 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3897d-eae6-4ba2-8d25-d2067506bb15 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:28.564430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1114/2219] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:49:28.564430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1da7bd-63fe-45e2-b8ab-e33f9ad45435 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:28.628127 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1da7bd-63fe-45e2-b8ab-e33f9ad45435 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:28.714355 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec6e57-b278-40dc-be06-1f9f7adc5f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:28.715508 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec6e57-b278-40dc-be06-1f9f7adc5f50 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:28.716010 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec6e57-b278-40dc-be06-1f9f7adc5f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:28.716522 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec6e57-b278-40dc-be06-1f9f7adc5f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:28.717765 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec6e57-b278-40dc-be06-1f9f7adc5f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:28.721270 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec6e57-b278-40dc-be06-1f9f7adc5f50 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:28.783277 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1115/2220] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:49:28.785342 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec6e57-b278-40dc-be06-1f9f7adc5f50 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:28.808745 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec6e57-b278-40dc-be06-1f9f7adc5f50 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:28.819369 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c8142-a4d2-4a9b-84f1-a13c0929a4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:28.820517 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c8142-a4d2-4a9b-84f1-a13c0929a4c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:28.828419 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c8142-a4d2-4a9b-84f1-a13c0929a4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:28.831132 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c8142-a4d2-4a9b-84f1-a13c0929a4c6 admin admin] PATH_INFO: `/v3/projects/a3de86c15a5649ecbb9e0f000d313d2d/users/4617ddc01c9f4a3fa5f379884ae28787/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:28.889951 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c8142-a4d2-4a9b-84f1-a13c0929a4c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3de86c15a5649ecbb9e0f000d313d2d, user_id=4617ddc01c9f4a3fa5f379884ae28787, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:28.895444 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c8142-a4d2-4a9b-84f1-a13c0929a4c6 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:28.942022 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1106/2221] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:49:28 2022] POST /identity/v3/users => generated 295 bytes in 813 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:49:28.943795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3897d-eae6-4ba2-8d25-d2067506bb15 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:28.972998 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3897d-eae6-4ba2-8d25-d2067506bb15 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:28.986195 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b3491-1793-4993-85cd-4c95a03efc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:28.987531 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b3491-1793-4993-85cd-4c95a03efc5d admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:28.988147 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b3491-1793-4993-85cd-4c95a03efc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:28.989154 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b3491-1793-4993-85cd-4c95a03efc5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:28.989648 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b3491-1793-4993-85cd-4c95a03efc5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:29.002980 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b3491-1793-4993-85cd-4c95a03efc5d admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:29.013029 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1107/2222] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:49:29.014350 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b3491-1793-4993-85cd-4c95a03efc5d admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:29.030808 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b3491-1793-4993-85cd-4c95a03efc5d admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:29.035994 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea1dc3-b8bd-47d2-80c2-f7dbe2f6b009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:29.036689 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea1dc3-b8bd-47d2-80c2-f7dbe2f6b009 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:29.036977 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea1dc3-b8bd-47d2-80c2-f7dbe2f6b009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:29.037250 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea1dc3-b8bd-47d2-80c2-f7dbe2f6b009 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:29.038059 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea1dc3-b8bd-47d2-80c2-f7dbe2f6b009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:29.041688 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea1dc3-b8bd-47d2-80c2-f7dbe2f6b009 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:29.074058 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1108/2223] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:49:29.077220 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea1dc3-b8bd-47d2-80c2-f7dbe2f6b009 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:29.108645 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1116/2224] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:49:28 2022] PUT /identity/v3/projects/a3de86c15a5649ecbb9e0f000d313d2d/users/4617ddc01c9f4a3fa5f379884ae28787/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:49:29.118394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662a2fd-da7c-4e67-9ac6-bcb598fb7a00 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:29.119444 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea1dc3-b8bd-47d2-80c2-f7dbe2f6b009 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:29.119810 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662a2fd-da7c-4e67-9ac6-bcb598fb7a00 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:29.120511 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662a2fd-da7c-4e67-9ac6-bcb598fb7a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:29.177463 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-d662a2fd-da7c-4e67-9ac6-bcb598fb7a00 None None] MFA Rules not processed for user `4617ddc01c9f4a3fa5f379884ae28787`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:29.179752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d662a2fd-da7c-4e67-9ac6-bcb598fb7a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:29.354607 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1117/2225] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:49:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:49:29.357253 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662a2fd-da7c-4e67-9ac6-bcb598fb7a00 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:29.395846 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58a9c7-f84f-4dac-a344-77ed04e7e614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:29.397339 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58a9c7-f84f-4dac-a344-77ed04e7e614 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:29.397816 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58a9c7-f84f-4dac-a344-77ed04e7e614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:29.398349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58a9c7-f84f-4dac-a344-77ed04e7e614 admin admin] PATH_INFO: `/v3/projects/9fd8a05a86b1406fb4aebb62b1e7c094/users/90f4985d7e354e48b1e7008c5359d812/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:29.492351 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58a9c7-f84f-4dac-a344-77ed04e7e614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fd8a05a86b1406fb4aebb62b1e7c094, user_id=90f4985d7e354e48b1e7008c5359d812, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:29.507297 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58a9c7-f84f-4dac-a344-77ed04e7e614 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:29.542890 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662a2fd-da7c-4e67-9ac6-bcb598fb7a00 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:29.571479 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ebba6-cf96-4e9f-adb2-b75ecb023942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:29.572375 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ebba6-cf96-4e9f-adb2-b75ecb023942 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:29.572783 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ebba6-cf96-4e9f-adb2-b75ecb023942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:29.573115 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ebba6-cf96-4e9f-adb2-b75ecb023942 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:29.574085 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ebba6-cf96-4e9f-adb2-b75ecb023942 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:29.581018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ebba6-cf96-4e9f-adb2-b75ecb023942 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:29.696195 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1109/2226] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:49:29 2022] PUT /identity/v3/projects/9fd8a05a86b1406fb4aebb62b1e7c094/users/90f4985d7e354e48b1e7008c5359d812/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:49:29.697973 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6758bdb-c374-4623-a1f2-3d050828fec5 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:29.698262 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6758bdb-c374-4623-a1f2-3d050828fec5 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:29.698540 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6758bdb-c374-4623-a1f2-3d050828fec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:29.794793 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1118/2227] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:49:29 2022] POST /identity/v3/projects => generated 385 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:49:29.797211 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ebba6-cf96-4e9f-adb2-b75ecb023942 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:29.827085 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-c6758bdb-c374-4623-a1f2-3d050828fec5 None None] MFA Rules not processed for user `90f4985d7e354e48b1e7008c5359d812`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:29.828981 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c6758bdb-c374-4623-a1f2-3d050828fec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:29.855504 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:29.888465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:29.990919 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ebba6-cf96-4e9f-adb2-b75ecb023942 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:29.999353 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38085723-14c1-4f88-b096-cedb11d7fc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:29.999999 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38085723-14c1-4f88-b096-cedb11d7fc3a admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:30.000811 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38085723-14c1-4f88-b096-cedb11d7fc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:30.001105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38085723-14c1-4f88-b096-cedb11d7fc3a admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:30.002209 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38085723-14c1-4f88-b096-cedb11d7fc3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:30.005435 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38085723-14c1-4f88-b096-cedb11d7fc3a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:30.054689 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1110/2228] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:49:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:49:30.115003 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6758bdb-c374-4623-a1f2-3d050828fec5 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:30.115003 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c6758bdb-c374-4623-a1f2-3d050828fec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:30.271588 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1119/2229] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:49:29 2022] POST /identity/v3/users => generated 299 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:49:30.276400 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38085723-14c1-4f88-b096-cedb11d7fc3a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:30.292482 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6758bdb-c374-4623-a1f2-3d050828fec5 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:30.306212 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8996c-8cc7-4a8f-8334-ff2f1db45d73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:30.309839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8996c-8cc7-4a8f-8334-ff2f1db45d73 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:30.309839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8996c-8cc7-4a8f-8334-ff2f1db45d73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:30.309839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8996c-8cc7-4a8f-8334-ff2f1db45d73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:30.332752 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8996c-8cc7-4a8f-8334-ff2f1db45d73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:30.334287 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8996c-8cc7-4a8f-8334-ff2f1db45d73 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:30.346263 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38085723-14c1-4f88-b096-cedb11d7fc3a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:30.368111 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1111/2230] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:49:30 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:49:30.375824 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e251bb-be7c-4eaf-8acf-c1aa307b7c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:30.378609 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e251bb-be7c-4eaf-8acf-c1aa307b7c20 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:30.379121 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e251bb-be7c-4eaf-8acf-c1aa307b7c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:30.384194 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e251bb-be7c-4eaf-8acf-c1aa307b7c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:30.386715 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e251bb-be7c-4eaf-8acf-c1aa307b7c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:30.391341 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e251bb-be7c-4eaf-8acf-c1aa307b7c20 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:30.440736 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1120/2231] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:49:30.443179 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8996c-8cc7-4a8f-8334-ff2f1db45d73 service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:30.471477 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8996c-8cc7-4a8f-8334-ff2f1db45d73 service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:30.499190 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71c02c-50e2-42b3-b3ba-22141e34dd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:30.500324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71c02c-50e2-42b3-b3ba-22141e34dd39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:30.500799 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71c02c-50e2-42b3-b3ba-22141e34dd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:30.501170 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71c02c-50e2-42b3-b3ba-22141e34dd39 admin admin] PATH_INFO: `/v3/projects/54538283e12847f3ac64ba1e060cb292/users/6e6b68332248471fba277c1971aafe65/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:30.588450 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71c02c-50e2-42b3-b3ba-22141e34dd39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54538283e12847f3ac64ba1e060cb292, user_id=6e6b68332248471fba277c1971aafe65, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:30.610381 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71c02c-50e2-42b3-b3ba-22141e34dd39 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:30.790933 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1112/2232] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:49:30 2022] PUT /identity/v3/projects/54538283e12847f3ac64ba1e060cb292/users/6e6b68332248471fba277c1971aafe65/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:49:30.791892 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e251bb-be7c-4eaf-8acf-c1aa307b7c20 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:30.810408 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e251bb-be7c-4eaf-8acf-c1aa307b7c20 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:30.954575 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a47e425-b376-4bcc-9bd0-cfff6c444dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:30.955697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47e425-b376-4bcc-9bd0-cfff6c444dda admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:30.956151 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47e425-b376-4bcc-9bd0-cfff6c444dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:30.956587 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47e425-b376-4bcc-9bd0-cfff6c444dda admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:30.957946 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a47e425-b376-4bcc-9bd0-cfff6c444dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:30.960335 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a47e425-b376-4bcc-9bd0-cfff6c444dda admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:30.985713 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1121/2233] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:49:30.986447 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71c02c-50e2-42b3-b3ba-22141e34dd39 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:31.006563 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71c02c-50e2-42b3-b3ba-22141e34dd39 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:31.020483 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29150d5a-fb41-44a3-b6cf-1e546a9337ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:31.020947 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29150d5a-fb41-44a3-b6cf-1e546a9337ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:31.021060 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29150d5a-fb41-44a3-b6cf-1e546a9337ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:31.021639 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29150d5a-fb41-44a3-b6cf-1e546a9337ee admin admin] PATH_INFO: `/v3/projects/54538283e12847f3ac64ba1e060cb292/users/6e6b68332248471fba277c1971aafe65/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:31.028853 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29150d5a-fb41-44a3-b6cf-1e546a9337ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=54538283e12847f3ac64ba1e060cb292, user_id=6e6b68332248471fba277c1971aafe65, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:31.036211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29150d5a-fb41-44a3-b6cf-1e546a9337ee admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:31.059394 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1113/2234] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:49:30 2022] PUT /identity/v3/projects/54538283e12847f3ac64ba1e060cb292/users/6e6b68332248471fba277c1971aafe65/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:49:31.071361 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8647d-8187-4657-9e75-59c055af96ca None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:31.072015 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8647d-8187-4657-9e75-59c055af96ca None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:31.072369 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8647d-8187-4657-9e75-59c055af96ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:31.174686 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-ffa8647d-8187-4657-9e75-59c055af96ca None None] MFA Rules not processed for user `6e6b68332248471fba277c1971aafe65`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:31.177479 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ffa8647d-8187-4657-9e75-59c055af96ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:31.475857 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1122/2235] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:49:31 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:49:31.493211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29150d5a-fb41-44a3-b6cf-1e546a9337ee admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:31.496173 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-29150d5a-fb41-44a3-b6cf-1e546a9337ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:31.677206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29150d5a-fb41-44a3-b6cf-1e546a9337ee admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:31.700489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed28ea-612f-4ef8-ac38-82b11c03356d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:31.702885 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed28ea-612f-4ef8-ac38-82b11c03356d service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:31.703485 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed28ea-612f-4ef8-ac38-82b11c03356d service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:31.703976 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed28ea-612f-4ef8-ac38-82b11c03356d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:31.741551 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed28ea-612f-4ef8-ac38-82b11c03356d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:31.749102 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed28ea-612f-4ef8-ac38-82b11c03356d service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:31.867407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1114/2236] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:49:31 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:49:31.934067 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8647d-8187-4657-9e75-59c055af96ca None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:32.074038 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:32.140925 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8647d-8187-4657-9e75-59c055af96ca None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:32.148788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5370e-2f70-4951-9841-58fd58f50423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:32.148788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5370e-2f70-4951-9841-58fd58f50423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:32.148788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5370e-2f70-4951-9841-58fd58f50423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:32.148788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5370e-2f70-4951-9841-58fd58f50423 admin admin] PATH_INFO: `/v3/users/4617ddc01c9f4a3fa5f379884ae28787` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:32.149489 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e5370e-2f70-4951-9841-58fd58f50423 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4617ddc01c9f4a3fa5f379884ae28787)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:32.151200 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e5370e-2f70-4951-9841-58fd58f50423 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:33.026730 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-52e5370e-2f70-4951-9841-58fd58f50423 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4617ddc01c9f4a3fa5f379884ae28787'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:33.114123 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-52e5370e-2f70-4951-9841-58fd58f50423 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4617ddc01c9f4a3fa5f379884ae28787'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:33.114766 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-52e5370e-2f70-4951-9841-58fd58f50423 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4617ddc01c9f4a3fa5f379884ae28787'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:33.115502 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-52e5370e-2f70-4951-9841-58fd58f50423 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4617ddc01c9f4a3fa5f379884ae28787'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:33.132360 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-52e5370e-2f70-4951-9841-58fd58f50423 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4617ddc01c9f4a3fa5f379884ae28787'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:33.229217 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1123/2237] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:49:31 2022] DELETE /identity/v3/users/4617ddc01c9f4a3fa5f379884ae28787 => generated 0 bytes in 1294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:49:33.235718 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71ba62-e5fa-4e0d-8b76-49125d29e8ad None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:33.241261 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71ba62-e5fa-4e0d-8b76-49125d29e8ad None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:33.241261 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71ba62-e5fa-4e0d-8b76-49125d29e8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:33.311716 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-7f71ba62-e5fa-4e0d-8b76-49125d29e8ad None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:33.316589 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7f71ba62-e5fa-4e0d-8b76-49125d29e8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:33.353632 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:33.458294 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1115/2238] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:49:33.473877 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5370e-2f70-4951-9841-58fd58f50423 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:33.477057 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-52e5370e-2f70-4951-9841-58fd58f50423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:33.638344 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5370e-2f70-4951-9841-58fd58f50423 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:33.646684 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935edcd-23ed-4e65-83da-6fb067a73d0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:33.647446 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935edcd-23ed-4e65-83da-6fb067a73d0a service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:33.650226 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935edcd-23ed-4e65-83da-6fb067a73d0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:33.650686 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935edcd-23ed-4e65-83da-6fb067a73d0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:33.685114 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935edcd-23ed-4e65-83da-6fb067a73d0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:33.686715 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935edcd-23ed-4e65-83da-6fb067a73d0a service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:33.728968 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1124/2239] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:49:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:49:34.887992 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71ba62-e5fa-4e0d-8b76-49125d29e8ad None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:34.890351 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7f71ba62-e5fa-4e0d-8b76-49125d29e8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:34.916930 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71ba62-e5fa-4e0d-8b76-49125d29e8ad None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:34.933970 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943daa5-0ba8-4391-9dc7-58f0b8b54043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:34.936026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943daa5-0ba8-4391-9dc7-58f0b8b54043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:34.936026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943daa5-0ba8-4391-9dc7-58f0b8b54043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:34.936026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943daa5-0ba8-4391-9dc7-58f0b8b54043 admin admin] PATH_INFO: `/v3/projects/a3de86c15a5649ecbb9e0f000d313d2d` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:34.944027 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943daa5-0ba8-4391-9dc7-58f0b8b54043 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3de86c15a5649ecbb9e0f000d313d2d)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:34.947825 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943daa5-0ba8-4391-9dc7-58f0b8b54043 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:35.194329 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f943daa5-0ba8-4391-9dc7-58f0b8b54043 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3de86c15a5649ecbb9e0f000d313d2d', 'request_id': 'req-f943daa5-0ba8-4391-9dc7-58f0b8b54043'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:35.215628 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f943daa5-0ba8-4391-9dc7-58f0b8b54043 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3de86c15a5649ecbb9e0f000d313d2d', 'request_id': 'req-f943daa5-0ba8-4391-9dc7-58f0b8b54043'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:35.299183 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f943daa5-0ba8-4391-9dc7-58f0b8b54043 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3de86c15a5649ecbb9e0f000d313d2d', 'request_id': 'req-f943daa5-0ba8-4391-9dc7-58f0b8b54043'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:35.336008 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f943daa5-0ba8-4391-9dc7-58f0b8b54043 admin admin] The token cache is being invalidate because project a3de86c15a5649ecbb9e0f000d313d2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:49:35.336389 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f943daa5-0ba8-4391-9dc7-58f0b8b54043 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:35.339981 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f943daa5-0ba8-4391-9dc7-58f0b8b54043 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:35.342941 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1116/2240] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:49:34 2022] DELETE /identity/v3/projects/a3de86c15a5649ecbb9e0f000d313d2d => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:49:35.346944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935edcd-23ed-4e65-83da-6fb067a73d0a service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:35.370100 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935edcd-23ed-4e65-83da-6fb067a73d0a service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:35.474806 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:35.503853 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c97f68-0d86-48de-88de-fe85c2bec437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:35.504613 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c97f68-0d86-48de-88de-fe85c2bec437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:35.504937 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c97f68-0d86-48de-88de-fe85c2bec437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:35.505120 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c97f68-0d86-48de-88de-fe85c2bec437 admin admin] PATH_INFO: `/v3/users/6e6b68332248471fba277c1971aafe65` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:35.511037 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c97f68-0d86-48de-88de-fe85c2bec437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e6b68332248471fba277c1971aafe65)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:35.517483 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c97f68-0d86-48de-88de-fe85c2bec437 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:35.838863 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f0c97f68-0d86-48de-88de-fe85c2bec437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e6b68332248471fba277c1971aafe65'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:35.978319 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f0c97f68-0d86-48de-88de-fe85c2bec437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e6b68332248471fba277c1971aafe65'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:35.979061 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f0c97f68-0d86-48de-88de-fe85c2bec437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e6b68332248471fba277c1971aafe65'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:35.979797 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f0c97f68-0d86-48de-88de-fe85c2bec437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e6b68332248471fba277c1971aafe65'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:36.003477 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f0c97f68-0d86-48de-88de-fe85c2bec437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e6b68332248471fba277c1971aafe65'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:36.061717 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1125/2241] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:49:35 2022] DELETE /identity/v3/users/6e6b68332248471fba277c1971aafe65 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:49:37.530228 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943daa5-0ba8-4391-9dc7-58f0b8b54043 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:37.533430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f943daa5-0ba8-4391-9dc7-58f0b8b54043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:37.609980 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943daa5-0ba8-4391-9dc7-58f0b8b54043 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:37.888910 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a53f7b-5846-42e7-81f8-156aabc0d81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:37.890143 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a53f7b-5846-42e7-81f8-156aabc0d81f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:37.890588 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a53f7b-5846-42e7-81f8-156aabc0d81f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:37.891030 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a53f7b-5846-42e7-81f8-156aabc0d81f admin admin] PATH_INFO: `/v3/projects/54538283e12847f3ac64ba1e060cb292` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:37.894210 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a53f7b-5846-42e7-81f8-156aabc0d81f admin admin] RBAC: Authorizing `identity:delete_project(project_id=54538283e12847f3ac64ba1e060cb292)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:37.896766 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a53f7b-5846-42e7-81f8-156aabc0d81f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:38.808464 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:38.816248 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a4a53f7b-5846-42e7-81f8-156aabc0d81f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54538283e12847f3ac64ba1e060cb292', 'request_id': 'req-a4a53f7b-5846-42e7-81f8-156aabc0d81f'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:38.826771 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a4a53f7b-5846-42e7-81f8-156aabc0d81f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54538283e12847f3ac64ba1e060cb292', 'request_id': 'req-a4a53f7b-5846-42e7-81f8-156aabc0d81f'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:39.019888 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a4a53f7b-5846-42e7-81f8-156aabc0d81f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54538283e12847f3ac64ba1e060cb292', 'request_id': 'req-a4a53f7b-5846-42e7-81f8-156aabc0d81f'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:39.103457 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a4a53f7b-5846-42e7-81f8-156aabc0d81f admin admin] The token cache is being invalidate because project 54538283e12847f3ac64ba1e060cb292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:49:39.103949 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a4a53f7b-5846-42e7-81f8-156aabc0d81f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:39.108208 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a4a53f7b-5846-42e7-81f8-156aabc0d81f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:39.129740 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1117/2242] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:49:37 2022] DELETE /identity/v3/projects/54538283e12847f3ac64ba1e060cb292 => generated 0 bytes in 1601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:49:39.134559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19379ffc-fe30-4141-87f8-8bf6fb7fce76 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:39.135527 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19379ffc-fe30-4141-87f8-8bf6fb7fce76 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:39.135527 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19379ffc-fe30-4141-87f8-8bf6fb7fce76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:39.190296 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-19379ffc-fe30-4141-87f8-8bf6fb7fce76 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:39.191806 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-19379ffc-fe30-4141-87f8-8bf6fb7fce76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:39.333228 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b8423-2566-4f8a-8991-68c908c16151 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:39.333543 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b8423-2566-4f8a-8991-68c908c16151 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:39.333822 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b8423-2566-4f8a-8991-68c908c16151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:39.345378 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1126/2243] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:49:39.366063 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-bf9b8423-2566-4f8a-8991-68c908c16151 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:39.367762 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-bf9b8423-2566-4f8a-8991-68c908c16151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:39.387362 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1118/2244] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:49:39.392581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19379ffc-fe30-4141-87f8-8bf6fb7fce76 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:39.418598 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19379ffc-fe30-4141-87f8-8bf6fb7fce76 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:39.429917 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9501bb3-4a0e-44b4-8384-e19150d02bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:39.433404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9501bb3-4a0e-44b4-8384-e19150d02bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:39.433404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9501bb3-4a0e-44b4-8384-e19150d02bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:39.433404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9501bb3-4a0e-44b4-8384-e19150d02bf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:39.436430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9501bb3-4a0e-44b4-8384-e19150d02bf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:49:39.437272 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9501bb3-4a0e-44b4-8384-e19150d02bf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:39.441859 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9501bb3-4a0e-44b4-8384-e19150d02bf2 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:39.488903 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1127/2245] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:49:39.493981 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b8423-2566-4f8a-8991-68c908c16151 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:39.529419 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b8423-2566-4f8a-8991-68c908c16151 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:39.537532 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701bff5-03d8-4467-8031-7784073dca64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:39.538723 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701bff5-03d8-4467-8031-7784073dca64 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:39.539156 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701bff5-03d8-4467-8031-7784073dca64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:39.539698 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701bff5-03d8-4467-8031-7784073dca64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:39.541134 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701bff5-03d8-4467-8031-7784073dca64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:39.552986 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701bff5-03d8-4467-8031-7784073dca64 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:39.988767 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1119/2246] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:49:39 2022] POST /identity/v3/projects => generated 381 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:49:39.992724 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9501bb3-4a0e-44b4-8384-e19150d02bf2 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:40.016840 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9501bb3-4a0e-44b4-8384-e19150d02bf2 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:40.112917 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:40.125589 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd584e-2034-4bb0-8d17-45d8efba19e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:40.130147 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd584e-2034-4bb0-8d17-45d8efba19e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:40.130147 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd584e-2034-4bb0-8d17-45d8efba19e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:40.130147 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd584e-2034-4bb0-8d17-45d8efba19e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:40.130147 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd584e-2034-4bb0-8d17-45d8efba19e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:40.130147 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd584e-2034-4bb0-8d17-45d8efba19e0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:40.281873 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1128/2247] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:49:39 2022] POST /identity/v3/users => generated 291 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:49:40.286621 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701bff5-03d8-4467-8031-7784073dca64 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:40.319566 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701bff5-03d8-4467-8031-7784073dca64 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:40.333459 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b223ed9-a97d-4017-8da1-4f826c57bb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:40.336071 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b223ed9-a97d-4017-8da1-4f826c57bb8e admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:40.336726 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b223ed9-a97d-4017-8da1-4f826c57bb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:40.337136 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b223ed9-a97d-4017-8da1-4f826c57bb8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:40.338048 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b223ed9-a97d-4017-8da1-4f826c57bb8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:40.340211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b223ed9-a97d-4017-8da1-4f826c57bb8e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:40.356640 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1120/2248] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:49:40.359538 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd584e-2034-4bb0-8d17-45d8efba19e0 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:40.396755 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd584e-2034-4bb0-8d17-45d8efba19e0 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:40.432330 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41d0f1-701c-4848-acfb-7dd9c5550bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:40.432330 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41d0f1-701c-4848-acfb-7dd9c5550bcb admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:40.432330 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41d0f1-701c-4848-acfb-7dd9c5550bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:40.432330 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41d0f1-701c-4848-acfb-7dd9c5550bcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:40.432664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41d0f1-701c-4848-acfb-7dd9c5550bcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:40.434555 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41d0f1-701c-4848-acfb-7dd9c5550bcb admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:40.472397 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b223ed9-a97d-4017-8da1-4f826c57bb8e admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:40.482781 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1129/2249] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:49:40.496711 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b223ed9-a97d-4017-8da1-4f826c57bb8e admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:40.526207 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb603ea-e25d-4e3b-a07c-2595e1fa8a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:40.532026 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb603ea-e25d-4e3b-a07c-2595e1fa8a7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:40.532764 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb603ea-e25d-4e3b-a07c-2595e1fa8a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:40.533374 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb603ea-e25d-4e3b-a07c-2595e1fa8a7e admin admin] PATH_INFO: `/v3/projects/f1e13af78ee44a0d87b401b488ab5923/users/8cfd3009fe134753a16172689fce7973/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:40.602539 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb603ea-e25d-4e3b-a07c-2595e1fa8a7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1e13af78ee44a0d87b401b488ab5923, user_id=8cfd3009fe134753a16172689fce7973, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:40.634314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb603ea-e25d-4e3b-a07c-2595e1fa8a7e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:40.783271 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1121/2250] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:49:40 2022] PUT /identity/v3/projects/f1e13af78ee44a0d87b401b488ab5923/users/8cfd3009fe134753a16172689fce7973/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:49:40.812083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcb826-cf10-4d94-9a57-c30d70f10d7f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:40.812389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcb826-cf10-4d94-9a57-c30d70f10d7f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:40.812625 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcb826-cf10-4d94-9a57-c30d70f10d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:40.856263 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-9cdcb826-cf10-4d94-9a57-c30d70f10d7f None None] MFA Rules not processed for user `8cfd3009fe134753a16172689fce7973`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:40.865768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9cdcb826-cf10-4d94-9a57-c30d70f10d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:41.019176 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1130/2251] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:49:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:49:41.020335 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb603ea-e25d-4e3b-a07c-2595e1fa8a7e admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:41.347205 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb603ea-e25d-4e3b-a07c-2595e1fa8a7e admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:41.362915 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b89bbc-f67d-4dd0-9c3a-f36acc86a301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:41.373534 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b89bbc-f67d-4dd0-9c3a-f36acc86a301 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:41.375494 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b89bbc-f67d-4dd0-9c3a-f36acc86a301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:41.375914 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b89bbc-f67d-4dd0-9c3a-f36acc86a301 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:41.378460 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b89bbc-f67d-4dd0-9c3a-f36acc86a301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:41.391348 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b89bbc-f67d-4dd0-9c3a-f36acc86a301 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:41.554285 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1122/2252] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:49:41 2022] POST /identity/v3/projects => generated 379 bytes in 534 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:49:41.560896 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcb826-cf10-4d94-9a57-c30d70f10d7f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:41.638789 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcb826-cf10-4d94-9a57-c30d70f10d7f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:41.981399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04558cbb-850f-4d6d-828c-0eac06018cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:41.982496 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04558cbb-850f-4d6d-828c-0eac06018cce admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:41.982989 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04558cbb-850f-4d6d-828c-0eac06018cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:41.983601 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04558cbb-850f-4d6d-828c-0eac06018cce admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:41.984772 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04558cbb-850f-4d6d-828c-0eac06018cce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:41.988801 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04558cbb-850f-4d6d-828c-0eac06018cce admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:42.126756 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1131/2253] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:49:41 2022] POST /identity/v3/users => generated 296 bytes in 566 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:49:42.131051 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b89bbc-f67d-4dd0-9c3a-f36acc86a301 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:42.179532 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b89bbc-f67d-4dd0-9c3a-f36acc86a301 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:42.203534 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cd52c-6550-4e79-a01c-971097be6d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:42.204551 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cd52c-6550-4e79-a01c-971097be6d82 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:42.204973 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cd52c-6550-4e79-a01c-971097be6d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:42.205429 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cd52c-6550-4e79-a01c-971097be6d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:42.206578 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330cd52c-6550-4e79-a01c-971097be6d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:42.213791 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330cd52c-6550-4e79-a01c-971097be6d82 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:42.253277 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1123/2254] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:49:42.258502 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04558cbb-850f-4d6d-828c-0eac06018cce admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:42.331548 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04558cbb-850f-4d6d-828c-0eac06018cce admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:42.360519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b4826-86a9-4fef-afef-31a677242422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:42.361768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b4826-86a9-4fef-afef-31a677242422 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:42.364611 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b4826-86a9-4fef-afef-31a677242422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:42.365041 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b4826-86a9-4fef-afef-31a677242422 admin admin] PATH_INFO: `/v3/projects/26c03650fc6148c184d45d68c30cbbdb/users/9c6b76f5fdb2421dadda3a48cbf533fc/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:42.424047 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b4826-86a9-4fef-afef-31a677242422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26c03650fc6148c184d45d68c30cbbdb, user_id=9c6b76f5fdb2421dadda3a48cbf533fc, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:42.429226 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b4826-86a9-4fef-afef-31a677242422 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:42.545493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1132/2255] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:49:42 2022] PUT /identity/v3/projects/26c03650fc6148c184d45d68c30cbbdb/users/9c6b76f5fdb2421dadda3a48cbf533fc/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:49:42.552702 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cd52c-6550-4e79-a01c-971097be6d82 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:42.575778 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cd52c-6550-4e79-a01c-971097be6d82 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:42.661129 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:42.688394 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3079d-1e23-4f01-a5e0-80df065547c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:42.690527 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3079d-1e23-4f01-a5e0-80df065547c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:42.691178 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3079d-1e23-4f01-a5e0-80df065547c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:42.691809 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3079d-1e23-4f01-a5e0-80df065547c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:42.693799 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3079d-1e23-4f01-a5e0-80df065547c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:42.697965 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3079d-1e23-4f01-a5e0-80df065547c4 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:42.717190 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1124/2256] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:49:42.721439 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b4826-86a9-4fef-afef-31a677242422 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:42.737633 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b4826-86a9-4fef-afef-31a677242422 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:42.749157 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946c167-8d80-4df1-a1bc-32d021f967e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:42.750456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946c167-8d80-4df1-a1bc-32d021f967e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:42.750974 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946c167-8d80-4df1-a1bc-32d021f967e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:42.751492 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946c167-8d80-4df1-a1bc-32d021f967e9 admin admin] PATH_INFO: `/v3/projects/26c03650fc6148c184d45d68c30cbbdb/users/9c6b76f5fdb2421dadda3a48cbf533fc/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:42.764247 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946c167-8d80-4df1-a1bc-32d021f967e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26c03650fc6148c184d45d68c30cbbdb, user_id=9c6b76f5fdb2421dadda3a48cbf533fc, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:42.767743 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946c167-8d80-4df1-a1bc-32d021f967e9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:42.793869 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1133/2257] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:49:42 2022] PUT /identity/v3/projects/26c03650fc6148c184d45d68c30cbbdb/users/9c6b76f5fdb2421dadda3a48cbf533fc/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:49:42.795962 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd852fc-cd26-4cce-a5b6-7a0fc62bd25e None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:42.797398 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd852fc-cd26-4cce-a5b6-7a0fc62bd25e None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:42.798142 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd852fc-cd26-4cce-a5b6-7a0fc62bd25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:42.853586 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-1dd852fc-cd26-4cce-a5b6-7a0fc62bd25e None None] MFA Rules not processed for user `9c6b76f5fdb2421dadda3a48cbf533fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:42.857269 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1dd852fc-cd26-4cce-a5b6-7a0fc62bd25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:43.242487 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1125/2258] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:49:42 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:49:43.272237 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946c167-8d80-4df1-a1bc-32d021f967e9 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:43.274914 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f946c167-8d80-4df1-a1bc-32d021f967e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:43.328873 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:43.474257 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946c167-8d80-4df1-a1bc-32d021f967e9 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:43.480315 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969567b-bb3e-4fd5-b2b5-80a7e0c9d1c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:43.483791 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969567b-bb3e-4fd5-b2b5-80a7e0c9d1c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:43.484204 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969567b-bb3e-4fd5-b2b5-80a7e0c9d1c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:43.484564 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969567b-bb3e-4fd5-b2b5-80a7e0c9d1c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:43.509991 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a969567b-bb3e-4fd5-b2b5-80a7e0c9d1c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:43.515149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a969567b-bb3e-4fd5-b2b5-80a7e0c9d1c3 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:43.541386 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1134/2259] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:49:43 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:49:45.849396 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd852fc-cd26-4cce-a5b6-7a0fc62bd25e None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:45.882089 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd852fc-cd26-4cce-a5b6-7a0fc62bd25e None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:45.905376 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4853d8c-8f3a-42e3-8c78-786cd6769903 tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6b76f5fdb2421dadda3a48cbf533fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c03650fc6148c184d45d68c30cbbdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:45.906448 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4853d8c-8f3a-42e3-8c78-786cd6769903 tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:45.906990 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4853d8c-8f3a-42e3-8c78-786cd6769903 tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:45.907597 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4853d8c-8f3a-42e3-8c78-786cd6769903 tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:45.908625 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4853d8c-8f3a-42e3-8c78-786cd6769903 tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:49:45.910603 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4853d8c-8f3a-42e3-8c78-786cd6769903 tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:45.916550 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4853d8c-8f3a-42e3-8c78-786cd6769903 tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:45.964837 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969567b-bb3e-4fd5-b2b5-80a7e0c9d1c3 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:45.972991 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1126/2260] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:49:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:49:45.977993 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969567b-bb3e-4fd5-b2b5-80a7e0c9d1c3 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:45.985512 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1148d00-980f-42f5-9dbe-8644c31613c2 tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6b76f5fdb2421dadda3a48cbf533fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c03650fc6148c184d45d68c30cbbdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:45.988365 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1148d00-980f-42f5-9dbe-8644c31613c2 tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:45.988930 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1148d00-980f-42f5-9dbe-8644c31613c2 tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:45.989495 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1148d00-980f-42f5-9dbe-8644c31613c2 tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:45.991069 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1148d00-980f-42f5-9dbe-8644c31613c2 tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:45.993713 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1148d00-980f-42f5-9dbe-8644c31613c2 tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:46.227309 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1135/2261] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:49:45 2022] POST /identity/v3/projects => generated 354 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:49:46.229692 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4853d8c-8f3a-42e3-8c78-786cd6769903 tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:46.268286 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4853d8c-8f3a-42e3-8c78-786cd6769903 tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:46.363557 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7624c55-8547-45d6-bf04-c386e70f178c tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6b76f5fdb2421dadda3a48cbf533fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c03650fc6148c184d45d68c30cbbdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:46.364182 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7624c55-8547-45d6-bf04-c386e70f178c tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:46.364591 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7624c55-8547-45d6-bf04-c386e70f178c tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:46.364993 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7624c55-8547-45d6-bf04-c386e70f178c tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:46.365821 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7624c55-8547-45d6-bf04-c386e70f178c tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:49:46.366246 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7624c55-8547-45d6-bf04-c386e70f178c tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:46.368351 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7624c55-8547-45d6-bf04-c386e70f178c tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:46.393470 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1127/2262] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:49:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:49:46.453702 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1148d00-980f-42f5-9dbe-8644c31613c2 tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:46.466582 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1148d00-980f-42f5-9dbe-8644c31613c2 tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:46.480073 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7e4ee-01cc-4724-a897-5ce47323c880 tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6b76f5fdb2421dadda3a48cbf533fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c03650fc6148c184d45d68c30cbbdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:46.481047 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7e4ee-01cc-4724-a897-5ce47323c880 tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:46.481741 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7e4ee-01cc-4724-a897-5ce47323c880 tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:46.482258 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7e4ee-01cc-4724-a897-5ce47323c880 tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] PATH_INFO: `/v3/projects/9e24071d050444798362dd769fb44100` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:46.484375 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7e4ee-01cc-4724-a897-5ce47323c880 tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9e24071d050444798362dd769fb44100)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:46.487395 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7e4ee-01cc-4724-a897-5ce47323c880 tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:46.748551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e9d7e4ee-01cc-4724-a897-5ce47323c880 tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e24071d050444798362dd769fb44100', 'request_id': 'req-e9d7e4ee-01cc-4724-a897-5ce47323c880'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:46.759397 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e9d7e4ee-01cc-4724-a897-5ce47323c880 tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e24071d050444798362dd769fb44100', 'request_id': 'req-e9d7e4ee-01cc-4724-a897-5ce47323c880'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:46.922803 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e9d7e4ee-01cc-4724-a897-5ce47323c880 tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e24071d050444798362dd769fb44100', 'request_id': 'req-e9d7e4ee-01cc-4724-a897-5ce47323c880'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:46.937896 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e9d7e4ee-01cc-4724-a897-5ce47323c880 tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] The token cache is being invalidate because project 9e24071d050444798362dd769fb44100 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:49:46.938426 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e9d7e4ee-01cc-4724-a897-5ce47323c880 tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:46.939197 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e9d7e4ee-01cc-4724-a897-5ce47323c880 tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:46.940933 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1136/2263] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:49:46 2022] DELETE /identity/v3/projects/9e24071d050444798362dd769fb44100 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:49:47.872359 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7624c55-8547-45d6-bf04-c386e70f178c tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:47.875356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-a7624c55-8547-45d6-bf04-c386e70f178c tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:47.953788 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:47.981472 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7624c55-8547-45d6-bf04-c386e70f178c tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:47.996989 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7e4ee-01cc-4724-a897-5ce47323c880 tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:47.998732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e9d7e4ee-01cc-4724-a897-5ce47323c880 tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:48.090028 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae925a47-9976-42aa-9bd9-9d06c663cfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:48.091078 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae925a47-9976-42aa-9bd9-9d06c663cfcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:48.091617 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae925a47-9976-42aa-9bd9-9d06c663cfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:48.092088 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae925a47-9976-42aa-9bd9-9d06c663cfcb admin admin] PATH_INFO: `/v3/users/90f4985d7e354e48b1e7008c5359d812` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:48.094636 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae925a47-9976-42aa-9bd9-9d06c663cfcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=90f4985d7e354e48b1e7008c5359d812)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:48.099593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae925a47-9976-42aa-9bd9-9d06c663cfcb admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:48.148657 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7e4ee-01cc-4724-a897-5ce47323c880 tempest-VolumeQuotaClassesTest-874525874 tempest-VolumeQuotaClassesTest-874525874-project-admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:48.161847 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3af603-19f2-4096-9726-4f47f2d00bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:48.169335 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3af603-19f2-4096-9726-4f47f2d00bca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:48.169335 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3af603-19f2-4096-9726-4f47f2d00bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:48.169335 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3af603-19f2-4096-9726-4f47f2d00bca admin admin] PATH_INFO: `/v3/users/8cfd3009fe134753a16172689fce7973` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:48.172194 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3af603-19f2-4096-9726-4f47f2d00bca admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cfd3009fe134753a16172689fce7973)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:48.179407 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3af603-19f2-4096-9726-4f47f2d00bca admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:48.234020 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:48.487523 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ae925a47-9976-42aa-9bd9-9d06c663cfcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90f4985d7e354e48b1e7008c5359d812'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:48.489175 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ae925a47-9976-42aa-9bd9-9d06c663cfcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90f4985d7e354e48b1e7008c5359d812'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:48.491164 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fe3af603-19f2-4096-9726-4f47f2d00bca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cfd3009fe134753a16172689fce7973'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:48.507969 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ae925a47-9976-42aa-9bd9-9d06c663cfcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90f4985d7e354e48b1e7008c5359d812'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:48.509777 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ae925a47-9976-42aa-9bd9-9d06c663cfcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90f4985d7e354e48b1e7008c5359d812'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:48.617810 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fe3af603-19f2-4096-9726-4f47f2d00bca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cfd3009fe134753a16172689fce7973'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:48.618739 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fe3af603-19f2-4096-9726-4f47f2d00bca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cfd3009fe134753a16172689fce7973'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:48.620308 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fe3af603-19f2-4096-9726-4f47f2d00bca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cfd3009fe134753a16172689fce7973'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:48.641830 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fe3af603-19f2-4096-9726-4f47f2d00bca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cfd3009fe134753a16172689fce7973'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:48.702135 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1137/2264] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:49:47 2022] DELETE /identity/v3/users/8cfd3009fe134753a16172689fce7973 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:49:48.706024 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a7360-0e88-4fd9-951c-b44ef45b299f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:48.707614 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a7360-0e88-4fd9-951c-b44ef45b299f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:48.708582 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a7360-0e88-4fd9-951c-b44ef45b299f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:48.757186 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-111a7360-0e88-4fd9-951c-b44ef45b299f None None] MFA Rules not processed for user `84fcccb19a5e43ac9da5d7ca501563e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:48.759711 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-111a7360-0e88-4fd9-951c-b44ef45b299f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:48.787089 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ae925a47-9976-42aa-9bd9-9d06c663cfcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90f4985d7e354e48b1e7008c5359d812'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:48.818077 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1128/2265] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:49:47 2022] DELETE /identity/v3/users/90f4985d7e354e48b1e7008c5359d812 => generated 0 bytes in 947 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:49:48.819538 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234a779-c600-4097-8d41-683d3288e897 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:48.819830 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234a779-c600-4097-8d41-683d3288e897 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:48.820111 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234a779-c600-4097-8d41-683d3288e897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:48.847979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-1234a779-c600-4097-8d41-683d3288e897 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:48.849246 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1234a779-c600-4097-8d41-683d3288e897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:48.900375 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1138/2266] 10.222.0.26 () {58 vars in 967 bytes} [Sun Sep 11 08:49:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:49:48.903886 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5e5a7-412d-4193-a219-fe16c2bee7d5 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:48.905593 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5e5a7-412d-4193-a219-fe16c2bee7d5 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:48.906291 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5e5a7-412d-4193-a219-fe16c2bee7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:48.962362 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-73f5e5a7-412d-4193-a219-fe16c2bee7d5 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:48.963109 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1129/2267] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:49:48.964882 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-73f5e5a7-412d-4193-a219-fe16c2bee7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:48.965247 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234a779-c600-4097-8d41-683d3288e897 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:48.969737 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1234a779-c600-4097-8d41-683d3288e897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:48.985365 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1139/2268] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:49:48.985365 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5e5a7-412d-4193-a219-fe16c2bee7d5 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:48.985365 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-73f5e5a7-412d-4193-a219-fe16c2bee7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:49.045802 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:49.149933 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5e5a7-412d-4193-a219-fe16c2bee7d5 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:49.158490 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a065438-c65c-410b-b4c8-9a5ea733d075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:49.159863 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a065438-c65c-410b-b4c8-9a5ea733d075 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:49.160533 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a065438-c65c-410b-b4c8-9a5ea733d075 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:49.161271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a065438-c65c-410b-b4c8-9a5ea733d075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:49.185260 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a065438-c65c-410b-b4c8-9a5ea733d075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:49.187323 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a065438-c65c-410b-b4c8-9a5ea733d075 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:49.211345 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1140/2269] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:49:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:49:49.212765 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a065438-c65c-410b-b4c8-9a5ea733d075 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:49.226904 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234a779-c600-4097-8d41-683d3288e897 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:49.242194 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3ad6a-fe38-40a5-9704-fece8a704a4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a4f25df9724d34afdd6a41e719546a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:49.247816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a065438-c65c-410b-b4c8-9a5ea733d075 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:49.248081 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3ad6a-fe38-40a5-9704-fece8a704a4e service swift] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:49.248412 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3ad6a-fe38-40a5-9704-fece8a704a4e service swift] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:49.248880 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3ad6a-fe38-40a5-9704-fece8a704a4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:49.265336 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d9dcf-4b26-47d3-8e5e-a5956c44f21f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:49.269715 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d9dcf-4b26-47d3-8e5e-a5956c44f21f service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:49.270201 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d9dcf-4b26-47d3-8e5e-a5956c44f21f service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:49.270659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d9dcf-4b26-47d3-8e5e-a5956c44f21f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:49.338534 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d9dcf-4b26-47d3-8e5e-a5956c44f21f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:49.341667 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d9dcf-4b26-47d3-8e5e-a5956c44f21f service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:49.384290 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1141/2270] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:49:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:49:49.434012 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3ad6a-fe38-40a5-9704-fece8a704a4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:49.436457 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3ad6a-fe38-40a5-9704-fece8a704a4e service swift] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:49.450139 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1130/2271] 10.222.0.26 () {60 vars in 1384 bytes} [Sun Sep 11 08:49:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 08:49:49.575485 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7445a7c-1b69-437d-8e3c-c7181a2f6a95 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:49.575982 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7445a7c-1b69-437d-8e3c-c7181a2f6a95 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:49.576467 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7445a7c-1b69-437d-8e3c-c7181a2f6a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:49.601351 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c7445a7c-1b69-437d-8e3c-c7181a2f6a95 None None] MFA Rules not processed for user `84fcccb19a5e43ac9da5d7ca501563e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:49.602633 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c7445a7c-1b69-437d-8e3c-c7181a2f6a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:49.611470 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1142/2272] 10.222.0.26 () {58 vars in 1009 bytes} [Sun Sep 11 08:49:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:49:49.626482 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3ad6a-fe38-40a5-9704-fece8a704a4e service swift] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:49.639736 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3ad6a-fe38-40a5-9704-fece8a704a4e service swift] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:49.645391 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c26661-1ecc-4565-9ece-6577f109d1fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a4f25df9724d34afdd6a41e719546a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:49.646025 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c26661-1ecc-4565-9ece-6577f109d1fa service swift] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:49.646304 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c26661-1ecc-4565-9ece-6577f109d1fa service swift] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:49.646576 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c26661-1ecc-4565-9ece-6577f109d1fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:49.658345 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c26661-1ecc-4565-9ece-6577f109d1fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:49.660435 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c26661-1ecc-4565-9ece-6577f109d1fa service swift] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:49.677098 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1131/2273] 10.222.0.26 () {60 vars in 1384 bytes} [Sun Sep 11 08:49:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 08:49:50.071105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7445a7c-1b69-437d-8e3c-c7181a2f6a95 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:50.073687 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c7445a7c-1b69-437d-8e3c-c7181a2f6a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:50.113678 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c26661-1ecc-4565-9ece-6577f109d1fa service swift] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:50.116696 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-63c26661-1ecc-4565-9ece-6577f109d1fa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:50.127701 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7445a7c-1b69-437d-8e3c-c7181a2f6a95 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:50.137757 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79dec8-ce4a-40b5-9f45-5fa66094a36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:50.139549 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79dec8-ce4a-40b5-9f45-5fa66094a36c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:50.140340 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79dec8-ce4a-40b5-9f45-5fa66094a36c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:50.141027 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79dec8-ce4a-40b5-9f45-5fa66094a36c admin admin] PATH_INFO: `/v3/projects/f1e13af78ee44a0d87b401b488ab5923` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:50.143676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79dec8-ce4a-40b5-9f45-5fa66094a36c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1e13af78ee44a0d87b401b488ab5923)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:50.149095 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79dec8-ce4a-40b5-9f45-5fa66094a36c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:50.168057 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c26661-1ecc-4565-9ece-6577f109d1fa service swift] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:50.180281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e8268-0167-4ecf-9b1a-db88953dc026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:50.181896 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:50.183960 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e8268-0167-4ecf-9b1a-db88953dc026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:50.184414 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e8268-0167-4ecf-9b1a-db88953dc026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:50.184897 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e8268-0167-4ecf-9b1a-db88953dc026 admin admin] PATH_INFO: `/v3/projects/9fd8a05a86b1406fb4aebb62b1e7c094` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:50.188246 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e8268-0167-4ecf-9b1a-db88953dc026 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fd8a05a86b1406fb4aebb62b1e7c094)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:50.206591 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e8268-0167-4ecf-9b1a-db88953dc026 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:50.400226 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4e79dec8-ce4a-40b5-9f45-5fa66094a36c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1e13af78ee44a0d87b401b488ab5923', 'request_id': 'req-4e79dec8-ce4a-40b5-9f45-5fa66094a36c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:50.411488 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4e79dec8-ce4a-40b5-9f45-5fa66094a36c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1e13af78ee44a0d87b401b488ab5923', 'request_id': 'req-4e79dec8-ce4a-40b5-9f45-5fa66094a36c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:50.455466 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-036e8268-0167-4ecf-9b1a-db88953dc026 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fd8a05a86b1406fb4aebb62b1e7c094', 'request_id': 'req-036e8268-0167-4ecf-9b1a-db88953dc026'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:50.465609 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-036e8268-0167-4ecf-9b1a-db88953dc026 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fd8a05a86b1406fb4aebb62b1e7c094', 'request_id': 'req-036e8268-0167-4ecf-9b1a-db88953dc026'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:50.586931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4e79dec8-ce4a-40b5-9f45-5fa66094a36c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1e13af78ee44a0d87b401b488ab5923', 'request_id': 'req-4e79dec8-ce4a-40b5-9f45-5fa66094a36c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:50.633379 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4e79dec8-ce4a-40b5-9f45-5fa66094a36c admin admin] The token cache is being invalidate because project f1e13af78ee44a0d87b401b488ab5923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:49:50.633379 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4e79dec8-ce4a-40b5-9f45-5fa66094a36c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:50.633379 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4e79dec8-ce4a-40b5-9f45-5fa66094a36c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:50.633379 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1143/2274] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:49:50 2022] DELETE /identity/v3/projects/f1e13af78ee44a0d87b401b488ab5923 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:49:50.633379 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79dec8-ce4a-40b5-9f45-5fa66094a36c admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:50.634025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4e79dec8-ce4a-40b5-9f45-5fa66094a36c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:50.706499 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-036e8268-0167-4ecf-9b1a-db88953dc026 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fd8a05a86b1406fb4aebb62b1e7c094', 'request_id': 'req-036e8268-0167-4ecf-9b1a-db88953dc026'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:50.740203 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-036e8268-0167-4ecf-9b1a-db88953dc026 admin admin] The token cache is being invalidate because project 9fd8a05a86b1406fb4aebb62b1e7c094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:49:50.740508 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-036e8268-0167-4ecf-9b1a-db88953dc026 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:50.741282 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-036e8268-0167-4ecf-9b1a-db88953dc026 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:50.755313 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1132/2275] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:49:50 2022] DELETE /identity/v3/projects/9fd8a05a86b1406fb4aebb62b1e7c094 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:49:50.761940 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79dec8-ce4a-40b5-9f45-5fa66094a36c admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:50.900160 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33cdd50-d7eb-4e00-8f2a-bc79f85b1d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:50.900160 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33cdd50-d7eb-4e00-8f2a-bc79f85b1d27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:50.900160 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33cdd50-d7eb-4e00-8f2a-bc79f85b1d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:50.900160 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33cdd50-d7eb-4e00-8f2a-bc79f85b1d27 admin admin] PATH_INFO: `/v3/users/9c6b76f5fdb2421dadda3a48cbf533fc` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:50.900701 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33cdd50-d7eb-4e00-8f2a-bc79f85b1d27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c6b76f5fdb2421dadda3a48cbf533fc)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:50.904431 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33cdd50-d7eb-4e00-8f2a-bc79f85b1d27 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:51.077607 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac01653-011a-4013-ada3-29d3400e3c8d None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:51.077607 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac01653-011a-4013-ada3-29d3400e3c8d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:51.077607 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac01653-011a-4013-ada3-29d3400e3c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:51.100583 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-1ac01653-011a-4013-ada3-29d3400e3c8d None None] MFA Rules not processed for user `84fcccb19a5e43ac9da5d7ca501563e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:51.102648 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1ac01653-011a-4013-ada3-29d3400e3c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:51.129082 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:51.166735 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1133/2276] 10.222.0.26 () {58 vars in 967 bytes} [Sun Sep 11 08:49:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:49:51.181125 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac01653-011a-4013-ada3-29d3400e3c8d None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:51.183137 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1ac01653-011a-4013-ada3-29d3400e3c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:51.228503 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c33cdd50-d7eb-4e00-8f2a-bc79f85b1d27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c6b76f5fdb2421dadda3a48cbf533fc'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:51.233914 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:51.294619 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac01653-011a-4013-ada3-29d3400e3c8d None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:51.303490 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6e7e8-4291-46ed-a8bb-b6f3f201f152 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a4f25df9724d34afdd6a41e719546a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:51.304577 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6e7e8-4291-46ed-a8bb-b6f3f201f152 service swift] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:51.305094 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6e7e8-4291-46ed-a8bb-b6f3f201f152 service swift] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:51.305608 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6e7e8-4291-46ed-a8bb-b6f3f201f152 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:51.317014 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6e7e8-4291-46ed-a8bb-b6f3f201f152 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:51.318982 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6e7e8-4291-46ed-a8bb-b6f3f201f152 service swift] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:51.329122 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1134/2277] 10.222.0.26 () {60 vars in 1384 bytes} [Sun Sep 11 08:49:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 11 08:49:51.409711 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c33cdd50-d7eb-4e00-8f2a-bc79f85b1d27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c6b76f5fdb2421dadda3a48cbf533fc'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:51.411664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c33cdd50-d7eb-4e00-8f2a-bc79f85b1d27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c6b76f5fdb2421dadda3a48cbf533fc'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:51.412621 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c33cdd50-d7eb-4e00-8f2a-bc79f85b1d27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c6b76f5fdb2421dadda3a48cbf533fc'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:51.422972 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c33cdd50-d7eb-4e00-8f2a-bc79f85b1d27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c6b76f5fdb2421dadda3a48cbf533fc'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:51.448341 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1144/2278] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:49:50 2022] DELETE /identity/v3/users/9c6b76f5fdb2421dadda3a48cbf533fc => generated 0 bytes in 819 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:49:52.281621 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6e7e8-4291-46ed-a8bb-b6f3f201f152 service swift] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:52.284069 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b2a6e7e8-4291-46ed-a8bb-b6f3f201f152 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:52.316169 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6e7e8-4291-46ed-a8bb-b6f3f201f152 service swift] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:52.408908 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a55d6-9433-44e3-a648-77165472cfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:52.409576 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a55d6-9433-44e3-a648-77165472cfea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:52.409859 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a55d6-9433-44e3-a648-77165472cfea admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:52.410301 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a55d6-9433-44e3-a648-77165472cfea admin admin] PATH_INFO: `/v3/projects/26c03650fc6148c184d45d68c30cbbdb` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:52.412151 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a55d6-9433-44e3-a648-77165472cfea admin admin] RBAC: Authorizing `identity:delete_project(project_id=26c03650fc6148c184d45d68c30cbbdb)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:52.416966 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a55d6-9433-44e3-a648-77165472cfea admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:52.454465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df467b0b-646c-44bc-baae-fdb1c6277e0d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:52.456012 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df467b0b-646c-44bc-baae-fdb1c6277e0d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:52.457188 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df467b0b-646c-44bc-baae-fdb1c6277e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:52.493601 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-df467b0b-646c-44bc-baae-fdb1c6277e0d None None] MFA Rules not processed for user `84fcccb19a5e43ac9da5d7ca501563e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:52.494970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-df467b0b-646c-44bc-baae-fdb1c6277e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:52.569149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1145/2279] 10.222.0.26 () {58 vars in 1009 bytes} [Sun Sep 11 08:49:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:49:52.584594 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df467b0b-646c-44bc-baae-fdb1c6277e0d None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:52.587503 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-df467b0b-646c-44bc-baae-fdb1c6277e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:52.614352 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-156a55d6-9433-44e3-a648-77165472cfea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26c03650fc6148c184d45d68c30cbbdb', 'request_id': 'req-156a55d6-9433-44e3-a648-77165472cfea'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:52.625858 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-156a55d6-9433-44e3-a648-77165472cfea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26c03650fc6148c184d45d68c30cbbdb', 'request_id': 'req-156a55d6-9433-44e3-a648-77165472cfea'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:52.628089 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:52.688124 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df467b0b-646c-44bc-baae-fdb1c6277e0d None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:52.770146 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8907c-d14f-488a-91a0-6ea02c7e8dd2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a4f25df9724d34afdd6a41e719546a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:52.773684 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8907c-d14f-488a-91a0-6ea02c7e8dd2 service swift] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:52.773684 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8907c-d14f-488a-91a0-6ea02c7e8dd2 service swift] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:52.773684 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8907c-d14f-488a-91a0-6ea02c7e8dd2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:52.794706 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:52.799749 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-156a55d6-9433-44e3-a648-77165472cfea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26c03650fc6148c184d45d68c30cbbdb', 'request_id': 'req-156a55d6-9433-44e3-a648-77165472cfea'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:52.831090 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-156a55d6-9433-44e3-a648-77165472cfea admin admin] The token cache is being invalidate because project 26c03650fc6148c184d45d68c30cbbdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:49:52.832629 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-156a55d6-9433-44e3-a648-77165472cfea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:52.833752 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-156a55d6-9433-44e3-a648-77165472cfea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:52.836348 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1135/2280] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:49:52 2022] DELETE /identity/v3/projects/26c03650fc6148c184d45d68c30cbbdb => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:49:52.846101 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea9964-59ad-4328-b15b-7fa76f5bd377 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:52.847136 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea9964-59ad-4328-b15b-7fa76f5bd377 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:52.847432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea9964-59ad-4328-b15b-7fa76f5bd377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:52.883766 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8907c-d14f-488a-91a0-6ea02c7e8dd2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:52.885540 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8907c-d14f-488a-91a0-6ea02c7e8dd2 service swift] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:52.886085 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-4bea9964-59ad-4328-b15b-7fa76f5bd377 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:52.889044 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4bea9964-59ad-4328-b15b-7fa76f5bd377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:52.897085 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1146/2281] 10.222.0.26 () {60 vars in 1384 bytes} [Sun Sep 11 08:49:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 11 08:49:52.986150 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1136/2282] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:49:52.998978 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae519f-b3f7-497b-9ebc-dd9da1caec9d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:52.999541 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae519f-b3f7-497b-9ebc-dd9da1caec9d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:53.000216 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae519f-b3f7-497b-9ebc-dd9da1caec9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:53.045458 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-adae519f-b3f7-497b-9ebc-dd9da1caec9d None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:53.046217 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-adae519f-b3f7-497b-9ebc-dd9da1caec9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:53.063292 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1147/2283] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:49:53.069860 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea9964-59ad-4328-b15b-7fa76f5bd377 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:53.087037 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea9964-59ad-4328-b15b-7fa76f5bd377 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:53.093801 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a758ac-d089-47bb-bd24-b58865e48c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:53.094775 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a758ac-d089-47bb-bd24-b58865e48c30 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:53.094775 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a758ac-d089-47bb-bd24-b58865e48c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:53.095091 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a758ac-d089-47bb-bd24-b58865e48c30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:53.095796 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a758ac-d089-47bb-bd24-b58865e48c30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:49:53.096105 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a758ac-d089-47bb-bd24-b58865e48c30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:53.097937 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a758ac-d089-47bb-bd24-b58865e48c30 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:53.144601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1137/2284] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:49:53.148186 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae519f-b3f7-497b-9ebc-dd9da1caec9d None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:53.161159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae519f-b3f7-497b-9ebc-dd9da1caec9d None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:53.182381 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53822d0-aa89-46f0-ab72-00b39b989244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:53.182381 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53822d0-aa89-46f0-ab72-00b39b989244 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:53.182381 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53822d0-aa89-46f0-ab72-00b39b989244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:53.182669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53822d0-aa89-46f0-ab72-00b39b989244 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:53.183458 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53822d0-aa89-46f0-ab72-00b39b989244 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:53.185893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53822d0-aa89-46f0-ab72-00b39b989244 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:53.391696 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1148/2285] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:49:53 2022] POST /identity/v3/projects => generated 385 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:49:53.400630 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a758ac-d089-47bb-bd24-b58865e48c30 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:53.413558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a758ac-d089-47bb-bd24-b58865e48c30 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:53.595937 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b289b-dfb2-42ad-b0bd-70576b8a4edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:53.596847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b289b-dfb2-42ad-b0bd-70576b8a4edd admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:53.596847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b289b-dfb2-42ad-b0bd-70576b8a4edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:53.597117 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b289b-dfb2-42ad-b0bd-70576b8a4edd admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:53.598031 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b289b-dfb2-42ad-b0bd-70576b8a4edd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:53.601756 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b289b-dfb2-42ad-b0bd-70576b8a4edd admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:53.714091 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1138/2286] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:49:53 2022] POST /identity/v3/users => generated 293 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:49:53.720332 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53822d0-aa89-46f0-ab72-00b39b989244 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:53.735015 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53822d0-aa89-46f0-ab72-00b39b989244 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:53.742284 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e748b0a-0e00-4621-8991-8aa37d224a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:53.742944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e748b0a-0e00-4621-8991-8aa37d224a08 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:53.743221 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e748b0a-0e00-4621-8991-8aa37d224a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:53.743542 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e748b0a-0e00-4621-8991-8aa37d224a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:53.744405 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e748b0a-0e00-4621-8991-8aa37d224a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:53.747340 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e748b0a-0e00-4621-8991-8aa37d224a08 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:53.793678 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1149/2287] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:49:53.794697 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b289b-dfb2-42ad-b0bd-70576b8a4edd admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:53.810717 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b289b-dfb2-42ad-b0bd-70576b8a4edd admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:53.830173 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5c039-a0c5-4ed8-bfb6-2ba1fdc977a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:53.830173 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5c039-a0c5-4ed8-bfb6-2ba1fdc977a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:53.830173 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5c039-a0c5-4ed8-bfb6-2ba1fdc977a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:53.830173 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5c039-a0c5-4ed8-bfb6-2ba1fdc977a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:53.831503 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe5c039-a0c5-4ed8-bfb6-2ba1fdc977a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:53.831503 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe5c039-a0c5-4ed8-bfb6-2ba1fdc977a7 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:53.844266 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1139/2288] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:49:53.850063 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e748b0a-0e00-4621-8991-8aa37d224a08 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:53.872710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e748b0a-0e00-4621-8991-8aa37d224a08 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:53.898827 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70731c-72bb-4e4f-8264-bbfd63272826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:53.898827 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70731c-72bb-4e4f-8264-bbfd63272826 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:53.901927 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70731c-72bb-4e4f-8264-bbfd63272826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:53.902565 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70731c-72bb-4e4f-8264-bbfd63272826 admin admin] PATH_INFO: `/v3/projects/939c55596f8f46079285e0a9f86e53fa/users/961f0c472b7d42c29f721b59a3126bbc/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:53.920601 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86d7ea-a45b-4022-95b2-e2c42d17497a None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:53.921091 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86d7ea-a45b-4022-95b2-e2c42d17497a None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:53.921398 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86d7ea-a45b-4022-95b2-e2c42d17497a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:53.946421 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70731c-72bb-4e4f-8264-bbfd63272826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=939c55596f8f46079285e0a9f86e53fa, user_id=961f0c472b7d42c29f721b59a3126bbc, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:53.950070 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70731c-72bb-4e4f-8264-bbfd63272826 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:53.962411 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-6f86d7ea-a45b-4022-95b2-e2c42d17497a None None] MFA Rules not processed for user `84fcccb19a5e43ac9da5d7ca501563e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:53.965988 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6f86d7ea-a45b-4022-95b2-e2c42d17497a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:54.037299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:54.048781 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1140/2289] 10.222.0.26 () {58 vars in 967 bytes} [Sun Sep 11 08:49:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:49:54.063532 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86d7ea-a45b-4022-95b2-e2c42d17497a None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:54.065720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6f86d7ea-a45b-4022-95b2-e2c42d17497a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:54.131799 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1150/2290] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:49:53 2022] PUT /identity/v3/projects/939c55596f8f46079285e0a9f86e53fa/users/961f0c472b7d42c29f721b59a3126bbc/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:49:54.142658 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae16f2-5ae9-401d-a0dc-5235a3d9d23b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:54.143509 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae16f2-5ae9-401d-a0dc-5235a3d9d23b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:54.144351 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae16f2-5ae9-401d-a0dc-5235a3d9d23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:54.169862 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86d7ea-a45b-4022-95b2-e2c42d17497a None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:54.206634 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-4dae16f2-5ae9-401d-a0dc-5235a3d9d23b None None] MFA Rules not processed for user `961f0c472b7d42c29f721b59a3126bbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:54.208490 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4dae16f2-5ae9-401d-a0dc-5235a3d9d23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:54.307213 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7381237-4a56-474c-86e7-4896c3dfaa11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a4f25df9724d34afdd6a41e719546a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:54.309600 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7381237-4a56-474c-86e7-4896c3dfaa11 service swift] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:54.310489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7381237-4a56-474c-86e7-4896c3dfaa11 service swift] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:54.314498 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7381237-4a56-474c-86e7-4896c3dfaa11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:54.324984 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1151/2291] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:49:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:49:54.331136 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae16f2-5ae9-401d-a0dc-5235a3d9d23b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:54.438740 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:54.462396 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae16f2-5ae9-401d-a0dc-5235a3d9d23b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:54.469049 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fb109-1bf7-4093-a0cd-588a38f3005c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:54.469329 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7381237-4a56-474c-86e7-4896c3dfaa11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:54.470493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fb109-1bf7-4093-a0cd-588a38f3005c admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:54.470932 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fb109-1bf7-4093-a0cd-588a38f3005c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:54.471419 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fb109-1bf7-4093-a0cd-588a38f3005c admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:54.472252 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1fb109-1bf7-4093-a0cd-588a38f3005c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:54.474260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7381237-4a56-474c-86e7-4896c3dfaa11 service swift] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:54.474934 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1fb109-1bf7-4093-a0cd-588a38f3005c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:54.486233 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1141/2292] 10.222.0.26 () {60 vars in 1384 bytes} [Sun Sep 11 08:49:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 08:49:54.539432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7381237-4a56-474c-86e7-4896c3dfaa11 service swift] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:54.541980 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e7381237-4a56-474c-86e7-4896c3dfaa11 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:54.571053 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7381237-4a56-474c-86e7-4896c3dfaa11 service swift] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:54.579474 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f6284-0d8d-421b-b373-95167e5e465a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:54.580674 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f6284-0d8d-421b-b373-95167e5e465a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:54.581269 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f6284-0d8d-421b-b373-95167e5e465a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:54.581839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f6284-0d8d-421b-b373-95167e5e465a admin admin] PATH_INFO: `/v3/users/c80fcafb1c34439b93873e1291a4eaeb` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:54.584227 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f6284-0d8d-421b-b373-95167e5e465a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c80fcafb1c34439b93873e1291a4eaeb)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:54.588889 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f6284-0d8d-421b-b373-95167e5e465a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:54.638476 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1152/2293] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:49:54 2022] POST /identity/v3/projects => generated 385 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:49:54.645831 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fb109-1bf7-4093-a0cd-588a38f3005c admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:54.753540 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fb109-1bf7-4093-a0cd-588a38f3005c admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:54.759591 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164e98c-76bf-4d8a-9958-6d61d3dfb411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:54.760385 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164e98c-76bf-4d8a-9958-6d61d3dfb411 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:54.760755 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164e98c-76bf-4d8a-9958-6d61d3dfb411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:54.761124 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164e98c-76bf-4d8a-9958-6d61d3dfb411 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:54.762692 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164e98c-76bf-4d8a-9958-6d61d3dfb411 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:54.764912 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164e98c-76bf-4d8a-9958-6d61d3dfb411 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:54.924259 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1153/2294] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:49:54 2022] POST /identity/v3/users => generated 293 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:49:54.929235 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164e98c-76bf-4d8a-9958-6d61d3dfb411 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:54.950904 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1b9f6284-0d8d-421b-b373-95167e5e465a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c80fcafb1c34439b93873e1291a4eaeb'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:54.953398 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1b9f6284-0d8d-421b-b373-95167e5e465a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c80fcafb1c34439b93873e1291a4eaeb'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:54.955034 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164e98c-76bf-4d8a-9958-6d61d3dfb411 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:54.970723 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1b9f6284-0d8d-421b-b373-95167e5e465a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c80fcafb1c34439b93873e1291a4eaeb'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:54.972476 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1b9f6284-0d8d-421b-b373-95167e5e465a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c80fcafb1c34439b93873e1291a4eaeb'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:54.974310 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1e395-0e61-4ae5-ae9f-d27265ba6c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:54.980897 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1e395-0e61-4ae5-ae9f-d27265ba6c5c admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:54.980897 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1e395-0e61-4ae5-ae9f-d27265ba6c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:54.982064 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1e395-0e61-4ae5-ae9f-d27265ba6c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:54.985369 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1e395-0e61-4ae5-ae9f-d27265ba6c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:54.988397 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1e395-0e61-4ae5-ae9f-d27265ba6c5c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:55.020324 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1154/2295] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:49:55.027031 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:55.029569 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1e395-0e61-4ae5-ae9f-d27265ba6c5c admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:55.035232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-cbe1e395-0e61-4ae5-ae9f-d27265ba6c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:55.053296 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1e395-0e61-4ae5-ae9f-d27265ba6c5c admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:55.061235 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a48ab3-6d06-49de-8ea7-667a482e98a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:55.062107 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a48ab3-6d06-49de-8ea7-667a482e98a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:55.062398 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a48ab3-6d06-49de-8ea7-667a482e98a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:55.062677 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a48ab3-6d06-49de-8ea7-667a482e98a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:55.063519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a48ab3-6d06-49de-8ea7-667a482e98a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:55.068515 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a48ab3-6d06-49de-8ea7-667a482e98a7 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:55.082506 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1155/2296] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:49:55.087867 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a48ab3-6d06-49de-8ea7-667a482e98a7 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:55.121481 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a48ab3-6d06-49de-8ea7-667a482e98a7 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:55.133627 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643505f-037d-4068-b511-7354ca959710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:55.134304 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643505f-037d-4068-b511-7354ca959710 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:55.134592 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643505f-037d-4068-b511-7354ca959710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:55.134871 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643505f-037d-4068-b511-7354ca959710 admin admin] PATH_INFO: `/v3/projects/eb24c00a5f744253bf8296977f5cf29a/users/f7f6c9d8ade54a8496b42f15431cb958/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:55.136910 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1b9f6284-0d8d-421b-b373-95167e5e465a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c80fcafb1c34439b93873e1291a4eaeb'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:55.169122 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1643505f-037d-4068-b511-7354ca959710 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb24c00a5f744253bf8296977f5cf29a, user_id=f7f6c9d8ade54a8496b42f15431cb958, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:55.173872 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1643505f-037d-4068-b511-7354ca959710 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:55.186518 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1142/2297] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:49:54 2022] DELETE /identity/v3/users/c80fcafb1c34439b93873e1291a4eaeb => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:49:55.381671 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1156/2298] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:49:55 2022] PUT /identity/v3/projects/eb24c00a5f744253bf8296977f5cf29a/users/f7f6c9d8ade54a8496b42f15431cb958/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:49:55.405260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602d63d-b1b1-4758-9809-280b8b256622 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:55.406310 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602d63d-b1b1-4758-9809-280b8b256622 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:55.408189 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602d63d-b1b1-4758-9809-280b8b256622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:55.474469 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-d602d63d-b1b1-4758-9809-280b8b256622 None None] MFA Rules not processed for user `f7f6c9d8ade54a8496b42f15431cb958`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:55.475981 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d602d63d-b1b1-4758-9809-280b8b256622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:55.591039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1143/2299] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:49:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:49:55.601098 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643505f-037d-4068-b511-7354ca959710 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:55.858209 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643505f-037d-4068-b511-7354ca959710 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:55.869102 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431c2c0-4d67-4349-b5e9-ea0ed6c6883e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:55.869749 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431c2c0-4d67-4349-b5e9-ea0ed6c6883e admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:55.870037 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431c2c0-4d67-4349-b5e9-ea0ed6c6883e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:55.870313 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431c2c0-4d67-4349-b5e9-ea0ed6c6883e admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:55.879704 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431c2c0-4d67-4349-b5e9-ea0ed6c6883e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:55.880454 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431c2c0-4d67-4349-b5e9-ea0ed6c6883e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:55.935627 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:55.959595 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602d63d-b1b1-4758-9809-280b8b256622 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:55.962414 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d602d63d-b1b1-4758-9809-280b8b256622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:55.986130 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602d63d-b1b1-4758-9809-280b8b256622 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:55.994188 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4644ba-0acc-46b4-bf23-9f57b0e68005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:55.995085 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4644ba-0acc-46b4-bf23-9f57b0e68005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:55.999863 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4644ba-0acc-46b4-bf23-9f57b0e68005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:55.999863 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4644ba-0acc-46b4-bf23-9f57b0e68005 admin admin] PATH_INFO: `/v3/projects/2f5bd35e7b2449bc8f24daea0ba240d5` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:55.999863 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4644ba-0acc-46b4-bf23-9f57b0e68005 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f5bd35e7b2449bc8f24daea0ba240d5)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:56.001369 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4644ba-0acc-46b4-bf23-9f57b0e68005 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:56.076095 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1157/2300] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:49:55 2022] POST /identity/v3/projects => generated 387 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:49:56.077317 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431c2c0-4d67-4349-b5e9-ea0ed6c6883e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:56.178421 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4f4644ba-0acc-46b4-bf23-9f57b0e68005 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f5bd35e7b2449bc8f24daea0ba240d5', 'request_id': 'req-4f4644ba-0acc-46b4-bf23-9f57b0e68005'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:56.188163 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4f4644ba-0acc-46b4-bf23-9f57b0e68005 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f5bd35e7b2449bc8f24daea0ba240d5', 'request_id': 'req-4f4644ba-0acc-46b4-bf23-9f57b0e68005'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:56.207893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431c2c0-4d67-4349-b5e9-ea0ed6c6883e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:56.266159 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4f4644ba-0acc-46b4-bf23-9f57b0e68005 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f5bd35e7b2449bc8f24daea0ba240d5', 'request_id': 'req-4f4644ba-0acc-46b4-bf23-9f57b0e68005'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:56.294499 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4f4644ba-0acc-46b4-bf23-9f57b0e68005 admin admin] The token cache is being invalidate because project 2f5bd35e7b2449bc8f24daea0ba240d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:49:56.295506 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4f4644ba-0acc-46b4-bf23-9f57b0e68005 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:56.296391 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4f4644ba-0acc-46b4-bf23-9f57b0e68005 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:56.299087 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1144/2301] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:49:55 2022] DELETE /identity/v3/projects/2f5bd35e7b2449bc8f24daea0ba240d5 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:49:56.339058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749edce2-1188-49f9-af4e-12887323e6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:56.339847 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749edce2-1188-49f9-af4e-12887323e6b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:56.340403 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749edce2-1188-49f9-af4e-12887323e6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:56.341144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749edce2-1188-49f9-af4e-12887323e6b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:56.342220 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749edce2-1188-49f9-af4e-12887323e6b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:56.344611 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749edce2-1188-49f9-af4e-12887323e6b0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:56.479657 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1158/2302] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:49:56 2022] POST /identity/v3/users => generated 300 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:49:56.486250 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4644ba-0acc-46b4-bf23-9f57b0e68005 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:56.490777 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4f4644ba-0acc-46b4-bf23-9f57b0e68005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:56.514825 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4644ba-0acc-46b4-bf23-9f57b0e68005 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:56.523466 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b47ea8-24bd-4abc-b499-0054f18acae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:56.524630 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b47ea8-24bd-4abc-b499-0054f18acae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:56.525114 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b47ea8-24bd-4abc-b499-0054f18acae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:56.525762 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b47ea8-24bd-4abc-b499-0054f18acae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:56.526655 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b47ea8-24bd-4abc-b499-0054f18acae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:56.529110 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b47ea8-24bd-4abc-b499-0054f18acae6 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:56.576159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d201a84-5862-4e6f-9ed1-95fe04603525 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:56.576440 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d201a84-5862-4e6f-9ed1-95fe04603525 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:56.576707 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d201a84-5862-4e6f-9ed1-95fe04603525 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:56.578176 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1159/2303] 10.222.0.26 () {54 vars in 921 bytes} [Sun Sep 11 08:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 08:49:56.595240 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023b15c-3a5a-4994-95f8-a5e62db0d754 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:56.595664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023b15c-3a5a-4994-95f8-a5e62db0d754 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:56.596187 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023b15c-3a5a-4994-95f8-a5e62db0d754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:56.603304 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1145/2304] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:49:56.610923 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b47ea8-24bd-4abc-b499-0054f18acae6 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:56.656148 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b47ea8-24bd-4abc-b499-0054f18acae6 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:56.660135 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-0023b15c-3a5a-4994-95f8-a5e62db0d754 None None] MFA Rules not processed for user `e62bb9d2e13649b5af239bb56001ce16`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:56.661927 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0023b15c-3a5a-4994-95f8-a5e62db0d754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:56.665127 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b175576-7527-4faf-900c-1c172b196da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:56.666330 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b175576-7527-4faf-900c-1c172b196da3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:56.666791 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b175576-7527-4faf-900c-1c172b196da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:56.667358 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b175576-7527-4faf-900c-1c172b196da3 admin admin] PATH_INFO: `/v3/projects/d9d34dfaa38847ffbff39796c8abf8c4/users/2e9d2914b1ef4fa1891eb3486f43c9e3/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:56.705795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:56.711655 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b175576-7527-4faf-900c-1c172b196da3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9d34dfaa38847ffbff39796c8abf8c4, user_id=2e9d2914b1ef4fa1891eb3486f43c9e3, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:56.717463 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b175576-7527-4faf-900c-1c172b196da3 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:56.833499 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1146/2305] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:49:56 2022] PUT /identity/v3/projects/d9d34dfaa38847ffbff39796c8abf8c4/users/2e9d2914b1ef4fa1891eb3486f43c9e3/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:49:56.840022 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b175576-7527-4faf-900c-1c172b196da3 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:56.854644 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1160/2306] 10.222.0.26 () {58 vars in 1018 bytes} [Sun Sep 11 08:49:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:49:56.882631 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023b15c-3a5a-4994-95f8-a5e62db0d754 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:56.882631 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0023b15c-3a5a-4994-95f8-a5e62db0d754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:56.945055 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:57.020761 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b175576-7527-4faf-900c-1c172b196da3 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:57.024394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023b15c-3a5a-4994-95f8-a5e62db0d754 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:57.027811 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0761f2-3a9b-440b-a511-195aff58d6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:57.028432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0761f2-3a9b-440b-a511-195aff58d6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:57.028888 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0761f2-3a9b-440b-a511-195aff58d6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:57.029173 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0761f2-3a9b-440b-a511-195aff58d6b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:57.030146 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0761f2-3a9b-440b-a511-195aff58d6b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:57.031893 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0761f2-3a9b-440b-a511-195aff58d6b5 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:57.054879 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1147/2307] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:49:57.056787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0761f2-3a9b-440b-a511-195aff58d6b5 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:57.078041 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0761f2-3a9b-440b-a511-195aff58d6b5 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:57.087482 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f51a6b-6dc3-44fd-8806-3751ca6b13cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:57.088577 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f51a6b-6dc3-44fd-8806-3751ca6b13cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:57.089063 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f51a6b-6dc3-44fd-8806-3751ca6b13cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:57.089576 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f51a6b-6dc3-44fd-8806-3751ca6b13cd admin admin] PATH_INFO: `/v3/projects/d9d34dfaa38847ffbff39796c8abf8c4/users/2e9d2914b1ef4fa1891eb3486f43c9e3/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:57.092477 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f51a6b-6dc3-44fd-8806-3751ca6b13cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9d34dfaa38847ffbff39796c8abf8c4, user_id=2e9d2914b1ef4fa1891eb3486f43c9e3, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:57.098016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f51a6b-6dc3-44fd-8806-3751ca6b13cd admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:57.115161 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd190365-57fe-46f5-b189-2fb81692da3a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7690af0cd266458f9cdd799c98ff5bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:57.116973 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd190365-57fe-46f5-b189-2fb81692da3a service glance] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:57.117389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd190365-57fe-46f5-b189-2fb81692da3a service glance] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:57.117783 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd190365-57fe-46f5-b189-2fb81692da3a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:57.120032 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1148/2308] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:49:57 2022] PUT /identity/v3/projects/d9d34dfaa38847ffbff39796c8abf8c4/users/2e9d2914b1ef4fa1891eb3486f43c9e3/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:49:57.208766 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb008c7-0774-4e97-94b7-293b35d5de60 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:57.209108 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb008c7-0774-4e97-94b7-293b35d5de60 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:57.209654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb008c7-0774-4e97-94b7-293b35d5de60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:57.266986 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd190365-57fe-46f5-b189-2fb81692da3a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:57.273030 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd190365-57fe-46f5-b189-2fb81692da3a service glance] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:57.273184 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-8bb008c7-0774-4e97-94b7-293b35d5de60 None None] MFA Rules not processed for user `2e9d2914b1ef4fa1891eb3486f43c9e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:57.274827 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-8bb008c7-0774-4e97-94b7-293b35d5de60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:57.318354 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1161/2309] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:49:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:49:57.446758 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1149/2310] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:49:57 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:49:57.459199 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd190365-57fe-46f5-b189-2fb81692da3a service glance] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:57.461057 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-dd190365-57fe-46f5-b189-2fb81692da3a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:57.570399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd190365-57fe-46f5-b189-2fb81692da3a service glance] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:57.644821 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a872a-989d-4d31-b0fe-903a5bf60371 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:57.645699 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a872a-989d-4d31-b0fe-903a5bf60371 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:57.646170 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a872a-989d-4d31-b0fe-903a5bf60371 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:57.646683 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a872a-989d-4d31-b0fe-903a5bf60371 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:57.654260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47ef32-20fa-438c-bebe-ab7d3f73899c None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:57.655769 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47ef32-20fa-438c-bebe-ab7d3f73899c None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:57.656421 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47ef32-20fa-438c-bebe-ab7d3f73899c None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:57.659892 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1150/2311] 10.222.0.26 () {54 vars in 921 bytes} [Sun Sep 11 08:49:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:49:57.668702 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66773c60-e551-41eb-82c9-bfab07d52106 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:57.669773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66773c60-e551-41eb-82c9-bfab07d52106 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:57.670390 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66773c60-e551-41eb-82c9-bfab07d52106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:57.677433 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a872a-989d-4d31-b0fe-903a5bf60371 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:57.680387 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a872a-989d-4d31-b0fe-903a5bf60371 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:57.709040 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-66773c60-e551-41eb-82c9-bfab07d52106 None None] MFA Rules not processed for user `7c86ca1e378c4042a1807c7a45aaab99`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:57.713133 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1162/2312] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:49:57 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:49:57.714190 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-66773c60-e551-41eb-82c9-bfab07d52106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:57.750675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:57.796735 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1151/2313] 10.222.0.26 () {58 vars in 1018 bytes} [Sun Sep 11 08:49:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:49:57.819296 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a872a-989d-4d31-b0fe-903a5bf60371 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:57.821270 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-af9a872a-989d-4d31-b0fe-903a5bf60371 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:57.842709 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a872a-989d-4d31-b0fe-903a5bf60371 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:57.849957 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb99024-e17a-4715-bd24-912f5eaea0a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:57.851366 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb99024-e17a-4715-bd24-912f5eaea0a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:57.851922 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb99024-e17a-4715-bd24-912f5eaea0a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:57.852385 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb99024-e17a-4715-bd24-912f5eaea0a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:57.868884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb99024-e17a-4715-bd24-912f5eaea0a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:57.869898 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb99024-e17a-4715-bd24-912f5eaea0a5 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:57.885220 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1163/2314] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:49:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:49:58.049349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f39ec1-576d-4c50-94bc-7e68d1875811 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:58.050248 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f39ec1-576d-4c50-94bc-7e68d1875811 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:58.050738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f39ec1-576d-4c50-94bc-7e68d1875811 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:58.053666 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1152/2315] 10.222.0.26 () {54 vars in 921 bytes} [Sun Sep 11 08:49:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:49:58.062669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8dfa6-d675-4572-b494-8ba7691769d2 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:58.063099 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8dfa6-d675-4572-b494-8ba7691769d2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:58.063509 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8dfa6-d675-4572-b494-8ba7691769d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:58.103307 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-b5f8dfa6-d675-4572-b494-8ba7691769d2 None None] MFA Rules not processed for user `e62bb9d2e13649b5af239bb56001ce16`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:58.104836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b5f8dfa6-d675-4572-b494-8ba7691769d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:58.210044 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1164/2316] 10.222.0.26 () {58 vars in 1018 bytes} [Sun Sep 11 08:49:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:49:58.230634 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f39ec1-576d-4c50-94bc-7e68d1875811 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:58.254123 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f39ec1-576d-4c50-94bc-7e68d1875811 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:58.260934 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d34856-e5c7-4b8b-9b4c-9cc641949a0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:58.262559 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d34856-e5c7-4b8b-9b4c-9cc641949a0a service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:58.263181 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d34856-e5c7-4b8b-9b4c-9cc641949a0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:58.263799 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d34856-e5c7-4b8b-9b4c-9cc641949a0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:58.283296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:58.288905 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d34856-e5c7-4b8b-9b4c-9cc641949a0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:58.294203 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d34856-e5c7-4b8b-9b4c-9cc641949a0a service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:58.326132 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1153/2317] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:49:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:49:58.406237 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8dfa6-d675-4572-b494-8ba7691769d2 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:58.410748 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b5f8dfa6-d675-4572-b494-8ba7691769d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:58.500286 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8dfa6-d675-4572-b494-8ba7691769d2 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:58.509450 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ef6f5-108c-494c-b02d-4f43839be3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:58.510394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ef6f5-108c-494c-b02d-4f43839be3e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:58.510743 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ef6f5-108c-494c-b02d-4f43839be3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:58.511177 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ef6f5-108c-494c-b02d-4f43839be3e9 admin admin] PATH_INFO: `/v3/users/75aa8304dc4440ffbec7f74110e61ed1` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:58.513894 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ef6f5-108c-494c-b02d-4f43839be3e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75aa8304dc4440ffbec7f74110e61ed1)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:58.517780 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ef6f5-108c-494c-b02d-4f43839be3e9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:58.848892 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c73ef6f5-108c-494c-b02d-4f43839be3e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75aa8304dc4440ffbec7f74110e61ed1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:58.975349 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c73ef6f5-108c-494c-b02d-4f43839be3e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75aa8304dc4440ffbec7f74110e61ed1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:58.977640 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c73ef6f5-108c-494c-b02d-4f43839be3e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75aa8304dc4440ffbec7f74110e61ed1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:58.979289 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c73ef6f5-108c-494c-b02d-4f43839be3e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75aa8304dc4440ffbec7f74110e61ed1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:59.004007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:59.012771 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c73ef6f5-108c-494c-b02d-4f43839be3e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75aa8304dc4440ffbec7f74110e61ed1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:49:59.084283 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1165/2318] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:49:58 2022] DELETE /identity/v3/users/75aa8304dc4440ffbec7f74110e61ed1 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:49:59.090928 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e693c-1d4c-40ce-b892-334a3db61ae1 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:59.091880 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e693c-1d4c-40ce-b892-334a3db61ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:59.091880 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e693c-1d4c-40ce-b892-334a3db61ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:59.123534 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-457e693c-1d4c-40ce-b892-334a3db61ae1 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:49:59.126520 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-457e693c-1d4c-40ce-b892-334a3db61ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:59.256687 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1154/2319] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:49:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:49:59.272889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ef6f5-108c-494c-b02d-4f43839be3e9 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:59.274591 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c73ef6f5-108c-494c-b02d-4f43839be3e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:59.381303 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ef6f5-108c-494c-b02d-4f43839be3e9 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:59.385723 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6f1b1-3744-4a30-9452-d20b6cad430c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:59.387202 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6f1b1-3744-4a30-9452-d20b6cad430c service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:59.387638 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6f1b1-3744-4a30-9452-d20b6cad430c service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:59.388183 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6f1b1-3744-4a30-9452-d20b6cad430c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:59.402781 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc6f1b1-3744-4a30-9452-d20b6cad430c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:59.402781 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc6f1b1-3744-4a30-9452-d20b6cad430c service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:59.414484 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1166/2320] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:49:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:49:59.581028 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e693c-1d4c-40ce-b892-334a3db61ae1 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:59.583596 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-457e693c-1d4c-40ce-b892-334a3db61ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:59.704653 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e693c-1d4c-40ce-b892-334a3db61ae1 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:59.711435 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7a2ed-9111-400a-b59d-43b0c468f68e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:59.716485 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7a2ed-9111-400a-b59d-43b0c468f68e service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:59.716485 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7a2ed-9111-400a-b59d-43b0c468f68e service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:59.716485 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7a2ed-9111-400a-b59d-43b0c468f68e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:59.716917 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-01a7a2ed-9111-400a-b59d-43b0c468f68e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:59.815587 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7a2ed-9111-400a-b59d-43b0c468f68e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:49:59.817075 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7a2ed-9111-400a-b59d-43b0c468f68e service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:49:59.827622 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1155/2321] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:49:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:49:59.889341 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6f1b1-3744-4a30-9452-d20b6cad430c service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:49:59.891747 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3cc6f1b1-3744-4a30-9452-d20b6cad430c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:49:59.943550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6f1b1-3744-4a30-9452-d20b6cad430c service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:49:59.984517 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fcd48-0cd1-4690-825f-5f7cf07ddd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:49:59.986491 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fcd48-0cd1-4690-825f-5f7cf07ddd4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:49:59.987162 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fcd48-0cd1-4690-825f-5f7cf07ddd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:49:59.987570 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fcd48-0cd1-4690-825f-5f7cf07ddd4d admin admin] PATH_INFO: `/v3/projects/bdffcae01caa495e853b0573c1e8c630` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:49:59.996803 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7fcd48-0cd1-4690-825f-5f7cf07ddd4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdffcae01caa495e853b0573c1e8c630)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:00.000569 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7fcd48-0cd1-4690-825f-5f7cf07ddd4d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:00.200945 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ae7fcd48-0cd1-4690-825f-5f7cf07ddd4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdffcae01caa495e853b0573c1e8c630', 'request_id': 'req-ae7fcd48-0cd1-4690-825f-5f7cf07ddd4d'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:00.207924 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ae7fcd48-0cd1-4690-825f-5f7cf07ddd4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdffcae01caa495e853b0573c1e8c630', 'request_id': 'req-ae7fcd48-0cd1-4690-825f-5f7cf07ddd4d'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:00.348890 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ae7fcd48-0cd1-4690-825f-5f7cf07ddd4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdffcae01caa495e853b0573c1e8c630', 'request_id': 'req-ae7fcd48-0cd1-4690-825f-5f7cf07ddd4d'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:00.363055 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ae7fcd48-0cd1-4690-825f-5f7cf07ddd4d admin admin] The token cache is being invalidate because project bdffcae01caa495e853b0573c1e8c630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:50:00.363380 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ae7fcd48-0cd1-4690-825f-5f7cf07ddd4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:00.364097 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ae7fcd48-0cd1-4690-825f-5f7cf07ddd4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:00.365706 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1167/2322] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:49:59 2022] DELETE /identity/v3/projects/bdffcae01caa495e853b0573c1e8c630 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:50:00.372014 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0ba9f-7e3c-4206-9507-970877113348 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:00.372797 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0ba9f-7e3c-4206-9507-970877113348 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:00.372797 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0ba9f-7e3c-4206-9507-970877113348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:00.397867 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-e7b0ba9f-7e3c-4206-9507-970877113348 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:50:00.399195 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e7b0ba9f-7e3c-4206-9507-970877113348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:50:00.453395 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:00.468828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1156/2323] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:50:00.477530 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d74ba9-c8f8-4b08-86e3-e8ed3603c3af None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:00.478085 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d74ba9-c8f8-4b08-86e3-e8ed3603c3af None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:00.478503 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d74ba9-c8f8-4b08-86e3-e8ed3603c3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:00.503935 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-04d74ba9-c8f8-4b08-86e3-e8ed3603c3af None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:50:00.505189 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-04d74ba9-c8f8-4b08-86e3-e8ed3603c3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:50:00.514388 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1168/2324] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:50:00.519299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0ba9f-7e3c-4206-9507-970877113348 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:00.530407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0ba9f-7e3c-4206-9507-970877113348 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:00.535734 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe257e-f220-4a7d-86f8-976aa265fa3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:00.536377 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe257e-f220-4a7d-86f8-976aa265fa3d admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:00.536661 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe257e-f220-4a7d-86f8-976aa265fa3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:00.536938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe257e-f220-4a7d-86f8-976aa265fa3d admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:00.537605 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe257e-f220-4a7d-86f8-976aa265fa3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:50:00.537915 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe257e-f220-4a7d-86f8-976aa265fa3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:00.539598 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe257e-f220-4a7d-86f8-976aa265fa3d admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:00.556497 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1157/2325] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:50:00.561104 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d74ba9-c8f8-4b08-86e3-e8ed3603c3af None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:00.571612 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d74ba9-c8f8-4b08-86e3-e8ed3603c3af None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:00.580346 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db5d96-0804-43bb-83a2-6a7e0f67c84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:00.581084 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db5d96-0804-43bb-83a2-6a7e0f67c84e admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:00.581275 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db5d96-0804-43bb-83a2-6a7e0f67c84e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:00.581551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db5d96-0804-43bb-83a2-6a7e0f67c84e admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:00.582202 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db5d96-0804-43bb-83a2-6a7e0f67c84e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:00.584205 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db5d96-0804-43bb-83a2-6a7e0f67c84e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:00.697496 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1169/2326] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:50:00 2022] POST /identity/v3/projects => generated 399 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:50:00.704129 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe257e-f220-4a7d-86f8-976aa265fa3d admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:00.725186 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe257e-f220-4a7d-86f8-976aa265fa3d admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:00.824960 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1f0cf-cbf6-4116-b7c9-358e6e217b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:00.826022 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1f0cf-cbf6-4116-b7c9-358e6e217b7e admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:00.826526 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1f0cf-cbf6-4116-b7c9-358e6e217b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:00.827016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1f0cf-cbf6-4116-b7c9-358e6e217b7e admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:00.828304 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1f0cf-cbf6-4116-b7c9-358e6e217b7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:00.832112 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1f0cf-cbf6-4116-b7c9-358e6e217b7e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:00.974572 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1158/2327] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:50:00 2022] POST /identity/v3/users => generated 300 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:50:00.978996 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db5d96-0804-43bb-83a2-6a7e0f67c84e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:00.996694 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db5d96-0804-43bb-83a2-6a7e0f67c84e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:01.006053 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf03bf-4146-4de6-ad36-3b0a307d65ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:01.007400 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf03bf-4146-4de6-ad36-3b0a307d65ea admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:01.009436 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf03bf-4146-4de6-ad36-3b0a307d65ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:01.009926 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf03bf-4146-4de6-ad36-3b0a307d65ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:01.012282 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf03bf-4146-4de6-ad36-3b0a307d65ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:01.015913 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf03bf-4146-4de6-ad36-3b0a307d65ea admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:01.037889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1170/2328] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:50:01.042422 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1f0cf-cbf6-4116-b7c9-358e6e217b7e admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:01.053562 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1f0cf-cbf6-4116-b7c9-358e6e217b7e admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:01.059979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea34048-f417-4a34-b53e-7ba8dc6b70de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:01.060977 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea34048-f417-4a34-b53e-7ba8dc6b70de admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:01.061639 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea34048-f417-4a34-b53e-7ba8dc6b70de admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:01.061920 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea34048-f417-4a34-b53e-7ba8dc6b70de admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:01.062741 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea34048-f417-4a34-b53e-7ba8dc6b70de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:01.065519 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea34048-f417-4a34-b53e-7ba8dc6b70de admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:01.082143 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1159/2329] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:50:01.087899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf03bf-4146-4de6-ad36-3b0a307d65ea admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:01.103740 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf03bf-4146-4de6-ad36-3b0a307d65ea admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:01.108780 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7b55d-fb99-4e05-a53d-75baef5c4d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:01.109589 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7b55d-fb99-4e05-a53d-75baef5c4d13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:01.109880 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7b55d-fb99-4e05-a53d-75baef5c4d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:01.110153 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7b55d-fb99-4e05-a53d-75baef5c4d13 admin admin] PATH_INFO: `/v3/projects/e3d8f651810341cda1bcb65efdd8994d/users/24bfb7ed0b0b4445a53bcd0dc53b5a68/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:01.130637 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7b55d-fb99-4e05-a53d-75baef5c4d13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3d8f651810341cda1bcb65efdd8994d, user_id=24bfb7ed0b0b4445a53bcd0dc53b5a68, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:01.134535 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7b55d-fb99-4e05-a53d-75baef5c4d13 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:01.255449 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:01.270107 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1171/2330] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:50:01 2022] PUT /identity/v3/projects/e3d8f651810341cda1bcb65efdd8994d/users/24bfb7ed0b0b4445a53bcd0dc53b5a68/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:50:01.282671 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1b026-9450-48b4-a65b-2a235ef7ac3e None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:01.283168 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1b026-9450-48b4-a65b-2a235ef7ac3e None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:01.283637 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1b026-9450-48b4-a65b-2a235ef7ac3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:01.333081 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-e6b1b026-9450-48b4-a65b-2a235ef7ac3e None None] MFA Rules not processed for user `24bfb7ed0b0b4445a53bcd0dc53b5a68`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:50:01.334922 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e6b1b026-9450-48b4-a65b-2a235ef7ac3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:50:01.486104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1160/2331] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:50:01 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:50:01.502052 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7b55d-fb99-4e05-a53d-75baef5c4d13 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:01.504045 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-eae7b55d-fb99-4e05-a53d-75baef5c4d13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:50:01.599603 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7b55d-fb99-4e05-a53d-75baef5c4d13 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:01.603768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b273c-0c38-45b2-a86f-8314a202950c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:01.604402 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b273c-0c38-45b2-a86f-8314a202950c service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:01.604685 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b273c-0c38-45b2-a86f-8314a202950c service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:01.605164 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b273c-0c38-45b2-a86f-8314a202950c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:01.615916 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b273c-0c38-45b2-a86f-8314a202950c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:01.617507 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b273c-0c38-45b2-a86f-8314a202950c service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:01.629168 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1172/2332] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:50:01 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:50:02.189163 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7b314-289d-42f0-988f-64d0936b61fe None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:02.189569 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7b314-289d-42f0-988f-64d0936b61fe None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:02.190016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7b314-289d-42f0-988f-64d0936b61fe None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:02.192421 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1161/2333] 10.222.0.26 () {54 vars in 961 bytes} [Sun Sep 11 08:50:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 08:50:02.201158 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2c45c-de4d-47ea-a282-89556456c161 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:02.201787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2c45c-de4d-47ea-a282-89556456c161 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:02.201787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2c45c-de4d-47ea-a282-89556456c161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:02.233943 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-57f2c45c-de4d-47ea-a282-89556456c161 None None] MFA Rules not processed for user `a48c49f7a9f44cef89dd024fecea422f`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:50:02.236004 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-57f2c45c-de4d-47ea-a282-89556456c161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:50:02.341649 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1173/2334] 10.222.0.26 () {58 vars in 1058 bytes} [Sun Sep 11 08:50:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:50:02.351482 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7b314-289d-42f0-988f-64d0936b61fe None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:02.379968 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7b314-289d-42f0-988f-64d0936b61fe None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:02.389336 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d4021-87fb-4aed-8a50-7d4bb50b539c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a48c49f7a9f44cef89dd024fecea422f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:02.390393 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d4021-87fb-4aed-8a50-7d4bb50b539c service placement] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:02.390891 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d4021-87fb-4aed-8a50-7d4bb50b539c service placement] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:02.391425 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d4021-87fb-4aed-8a50-7d4bb50b539c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:02.410178 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e00d4021-87fb-4aed-8a50-7d4bb50b539c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:50:02.437770 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d4021-87fb-4aed-8a50-7d4bb50b539c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:02.442458 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d4021-87fb-4aed-8a50-7d4bb50b539c service placement] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:02.465142 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1162/2335] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:50:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:50:05.431194 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372ed16-708d-4d77-846d-6d8135c39119 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:05.431780 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372ed16-708d-4d77-846d-6d8135c39119 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:05.432206 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372ed16-708d-4d77-846d-6d8135c39119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:05.467340 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-b372ed16-708d-4d77-846d-6d8135c39119 None None] MFA Rules not processed for user `84fcccb19a5e43ac9da5d7ca501563e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:50:05.469546 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b372ed16-708d-4d77-846d-6d8135c39119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:50:05.580577 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1174/2336] 10.222.0.26 () {58 vars in 1009 bytes} [Sun Sep 11 08:50:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:50:05.611938 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d4021-87fb-4aed-8a50-7d4bb50b539c service placement] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:05.614772 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e00d4021-87fb-4aed-8a50-7d4bb50b539c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:50:05.672494 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:05.764384 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d4021-87fb-4aed-8a50-7d4bb50b539c service placement] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:05.788171 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3c98f-73a3-4c3f-9276-31045ad57276 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a4f25df9724d34afdd6a41e719546a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:05.788171 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3c98f-73a3-4c3f-9276-31045ad57276 service swift] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:05.788171 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3c98f-73a3-4c3f-9276-31045ad57276 service swift] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:05.788171 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3c98f-73a3-4c3f-9276-31045ad57276 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:05.806413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3c98f-73a3-4c3f-9276-31045ad57276 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:05.810101 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3c98f-73a3-4c3f-9276-31045ad57276 service swift] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:05.830394 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1163/2337] 10.222.0.26 () {60 vars in 1384 bytes} [Sun Sep 11 08:50:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 08:50:06.401771 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372ed16-708d-4d77-846d-6d8135c39119 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:06.413002 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372ed16-708d-4d77-846d-6d8135c39119 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:06.419764 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147eb22-b367-4866-a86a-f64be8782d2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:06.420718 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147eb22-b367-4866-a86a-f64be8782d2b service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:06.421159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147eb22-b367-4866-a86a-f64be8782d2b service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:06.421585 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147eb22-b367-4866-a86a-f64be8782d2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:06.423989 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8147eb22-b367-4866-a86a-f64be8782d2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:50:06.483380 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:06.511582 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8147eb22-b367-4866-a86a-f64be8782d2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:06.513698 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8147eb22-b367-4866-a86a-f64be8782d2b service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:06.527816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1175/2338] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:50:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:50:08.846874 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3c98f-73a3-4c3f-9276-31045ad57276 service swift] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:09.106742 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3c98f-73a3-4c3f-9276-31045ad57276 service swift] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:09.119947 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ad845-63e0-4b06-aef1-63d52b85591b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:09.124710 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ad845-63e0-4b06-aef1-63d52b85591b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:09.125396 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ad845-63e0-4b06-aef1-63d52b85591b admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:09.126099 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ad845-63e0-4b06-aef1-63d52b85591b admin admin] PATH_INFO: `/v3/users/24bfb7ed0b0b4445a53bcd0dc53b5a68` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:09.130659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ad845-63e0-4b06-aef1-63d52b85591b admin admin] RBAC: Authorizing `identity:delete_user(user_id=24bfb7ed0b0b4445a53bcd0dc53b5a68)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:09.147405 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ad845-63e0-4b06-aef1-63d52b85591b admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:09.430379 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ac0ad845-63e0-4b06-aef1-63d52b85591b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24bfb7ed0b0b4445a53bcd0dc53b5a68'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:09.431633 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ac0ad845-63e0-4b06-aef1-63d52b85591b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24bfb7ed0b0b4445a53bcd0dc53b5a68'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:09.449290 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ac0ad845-63e0-4b06-aef1-63d52b85591b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24bfb7ed0b0b4445a53bcd0dc53b5a68'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:09.450630 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ac0ad845-63e0-4b06-aef1-63d52b85591b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24bfb7ed0b0b4445a53bcd0dc53b5a68'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:09.551544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ac0ad845-63e0-4b06-aef1-63d52b85591b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24bfb7ed0b0b4445a53bcd0dc53b5a68'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:09.572727 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1164/2339] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:50:08 2022] DELETE /identity/v3/users/24bfb7ed0b0b4445a53bcd0dc53b5a68 => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:50:09.580793 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c818f37-3c72-4799-8c0d-005701c64788 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:09.581394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c818f37-3c72-4799-8c0d-005701c64788 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:09.581394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c818f37-3c72-4799-8c0d-005701c64788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:09.603104 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-6c818f37-3c72-4799-8c0d-005701c64788 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:50:09.604606 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6c818f37-3c72-4799-8c0d-005701c64788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:50:09.696682 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1176/2340] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:50:09.704456 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ad845-63e0-4b06-aef1-63d52b85591b admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:09.707363 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ac0ad845-63e0-4b06-aef1-63d52b85591b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:50:09.791005 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:09.824095 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ad845-63e0-4b06-aef1-63d52b85591b admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:09.831408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e38527-d59d-41e0-bc77-60d2007794c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:09.835358 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e38527-d59d-41e0-bc77-60d2007794c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:09.835358 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e38527-d59d-41e0-bc77-60d2007794c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:09.835358 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e38527-d59d-41e0-bc77-60d2007794c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:09.846006 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e38527-d59d-41e0-bc77-60d2007794c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:09.847699 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e38527-d59d-41e0-bc77-60d2007794c9 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:09.859981 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1165/2341] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:50:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:50:10.549273 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c818f37-3c72-4799-8c0d-005701c64788 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:10.550834 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6c818f37-3c72-4799-8c0d-005701c64788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:50:10.570758 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c818f37-3c72-4799-8c0d-005701c64788 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:10.581112 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483fce3-efea-4ff5-885b-144b1a766478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:10.591033 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483fce3-efea-4ff5-885b-144b1a766478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:10.592546 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483fce3-efea-4ff5-885b-144b1a766478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:10.600985 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483fce3-efea-4ff5-885b-144b1a766478 admin admin] PATH_INFO: `/v3/projects/e3d8f651810341cda1bcb65efdd8994d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:10.606609 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483fce3-efea-4ff5-885b-144b1a766478 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3d8f651810341cda1bcb65efdd8994d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:10.610440 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483fce3-efea-4ff5-885b-144b1a766478 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:10.897090 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0483fce3-efea-4ff5-885b-144b1a766478 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3d8f651810341cda1bcb65efdd8994d', 'request_id': 'req-0483fce3-efea-4ff5-885b-144b1a766478'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:10.905276 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0483fce3-efea-4ff5-885b-144b1a766478 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3d8f651810341cda1bcb65efdd8994d', 'request_id': 'req-0483fce3-efea-4ff5-885b-144b1a766478'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:10.978097 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0483fce3-efea-4ff5-885b-144b1a766478 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3d8f651810341cda1bcb65efdd8994d', 'request_id': 'req-0483fce3-efea-4ff5-885b-144b1a766478'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:11.001149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0483fce3-efea-4ff5-885b-144b1a766478 admin admin] The token cache is being invalidate because project e3d8f651810341cda1bcb65efdd8994d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:50:11.001625 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0483fce3-efea-4ff5-885b-144b1a766478 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:11.002516 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0483fce3-efea-4ff5-885b-144b1a766478 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:11.004991 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1177/2342] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:50:10 2022] DELETE /identity/v3/projects/e3d8f651810341cda1bcb65efdd8994d => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:50:12.129103 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e38527-d59d-41e0-bc77-60d2007794c9 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:12.131650 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c1e38527-d59d-41e0-bc77-60d2007794c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:50:12.149645 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e38527-d59d-41e0-bc77-60d2007794c9 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:12.259992 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea3513-09d5-41b0-ad16-7753c62809bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:12.261082 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea3513-09d5-41b0-ad16-7753c62809bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:12.261531 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea3513-09d5-41b0-ad16-7753c62809bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:12.262017 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea3513-09d5-41b0-ad16-7753c62809bb admin admin] PATH_INFO: `/v3/users/961f0c472b7d42c29f721b59a3126bbc` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:12.263481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea3513-09d5-41b0-ad16-7753c62809bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=961f0c472b7d42c29f721b59a3126bbc)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:12.265735 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea3513-09d5-41b0-ad16-7753c62809bb admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:12.512520 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-65ea3513-09d5-41b0-ad16-7753c62809bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '961f0c472b7d42c29f721b59a3126bbc'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:12.514755 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-65ea3513-09d5-41b0-ad16-7753c62809bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '961f0c472b7d42c29f721b59a3126bbc'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:12.535136 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-65ea3513-09d5-41b0-ad16-7753c62809bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '961f0c472b7d42c29f721b59a3126bbc'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:12.536236 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-65ea3513-09d5-41b0-ad16-7753c62809bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '961f0c472b7d42c29f721b59a3126bbc'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:12.626540 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-65ea3513-09d5-41b0-ad16-7753c62809bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '961f0c472b7d42c29f721b59a3126bbc'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:12.682293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1166/2343] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:50:12 2022] DELETE /identity/v3/users/961f0c472b7d42c29f721b59a3126bbc => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:50:12.691693 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af41da6-1e14-4639-bec3-1484b5520b26 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:12.691693 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af41da6-1e14-4639-bec3-1484b5520b26 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:12.691693 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af41da6-1e14-4639-bec3-1484b5520b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:12.721158 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-9af41da6-1e14-4639-bec3-1484b5520b26 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:50:12.724326 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9af41da6-1e14-4639-bec3-1484b5520b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:50:12.871033 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1178/2344] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:50:12.882304 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea3513-09d5-41b0-ad16-7753c62809bb admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:12.884112 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-65ea3513-09d5-41b0-ad16-7753c62809bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:50:12.972934 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea3513-09d5-41b0-ad16-7753c62809bb admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:12.977684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af37a2-221b-4950-a72f-e616a8484112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:12.978925 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af37a2-221b-4950-a72f-e616a8484112 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:12.979286 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af37a2-221b-4950-a72f-e616a8484112 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:12.980303 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af37a2-221b-4950-a72f-e616a8484112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:13.012302 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af37a2-221b-4950-a72f-e616a8484112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:13.015179 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af37a2-221b-4950-a72f-e616a8484112 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:13.045968 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1167/2345] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:50:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:50:14.216978 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af41da6-1e14-4639-bec3-1484b5520b26 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:14.220164 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9af41da6-1e14-4639-bec3-1484b5520b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:50:14.263775 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af41da6-1e14-4639-bec3-1484b5520b26 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:14.317210 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbe76a-06ad-4cdb-9b40-144471c9c7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:14.317210 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbe76a-06ad-4cdb-9b40-144471c9c7ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:14.317210 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbe76a-06ad-4cdb-9b40-144471c9c7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:14.317210 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbe76a-06ad-4cdb-9b40-144471c9c7ed admin admin] PATH_INFO: `/v3/projects/939c55596f8f46079285e0a9f86e53fa` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:14.318027 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bbe76a-06ad-4cdb-9b40-144471c9c7ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=939c55596f8f46079285e0a9f86e53fa)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:14.318027 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bbe76a-06ad-4cdb-9b40-144471c9c7ed admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:14.318027 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:15.668472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-65bbe76a-06ad-4cdb-9b40-144471c9c7ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '939c55596f8f46079285e0a9f86e53fa', 'request_id': 'req-65bbe76a-06ad-4cdb-9b40-144471c9c7ed'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:15.676026 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-65bbe76a-06ad-4cdb-9b40-144471c9c7ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '939c55596f8f46079285e0a9f86e53fa', 'request_id': 'req-65bbe76a-06ad-4cdb-9b40-144471c9c7ed'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:15.820950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-65bbe76a-06ad-4cdb-9b40-144471c9c7ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '939c55596f8f46079285e0a9f86e53fa', 'request_id': 'req-65bbe76a-06ad-4cdb-9b40-144471c9c7ed'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:15.846594 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-65bbe76a-06ad-4cdb-9b40-144471c9c7ed admin admin] The token cache is being invalidate because project 939c55596f8f46079285e0a9f86e53fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:50:15.847150 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-65bbe76a-06ad-4cdb-9b40-144471c9c7ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:15.848096 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-65bbe76a-06ad-4cdb-9b40-144471c9c7ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:15.850970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1179/2346] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:50:14 2022] DELETE /identity/v3/projects/939c55596f8f46079285e0a9f86e53fa => generated 0 bytes in 1636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:50:15.857719 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af37a2-221b-4950-a72f-e616a8484112 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:15.874085 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af37a2-221b-4950-a72f-e616a8484112 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:15.881024 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:15.984795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4f55b-4e32-48f0-ac22-15a37b9b5d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:15.985668 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4f55b-4e32-48f0-ac22-15a37b9b5d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:15.986428 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4f55b-4e32-48f0-ac22-15a37b9b5d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:15.986827 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4f55b-4e32-48f0-ac22-15a37b9b5d68 admin admin] PATH_INFO: `/v3/users/f7f6c9d8ade54a8496b42f15431cb958` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:15.989331 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4f55b-4e32-48f0-ac22-15a37b9b5d68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7f6c9d8ade54a8496b42f15431cb958)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:15.997035 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4f55b-4e32-48f0-ac22-15a37b9b5d68 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:16.234795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5fb4f55b-4e32-48f0-ac22-15a37b9b5d68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7f6c9d8ade54a8496b42f15431cb958'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:16.235805 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5fb4f55b-4e32-48f0-ac22-15a37b9b5d68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7f6c9d8ade54a8496b42f15431cb958'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:16.256618 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5fb4f55b-4e32-48f0-ac22-15a37b9b5d68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7f6c9d8ade54a8496b42f15431cb958'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:16.257919 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5fb4f55b-4e32-48f0-ac22-15a37b9b5d68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7f6c9d8ade54a8496b42f15431cb958'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:16.362031 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5fb4f55b-4e32-48f0-ac22-15a37b9b5d68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7f6c9d8ade54a8496b42f15431cb958'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:16.399198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1168/2347] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:50:15 2022] DELETE /identity/v3/users/f7f6c9d8ade54a8496b42f15431cb958 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:50:16.999618 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbe76a-06ad-4cdb-9b40-144471c9c7ed admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:17.000186 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-65bbe76a-06ad-4cdb-9b40-144471c9c7ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:50:17.029357 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbe76a-06ad-4cdb-9b40-144471c9c7ed admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:17.102655 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f641de9-d62c-4e8c-833e-96c228edf18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:17.103906 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f641de9-d62c-4e8c-833e-96c228edf18f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:17.104458 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f641de9-d62c-4e8c-833e-96c228edf18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:17.104993 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f641de9-d62c-4e8c-833e-96c228edf18f admin admin] PATH_INFO: `/v3/projects/eb24c00a5f744253bf8296977f5cf29a` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:17.108021 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f641de9-d62c-4e8c-833e-96c228edf18f admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb24c00a5f744253bf8296977f5cf29a)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:17.111181 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f641de9-d62c-4e8c-833e-96c228edf18f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:17.252646 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5f641de9-d62c-4e8c-833e-96c228edf18f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb24c00a5f744253bf8296977f5cf29a', 'request_id': 'req-5f641de9-d62c-4e8c-833e-96c228edf18f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:17.262376 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5f641de9-d62c-4e8c-833e-96c228edf18f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb24c00a5f744253bf8296977f5cf29a', 'request_id': 'req-5f641de9-d62c-4e8c-833e-96c228edf18f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:17.349174 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5f641de9-d62c-4e8c-833e-96c228edf18f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb24c00a5f744253bf8296977f5cf29a', 'request_id': 'req-5f641de9-d62c-4e8c-833e-96c228edf18f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:17.369363 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5f641de9-d62c-4e8c-833e-96c228edf18f admin admin] The token cache is being invalidate because project eb24c00a5f744253bf8296977f5cf29a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:50:17.370015 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5f641de9-d62c-4e8c-833e-96c228edf18f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:17.371130 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5f641de9-d62c-4e8c-833e-96c228edf18f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:17.373502 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1180/2348] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:50:16 2022] DELETE /identity/v3/projects/eb24c00a5f744253bf8296977f5cf29a => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:50:17.378690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4f55b-4e32-48f0-ac22-15a37b9b5d68 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:17.381920 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5fb4f55b-4e32-48f0-ac22-15a37b9b5d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:50:17.402604 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4f55b-4e32-48f0-ac22-15a37b9b5d68 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:17.479286 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101caaf1-6e06-434e-901d-5264f2ad653e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:17.480312 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101caaf1-6e06-434e-901d-5264f2ad653e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:17.480587 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101caaf1-6e06-434e-901d-5264f2ad653e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:17.480856 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101caaf1-6e06-434e-901d-5264f2ad653e admin admin] PATH_INFO: `/v3/users/2e9d2914b1ef4fa1891eb3486f43c9e3` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:17.482128 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101caaf1-6e06-434e-901d-5264f2ad653e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e9d2914b1ef4fa1891eb3486f43c9e3)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:17.484409 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101caaf1-6e06-434e-901d-5264f2ad653e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:17.648840 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:17.796112 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-101caaf1-6e06-434e-901d-5264f2ad653e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e9d2914b1ef4fa1891eb3486f43c9e3'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:17.797214 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-101caaf1-6e06-434e-901d-5264f2ad653e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e9d2914b1ef4fa1891eb3486f43c9e3'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:17.811058 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-101caaf1-6e06-434e-901d-5264f2ad653e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e9d2914b1ef4fa1891eb3486f43c9e3'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:17.812294 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-101caaf1-6e06-434e-901d-5264f2ad653e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e9d2914b1ef4fa1891eb3486f43c9e3'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:17.885829 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-101caaf1-6e06-434e-901d-5264f2ad653e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e9d2914b1ef4fa1891eb3486f43c9e3'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:17.928758 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1169/2349] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:50:17 2022] DELETE /identity/v3/users/2e9d2914b1ef4fa1891eb3486f43c9e3 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:50:18.913239 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f641de9-d62c-4e8c-833e-96c228edf18f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:18.915950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5f641de9-d62c-4e8c-833e-96c228edf18f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:50:18.938107 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f641de9-d62c-4e8c-833e-96c228edf18f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:18.964568 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:19.027484 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2424c9-0927-4420-962d-b1dc449f4fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:19.028510 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2424c9-0927-4420-962d-b1dc449f4fbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:19.028980 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2424c9-0927-4420-962d-b1dc449f4fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:19.029428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2424c9-0927-4420-962d-b1dc449f4fbe admin admin] PATH_INFO: `/v3/projects/d9d34dfaa38847ffbff39796c8abf8c4` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:19.031846 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2424c9-0927-4420-962d-b1dc449f4fbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9d34dfaa38847ffbff39796c8abf8c4)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:19.034944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2424c9-0927-4420-962d-b1dc449f4fbe admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:19.182364 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8e2424c9-0927-4420-962d-b1dc449f4fbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9d34dfaa38847ffbff39796c8abf8c4', 'request_id': 'req-8e2424c9-0927-4420-962d-b1dc449f4fbe'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:19.191958 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8e2424c9-0927-4420-962d-b1dc449f4fbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9d34dfaa38847ffbff39796c8abf8c4', 'request_id': 'req-8e2424c9-0927-4420-962d-b1dc449f4fbe'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:19.275277 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8e2424c9-0927-4420-962d-b1dc449f4fbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9d34dfaa38847ffbff39796c8abf8c4', 'request_id': 'req-8e2424c9-0927-4420-962d-b1dc449f4fbe'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:19.296880 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8e2424c9-0927-4420-962d-b1dc449f4fbe admin admin] The token cache is being invalidate because project d9d34dfaa38847ffbff39796c8abf8c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:50:19.297882 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8e2424c9-0927-4420-962d-b1dc449f4fbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:19.298939 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8e2424c9-0927-4420-962d-b1dc449f4fbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:19.307327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1181/2350] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:50:18 2022] DELETE /identity/v3/projects/d9d34dfaa38847ffbff39796c8abf8c4 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:50:19.310662 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7268473-75ed-4672-860d-5b775f3f7bd9 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:19.311561 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7268473-75ed-4672-860d-5b775f3f7bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:19.311720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7268473-75ed-4672-860d-5b775f3f7bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:19.337257 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-d7268473-75ed-4672-860d-5b775f3f7bd9 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:50:19.339509 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d7268473-75ed-4672-860d-5b775f3f7bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:50:19.502037 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1170/2351] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:50:19.517972 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c5b7d-4308-4cfe-90ff-724eff3fd562 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:19.519610 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c5b7d-4308-4cfe-90ff-724eff3fd562 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:19.520457 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c5b7d-4308-4cfe-90ff-724eff3fd562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:19.567603 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-673c5b7d-4308-4cfe-90ff-724eff3fd562 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:50:19.570629 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-673c5b7d-4308-4cfe-90ff-724eff3fd562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:50:19.587228 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1182/2352] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:50:19.592095 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7268473-75ed-4672-860d-5b775f3f7bd9 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:19.608893 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7268473-75ed-4672-860d-5b775f3f7bd9 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:19.614976 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef78e4-4e5f-4ca9-9238-b993ae4222ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:19.620654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef78e4-4e5f-4ca9-9238-b993ae4222ab admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:19.620654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef78e4-4e5f-4ca9-9238-b993ae4222ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:19.620654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef78e4-4e5f-4ca9-9238-b993ae4222ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:19.620654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef78e4-4e5f-4ca9-9238-b993ae4222ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:50:19.620654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef78e4-4e5f-4ca9-9238-b993ae4222ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:19.620654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef78e4-4e5f-4ca9-9238-b993ae4222ab admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:19.656159 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1171/2353] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:50:19.657724 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c5b7d-4308-4cfe-90ff-724eff3fd562 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:19.675228 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c5b7d-4308-4cfe-90ff-724eff3fd562 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:19.684625 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e9f67-4f5b-436c-9c15-40e5c0d82aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:19.686400 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e9f67-4f5b-436c-9c15-40e5c0d82aab admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:19.686905 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e9f67-4f5b-436c-9c15-40e5c0d82aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:19.687531 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e9f67-4f5b-436c-9c15-40e5c0d82aab admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:19.688788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e9f67-4f5b-436c-9c15-40e5c0d82aab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:19.701044 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e9f67-4f5b-436c-9c15-40e5c0d82aab admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:19.851048 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1183/2354] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:50:19 2022] POST /identity/v3/projects => generated 375 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:50:19.852432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef78e4-4e5f-4ca9-9238-b993ae4222ab admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:19.863834 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef78e4-4e5f-4ca9-9238-b993ae4222ab admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:19.954165 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b62e5-c0d8-4154-be3f-34f772e3eeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:19.955966 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b62e5-c0d8-4154-be3f-34f772e3eeb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:19.956386 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b62e5-c0d8-4154-be3f-34f772e3eeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:19.956813 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b62e5-c0d8-4154-be3f-34f772e3eeb5 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:19.958080 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b62e5-c0d8-4154-be3f-34f772e3eeb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:19.960320 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b62e5-c0d8-4154-be3f-34f772e3eeb5 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:20.112982 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1172/2355] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:50:19 2022] POST /identity/v3/users => generated 288 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:50:20.115119 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e9f67-4f5b-436c-9c15-40e5c0d82aab admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:20.129168 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e9f67-4f5b-436c-9c15-40e5c0d82aab admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:20.137000 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae59175-99f7-4248-b1c9-6835d2078345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:20.137962 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae59175-99f7-4248-b1c9-6835d2078345 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:20.139871 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae59175-99f7-4248-b1c9-6835d2078345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:20.139871 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae59175-99f7-4248-b1c9-6835d2078345 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:20.139871 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae59175-99f7-4248-b1c9-6835d2078345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:20.142027 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae59175-99f7-4248-b1c9-6835d2078345 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:20.160399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1184/2356] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:50:20.165532 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b62e5-c0d8-4154-be3f-34f772e3eeb5 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:20.191595 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b62e5-c0d8-4154-be3f-34f772e3eeb5 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:20.202366 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d553ff-f52d-4544-a704-e40182034c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:20.203705 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d553ff-f52d-4544-a704-e40182034c98 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:20.204325 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d553ff-f52d-4544-a704-e40182034c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:20.204925 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d553ff-f52d-4544-a704-e40182034c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:20.206323 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d553ff-f52d-4544-a704-e40182034c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:20.211673 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d553ff-f52d-4544-a704-e40182034c98 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:20.231483 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1173/2357] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:50:20.236756 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae59175-99f7-4248-b1c9-6835d2078345 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:20.263670 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae59175-99f7-4248-b1c9-6835d2078345 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:20.273603 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96663b3b-3f30-421a-90d5-1444d4a75d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:20.275321 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96663b3b-3f30-421a-90d5-1444d4a75d52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:20.276266 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96663b3b-3f30-421a-90d5-1444d4a75d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:20.277067 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96663b3b-3f30-421a-90d5-1444d4a75d52 admin admin] PATH_INFO: `/v3/projects/d1348b0eb68248458f697f51e306a471/users/bf9b7b98559b436eb1248313e84da06e/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:20.314466 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96663b3b-3f30-421a-90d5-1444d4a75d52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1348b0eb68248458f697f51e306a471, user_id=bf9b7b98559b436eb1248313e84da06e, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:20.320544 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96663b3b-3f30-421a-90d5-1444d4a75d52 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:20.485485 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1185/2358] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:50:20 2022] PUT /identity/v3/projects/d1348b0eb68248458f697f51e306a471/users/bf9b7b98559b436eb1248313e84da06e/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:50:20.505911 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3648c6-bccc-4cba-8299-9079ab87f282 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:20.506522 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3648c6-bccc-4cba-8299-9079ab87f282 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:20.506838 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3648c6-bccc-4cba-8299-9079ab87f282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:20.541541 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:20.562943 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-0d3648c6-bccc-4cba-8299-9079ab87f282 None None] MFA Rules not processed for user `bf9b7b98559b436eb1248313e84da06e`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:50:20.567645 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-0d3648c6-bccc-4cba-8299-9079ab87f282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:50:20.750382 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1174/2359] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:50:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:50:20.754908 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96663b3b-3f30-421a-90d5-1444d4a75d52 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:20.825517 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:20.861864 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96663b3b-3f30-421a-90d5-1444d4a75d52 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:20.861864 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de42e53-4703-4788-ae24-d05b939b8820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:20.861864 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de42e53-4703-4788-ae24-d05b939b8820 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:20.861864 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de42e53-4703-4788-ae24-d05b939b8820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:20.862451 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de42e53-4703-4788-ae24-d05b939b8820 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:20.863169 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de42e53-4703-4788-ae24-d05b939b8820 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:20.865746 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de42e53-4703-4788-ae24-d05b939b8820 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:21.009947 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1186/2360] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:50:20 2022] POST /identity/v3/projects => generated 377 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:50:21.014716 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3648c6-bccc-4cba-8299-9079ab87f282 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:21.027429 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3648c6-bccc-4cba-8299-9079ab87f282 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:21.106878 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74f3e5-5a4f-4c43-858a-b2f090cb146f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:21.107626 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74f3e5-5a4f-4c43-858a-b2f090cb146f admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:21.107976 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74f3e5-5a4f-4c43-858a-b2f090cb146f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:21.108318 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74f3e5-5a4f-4c43-858a-b2f090cb146f admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:21.109349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74f3e5-5a4f-4c43-858a-b2f090cb146f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:21.111732 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74f3e5-5a4f-4c43-858a-b2f090cb146f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:21.251241 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1175/2361] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:50:21 2022] POST /identity/v3/users => generated 289 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:50:21.253289 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de42e53-4703-4788-ae24-d05b939b8820 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:21.268520 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de42e53-4703-4788-ae24-d05b939b8820 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:21.274655 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924186c-a165-4f63-a05f-69efc7052db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:21.275573 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924186c-a165-4f63-a05f-69efc7052db1 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:21.276002 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924186c-a165-4f63-a05f-69efc7052db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:21.276442 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924186c-a165-4f63-a05f-69efc7052db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:21.277329 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924186c-a165-4f63-a05f-69efc7052db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:21.279586 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924186c-a165-4f63-a05f-69efc7052db1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:21.301417 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1187/2362] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:50:21.303010 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74f3e5-5a4f-4c43-858a-b2f090cb146f admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:21.317530 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74f3e5-5a4f-4c43-858a-b2f090cb146f admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:21.324083 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122654e1-0537-4782-9d62-122279acf5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:21.324893 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122654e1-0537-4782-9d62-122279acf5cc admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:21.325281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122654e1-0537-4782-9d62-122279acf5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:21.325522 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122654e1-0537-4782-9d62-122279acf5cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:21.326201 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122654e1-0537-4782-9d62-122279acf5cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:21.328099 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122654e1-0537-4782-9d62-122279acf5cc admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:21.340370 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1176/2363] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:50:21.344658 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924186c-a165-4f63-a05f-69efc7052db1 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:21.359151 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924186c-a165-4f63-a05f-69efc7052db1 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:21.364817 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced566ed-2c02-4456-a83e-f95fa721f12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:21.365594 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced566ed-2c02-4456-a83e-f95fa721f12f admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:21.365987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced566ed-2c02-4456-a83e-f95fa721f12f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:21.366354 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced566ed-2c02-4456-a83e-f95fa721f12f admin admin] PATH_INFO: `/v3/projects/1590af8fdc0d49368b7174eeed9a2129/users/17a262c21dcd4e8ca34da5a22c5cf889/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:21.384020 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced566ed-2c02-4456-a83e-f95fa721f12f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1590af8fdc0d49368b7174eeed9a2129, user_id=17a262c21dcd4e8ca34da5a22c5cf889, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:21.387578 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced566ed-2c02-4456-a83e-f95fa721f12f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:21.470433 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1188/2364] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:50:21 2022] PUT /identity/v3/projects/1590af8fdc0d49368b7174eeed9a2129/users/17a262c21dcd4e8ca34da5a22c5cf889/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:50:21.484177 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb28cc0-c473-4e83-b192-37dbff84a526 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:21.484466 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb28cc0-c473-4e83-b192-37dbff84a526 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:21.484755 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb28cc0-c473-4e83-b192-37dbff84a526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:21.518950 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-deb28cc0-c473-4e83-b192-37dbff84a526 None None] MFA Rules not processed for user `17a262c21dcd4e8ca34da5a22c5cf889`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:50:21.520251 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-deb28cc0-c473-4e83-b192-37dbff84a526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:50:21.611192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1177/2365] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:50:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:50:21.616281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced566ed-2c02-4456-a83e-f95fa721f12f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:21.705506 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced566ed-2c02-4456-a83e-f95fa721f12f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:21.711081 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84941fbf-4216-4851-b250-0c7cfce1541c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:21.711751 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84941fbf-4216-4851-b250-0c7cfce1541c admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:21.712051 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84941fbf-4216-4851-b250-0c7cfce1541c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:21.712313 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84941fbf-4216-4851-b250-0c7cfce1541c admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:21.713001 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84941fbf-4216-4851-b250-0c7cfce1541c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:21.715770 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84941fbf-4216-4851-b250-0c7cfce1541c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:21.830804 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1189/2366] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:50:21 2022] POST /identity/v3/projects => generated 377 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:50:21.835570 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb28cc0-c473-4e83-b192-37dbff84a526 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:21.848927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb28cc0-c473-4e83-b192-37dbff84a526 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:21.855076 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:21.919726 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc3016-d35f-4f0c-9b84-9f9f55baf84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:21.920535 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc3016-d35f-4f0c-9b84-9f9f55baf84a admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:21.920848 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc3016-d35f-4f0c-9b84-9f9f55baf84a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:21.921246 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc3016-d35f-4f0c-9b84-9f9f55baf84a admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:21.922084 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc3016-d35f-4f0c-9b84-9f9f55baf84a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:21.924322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc3016-d35f-4f0c-9b84-9f9f55baf84a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:22.003597 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1178/2367] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:50:21 2022] POST /identity/v3/users => generated 295 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:50:22.009104 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84941fbf-4216-4851-b250-0c7cfce1541c admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:22.021754 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84941fbf-4216-4851-b250-0c7cfce1541c admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:22.027153 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6958478-65f0-4dd0-991b-9dd8cb372463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:22.027795 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6958478-65f0-4dd0-991b-9dd8cb372463 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:22.028075 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6958478-65f0-4dd0-991b-9dd8cb372463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:22.028349 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6958478-65f0-4dd0-991b-9dd8cb372463 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:22.029031 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6958478-65f0-4dd0-991b-9dd8cb372463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:22.030693 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6958478-65f0-4dd0-991b-9dd8cb372463 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:22.043453 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1190/2368] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:50:22.048265 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc3016-d35f-4f0c-9b84-9f9f55baf84a admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:22.060590 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc3016-d35f-4f0c-9b84-9f9f55baf84a admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:22.065395 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1587b4-0f26-42d0-813f-1252e9a0c861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:22.066068 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1587b4-0f26-42d0-813f-1252e9a0c861 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:22.066349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1587b4-0f26-42d0-813f-1252e9a0c861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:22.066628 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1587b4-0f26-42d0-813f-1252e9a0c861 admin admin] PATH_INFO: `/v3/projects/0b8a5a5674e849818a93231f597e5fcf/users/efb2718a9f654192905d8e751f3b4dbe/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:22.087058 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1587b4-0f26-42d0-813f-1252e9a0c861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b8a5a5674e849818a93231f597e5fcf, user_id=efb2718a9f654192905d8e751f3b4dbe, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:22.090525 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1587b4-0f26-42d0-813f-1252e9a0c861 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:22.213312 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1179/2369] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:50:22 2022] PUT /identity/v3/projects/0b8a5a5674e849818a93231f597e5fcf/users/efb2718a9f654192905d8e751f3b4dbe/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:50:22.219027 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6958478-65f0-4dd0-991b-9dd8cb372463 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:22.237621 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6958478-65f0-4dd0-991b-9dd8cb372463 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:22.321934 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a90883-7690-4837-8f1f-2a09a355fd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:22.323280 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a90883-7690-4837-8f1f-2a09a355fd99 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:22.323604 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a90883-7690-4837-8f1f-2a09a355fd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:22.324034 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a90883-7690-4837-8f1f-2a09a355fd99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:22.325042 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a90883-7690-4837-8f1f-2a09a355fd99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:22.327624 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a90883-7690-4837-8f1f-2a09a355fd99 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:22.341427 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1191/2370] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:50:22.347640 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1587b4-0f26-42d0-813f-1252e9a0c861 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:22.360343 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1587b4-0f26-42d0-813f-1252e9a0c861 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:22.365322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f3882-e67e-4c98-b0e9-daed73f5c468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:22.366007 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f3882-e67e-4c98-b0e9-daed73f5c468 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:22.366289 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f3882-e67e-4c98-b0e9-daed73f5c468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:22.366568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f3882-e67e-4c98-b0e9-daed73f5c468 admin admin] PATH_INFO: `/v3/projects/0b8a5a5674e849818a93231f597e5fcf/users/efb2718a9f654192905d8e751f3b4dbe/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:22.368644 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f3882-e67e-4c98-b0e9-daed73f5c468 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b8a5a5674e849818a93231f597e5fcf, user_id=efb2718a9f654192905d8e751f3b4dbe, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:22.372133 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f3882-e67e-4c98-b0e9-daed73f5c468 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:22.385233 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1180/2371] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:50:22 2022] PUT /identity/v3/projects/0b8a5a5674e849818a93231f597e5fcf/users/efb2718a9f654192905d8e751f3b4dbe/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:50:22.396281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757a94e-224c-4ced-97c7-f210df9402e7 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:22.396552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757a94e-224c-4ced-97c7-f210df9402e7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:22.396842 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757a94e-224c-4ced-97c7-f210df9402e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:22.423329 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:22.450015 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-1757a94e-224c-4ced-97c7-f210df9402e7 None None] MFA Rules not processed for user `efb2718a9f654192905d8e751f3b4dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:50:22.452343 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1757a94e-224c-4ced-97c7-f210df9402e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:50:22.594507 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1192/2372] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:50:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:50:22.609603 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f3882-e67e-4c98-b0e9-daed73f5c468 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:22.612815 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-921f3882-e67e-4c98-b0e9-daed73f5c468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:50:22.707535 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f3882-e67e-4c98-b0e9-daed73f5c468 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:22.714021 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f4758-fb2f-4114-ad28-12862dff1e08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:22.715098 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f4758-fb2f-4114-ad28-12862dff1e08 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:22.715654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f4758-fb2f-4114-ad28-12862dff1e08 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:22.716047 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f4758-fb2f-4114-ad28-12862dff1e08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:22.787162 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f4758-fb2f-4114-ad28-12862dff1e08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:22.788736 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f4758-fb2f-4114-ad28-12862dff1e08 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:22.799838 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1181/2373] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:50:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:50:24.337234 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940d3f4-b9ed-4dbe-90da-bc957ebbd6f7 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:24.337786 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940d3f4-b9ed-4dbe-90da-bc957ebbd6f7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:24.337786 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940d3f4-b9ed-4dbe-90da-bc957ebbd6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:24.359167 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-3940d3f4-b9ed-4dbe-90da-bc957ebbd6f7 None None] MFA Rules not processed for user `84fcccb19a5e43ac9da5d7ca501563e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:50:24.360496 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3940d3f4-b9ed-4dbe-90da-bc957ebbd6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:50:24.421335 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1193/2374] 10.222.0.26 () {58 vars in 967 bytes} [Sun Sep 11 08:50:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:50:24.445656 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f4758-fb2f-4114-ad28-12862dff1e08 service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:24.447426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-a81f4758-fb2f-4114-ad28-12862dff1e08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:50:24.468879 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:24.528247 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f4758-fb2f-4114-ad28-12862dff1e08 service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:24.533644 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b0052-f7cd-4e6d-93c7-566e0ad5773a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a4f25df9724d34afdd6a41e719546a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:24.534292 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b0052-f7cd-4e6d-93c7-566e0ad5773a service swift] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:24.534572 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b0052-f7cd-4e6d-93c7-566e0ad5773a service swift] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:24.534847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b0052-f7cd-4e6d-93c7-566e0ad5773a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:24.544264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b0052-f7cd-4e6d-93c7-566e0ad5773a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:24.546108 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b0052-f7cd-4e6d-93c7-566e0ad5773a service swift] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:24.560332 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1182/2375] 10.222.0.26 () {60 vars in 1384 bytes} [Sun Sep 11 08:50:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 08:50:24.986694 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940d3f4-b9ed-4dbe-90da-bc957ebbd6f7 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:24.988276 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3940d3f4-b9ed-4dbe-90da-bc957ebbd6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:50:25.001813 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940d3f4-b9ed-4dbe-90da-bc957ebbd6f7 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:25.007975 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc53f1-5cd0-43b5-9067-3ce6a9551e45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:25.008594 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc53f1-5cd0-43b5-9067-3ce6a9551e45 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:25.021933 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc53f1-5cd0-43b5-9067-3ce6a9551e45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:25.021933 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc53f1-5cd0-43b5-9067-3ce6a9551e45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:25.082230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc53f1-5cd0-43b5-9067-3ce6a9551e45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:25.084931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc53f1-5cd0-43b5-9067-3ce6a9551e45 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:25.098328 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1194/2376] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:50:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:50:27.436019 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b0052-f7cd-4e6d-93c7-566e0ad5773a service swift] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:27.447390 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b0052-f7cd-4e6d-93c7-566e0ad5773a service swift] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:27.451762 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8d903-4dee-40be-982e-9b2a3ca7cc94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:27.452389 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8d903-4dee-40be-982e-9b2a3ca7cc94 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:27.452676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8d903-4dee-40be-982e-9b2a3ca7cc94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:27.452943 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8d903-4dee-40be-982e-9b2a3ca7cc94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:27.463533 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc8d903-4dee-40be-982e-9b2a3ca7cc94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:27.465032 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc8d903-4dee-40be-982e-9b2a3ca7cc94 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:27.476234 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1183/2377] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:50:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:50:32.348228 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc53f1-5cd0-43b5-9067-3ce6a9551e45 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:32.393464 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:32.423410 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc53f1-5cd0-43b5-9067-3ce6a9551e45 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:32.428667 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30d894-721a-459e-b339-bbdf44e571c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:32.429374 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30d894-721a-459e-b339-bbdf44e571c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:32.429658 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30d894-721a-459e-b339-bbdf44e571c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:32.429937 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30d894-721a-459e-b339-bbdf44e571c6 admin admin] PATH_INFO: `/v3/users/bf9b7b98559b436eb1248313e84da06e` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:32.431103 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c30d894-721a-459e-b339-bbdf44e571c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf9b7b98559b436eb1248313e84da06e)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:32.433802 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c30d894-721a-459e-b339-bbdf44e571c6 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:32.618907 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1c30d894-721a-459e-b339-bbdf44e571c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf9b7b98559b436eb1248313e84da06e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:32.720284 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1c30d894-721a-459e-b339-bbdf44e571c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf9b7b98559b436eb1248313e84da06e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:32.720961 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1c30d894-721a-459e-b339-bbdf44e571c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf9b7b98559b436eb1248313e84da06e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:32.721693 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1c30d894-721a-459e-b339-bbdf44e571c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf9b7b98559b436eb1248313e84da06e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:32.731160 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1c30d894-721a-459e-b339-bbdf44e571c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf9b7b98559b436eb1248313e84da06e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:32.751946 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1195/2378] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:50:32 2022] DELETE /identity/v3/users/bf9b7b98559b436eb1248313e84da06e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:50:32.756867 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d234f-7823-4f82-971e-891ce68614c4 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:32.757470 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d234f-7823-4f82-971e-891ce68614c4 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:32.757583 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d234f-7823-4f82-971e-891ce68614c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:32.779322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-3d4d234f-7823-4f82-971e-891ce68614c4 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:50:32.780540 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3d4d234f-7823-4f82-971e-891ce68614c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:50:32.849311 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1184/2379] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:50:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:50:32.861008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30d894-721a-459e-b339-bbdf44e571c6 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:32.862769 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1c30d894-721a-459e-b339-bbdf44e571c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:50:32.928594 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30d894-721a-459e-b339-bbdf44e571c6 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:32.933462 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b04d2-01d3-4345-ace1-a412c686f3ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:32.934268 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b04d2-01d3-4345-ace1-a412c686f3ce service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:32.934555 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b04d2-01d3-4345-ace1-a412c686f3ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:32.934826 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b04d2-01d3-4345-ace1-a412c686f3ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:32.950883 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b04d2-01d3-4345-ace1-a412c686f3ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:32.952411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b04d2-01d3-4345-ace1-a412c686f3ce service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:32.964390 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1196/2380] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:50:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:50:33.442839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d234f-7823-4f82-971e-891ce68614c4 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:33.445296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3d4d234f-7823-4f82-971e-891ce68614c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:50:33.466952 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d234f-7823-4f82-971e-891ce68614c4 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:33.474706 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698d06f-27cc-46e5-994c-391e9752a367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:33.475825 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698d06f-27cc-46e5-994c-391e9752a367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:33.476308 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698d06f-27cc-46e5-994c-391e9752a367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:33.476794 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698d06f-27cc-46e5-994c-391e9752a367 admin admin] PATH_INFO: `/v3/projects/d1348b0eb68248458f697f51e306a471` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:33.478779 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698d06f-27cc-46e5-994c-391e9752a367 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1348b0eb68248458f697f51e306a471)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:33.483180 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698d06f-27cc-46e5-994c-391e9752a367 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:33.631559 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f698d06f-27cc-46e5-994c-391e9752a367 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1348b0eb68248458f697f51e306a471', 'request_id': 'req-f698d06f-27cc-46e5-994c-391e9752a367'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:33.637588 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f698d06f-27cc-46e5-994c-391e9752a367 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1348b0eb68248458f697f51e306a471', 'request_id': 'req-f698d06f-27cc-46e5-994c-391e9752a367'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:33.731637 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f698d06f-27cc-46e5-994c-391e9752a367 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1348b0eb68248458f697f51e306a471', 'request_id': 'req-f698d06f-27cc-46e5-994c-391e9752a367'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:33.744532 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f698d06f-27cc-46e5-994c-391e9752a367 admin admin] The token cache is being invalidate because project d1348b0eb68248458f697f51e306a471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:50:33.744801 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f698d06f-27cc-46e5-994c-391e9752a367 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:33.745510 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f698d06f-27cc-46e5-994c-391e9752a367 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:33.747078 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1185/2381] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:50:33 2022] DELETE /identity/v3/projects/d1348b0eb68248458f697f51e306a471 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:50:33.751396 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b04d2-01d3-4345-ace1-a412c686f3ce service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:33.761625 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b04d2-01d3-4345-ace1-a412c686f3ce service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:33.826089 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:33.834116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80c2e6-042d-40cf-9542-a631975b9cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:33.834830 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80c2e6-042d-40cf-9542-a631975b9cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:33.835097 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80c2e6-042d-40cf-9542-a631975b9cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:33.835404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80c2e6-042d-40cf-9542-a631975b9cde admin admin] PATH_INFO: `/v3/users/17a262c21dcd4e8ca34da5a22c5cf889` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:33.836916 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c80c2e6-042d-40cf-9542-a631975b9cde admin admin] RBAC: Authorizing `identity:delete_user(user_id=17a262c21dcd4e8ca34da5a22c5cf889)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:33.839552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c80c2e6-042d-40cf-9542-a631975b9cde admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:34.165016 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2c80c2e6-042d-40cf-9542-a631975b9cde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17a262c21dcd4e8ca34da5a22c5cf889'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:34.239704 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2c80c2e6-042d-40cf-9542-a631975b9cde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17a262c21dcd4e8ca34da5a22c5cf889'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:34.240345 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2c80c2e6-042d-40cf-9542-a631975b9cde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17a262c21dcd4e8ca34da5a22c5cf889'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:34.240969 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2c80c2e6-042d-40cf-9542-a631975b9cde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17a262c21dcd4e8ca34da5a22c5cf889'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:34.250263 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2c80c2e6-042d-40cf-9542-a631975b9cde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17a262c21dcd4e8ca34da5a22c5cf889'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:34.270345 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1197/2382] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:50:33 2022] DELETE /identity/v3/users/17a262c21dcd4e8ca34da5a22c5cf889 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:50:34.773983 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698d06f-27cc-46e5-994c-391e9752a367 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:34.782356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f698d06f-27cc-46e5-994c-391e9752a367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:50:34.794046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698d06f-27cc-46e5-994c-391e9752a367 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:34.816406 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:34.873952 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37be0e-c7dc-4da0-9fa6-f22fdd43746a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:34.874625 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37be0e-c7dc-4da0-9fa6-f22fdd43746a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:34.874911 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37be0e-c7dc-4da0-9fa6-f22fdd43746a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:34.875193 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37be0e-c7dc-4da0-9fa6-f22fdd43746a admin admin] PATH_INFO: `/v3/projects/1590af8fdc0d49368b7174eeed9a2129` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:34.876507 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37be0e-c7dc-4da0-9fa6-f22fdd43746a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1590af8fdc0d49368b7174eeed9a2129)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:34.878603 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37be0e-c7dc-4da0-9fa6-f22fdd43746a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:35.020863 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-6c37be0e-c7dc-4da0-9fa6-f22fdd43746a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1590af8fdc0d49368b7174eeed9a2129', 'request_id': 'req-6c37be0e-c7dc-4da0-9fa6-f22fdd43746a'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:35.028055 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-6c37be0e-c7dc-4da0-9fa6-f22fdd43746a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1590af8fdc0d49368b7174eeed9a2129', 'request_id': 'req-6c37be0e-c7dc-4da0-9fa6-f22fdd43746a'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:35.096855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-6c37be0e-c7dc-4da0-9fa6-f22fdd43746a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1590af8fdc0d49368b7174eeed9a2129', 'request_id': 'req-6c37be0e-c7dc-4da0-9fa6-f22fdd43746a'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:35.111506 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-6c37be0e-c7dc-4da0-9fa6-f22fdd43746a admin admin] The token cache is being invalidate because project 1590af8fdc0d49368b7174eeed9a2129 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:50:35.111820 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-6c37be0e-c7dc-4da0-9fa6-f22fdd43746a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:35.112470 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-6c37be0e-c7dc-4da0-9fa6-f22fdd43746a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:35.114189 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1186/2383] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:50:34 2022] DELETE /identity/v3/projects/1590af8fdc0d49368b7174eeed9a2129 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:50:35.120076 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80c2e6-042d-40cf-9542-a631975b9cde admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:35.122530 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2c80c2e6-042d-40cf-9542-a631975b9cde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:50:35.139950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80c2e6-042d-40cf-9542-a631975b9cde admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:35.208464 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca96acf-ae4a-4939-a9e2-901393d69ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:35.209114 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca96acf-ae4a-4939-a9e2-901393d69ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:35.209391 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca96acf-ae4a-4939-a9e2-901393d69ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:35.209664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca96acf-ae4a-4939-a9e2-901393d69ac3 admin admin] PATH_INFO: `/v3/users/efb2718a9f654192905d8e751f3b4dbe` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:35.210856 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca96acf-ae4a-4939-a9e2-901393d69ac3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efb2718a9f654192905d8e751f3b4dbe)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:35.213218 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca96acf-ae4a-4939-a9e2-901393d69ac3 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:35.422873 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2ca96acf-ae4a-4939-a9e2-901393d69ac3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efb2718a9f654192905d8e751f3b4dbe'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:35.497007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2ca96acf-ae4a-4939-a9e2-901393d69ac3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efb2718a9f654192905d8e751f3b4dbe'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:35.497680 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2ca96acf-ae4a-4939-a9e2-901393d69ac3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efb2718a9f654192905d8e751f3b4dbe'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:35.498293 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2ca96acf-ae4a-4939-a9e2-901393d69ac3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efb2718a9f654192905d8e751f3b4dbe'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:35.506471 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2ca96acf-ae4a-4939-a9e2-901393d69ac3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efb2718a9f654192905d8e751f3b4dbe'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:35.520162 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:35.527455 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1198/2384] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:50:35 2022] DELETE /identity/v3/users/efb2718a9f654192905d8e751f3b4dbe => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:50:35.972663 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37be0e-c7dc-4da0-9fa6-f22fdd43746a admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:50:35.974149 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6c37be0e-c7dc-4da0-9fa6-f22fdd43746a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:50:35.994582 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37be0e-c7dc-4da0-9fa6-f22fdd43746a admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:50:36.059747 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddec6f-6ed9-46f0-b54e-886e9d9eac6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:50:36.060448 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddec6f-6ed9-46f0-b54e-886e9d9eac6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:50:36.060736 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddec6f-6ed9-46f0-b54e-886e9d9eac6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:50:36.061015 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddec6f-6ed9-46f0-b54e-886e9d9eac6f admin admin] PATH_INFO: `/v3/projects/0b8a5a5674e849818a93231f597e5fcf` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:50:36.062291 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ddec6f-6ed9-46f0-b54e-886e9d9eac6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b8a5a5674e849818a93231f597e5fcf)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:50:36.064315 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ddec6f-6ed9-46f0-b54e-886e9d9eac6f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:50:36.172381 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:36.174292 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-71ddec6f-6ed9-46f0-b54e-886e9d9eac6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b8a5a5674e849818a93231f597e5fcf', 'request_id': 'req-71ddec6f-6ed9-46f0-b54e-886e9d9eac6f'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:36.181235 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-71ddec6f-6ed9-46f0-b54e-886e9d9eac6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b8a5a5674e849818a93231f597e5fcf', 'request_id': 'req-71ddec6f-6ed9-46f0-b54e-886e9d9eac6f'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:36.254133 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-71ddec6f-6ed9-46f0-b54e-886e9d9eac6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b8a5a5674e849818a93231f597e5fcf', 'request_id': 'req-71ddec6f-6ed9-46f0-b54e-886e9d9eac6f'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:36.270428 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-71ddec6f-6ed9-46f0-b54e-886e9d9eac6f admin admin] The token cache is being invalidate because project 0b8a5a5674e849818a93231f597e5fcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:50:36.270874 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-71ddec6f-6ed9-46f0-b54e-886e9d9eac6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:36.272019 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-71ddec6f-6ed9-46f0-b54e-886e9d9eac6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:50:36.274578 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1187/2385] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:50:35 2022] DELETE /identity/v3/projects/0b8a5a5674e849818a93231f597e5fcf => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:50:45.825714 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:46.337353 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=7,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:51:06.641851 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed14d74-3f15-4668-a9f3-7c02e7bc95c0 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:51:06.641851 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed14d74-3f15-4668-a9f3-7c02e7bc95c0 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:51:06.641851 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed14d74-3f15-4668-a9f3-7c02e7bc95c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:51:06.670430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-4ed14d74-3f15-4668-a9f3-7c02e7bc95c0 None None] MFA Rules not processed for user `cf1cba65d61e45179dcc3aa3ba8391e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:51:06.671942 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4ed14d74-3f15-4668-a9f3-7c02e7bc95c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:51:06.742771 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1199/2386] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:51:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:51:13.149218 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc16933-2519-4828-8cbd-46ec1237bf4a None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:51:13.149811 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc16933-2519-4828-8cbd-46ec1237bf4a None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:51:13.149811 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc16933-2519-4828-8cbd-46ec1237bf4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:51:13.172291 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-fbc16933-2519-4828-8cbd-46ec1237bf4a None None] MFA Rules not processed for user `b0b04eae45014585a0fb2205adf946c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:51:13.175061 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-fbc16933-2519-4828-8cbd-46ec1237bf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:51:13.235530 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1188/2387] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:51:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:51:16.735355 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=25 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:51:21.856026 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783502d-0479-456e-9d0b-ec3eda331aaf None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:51:21.856779 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783502d-0479-456e-9d0b-ec3eda331aaf None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:51:21.856779 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783502d-0479-456e-9d0b-ec3eda331aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:51:21.875366 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c783502d-0479-456e-9d0b-ec3eda331aaf None None] MFA Rules not processed for user `0c035b3b70c340bf9f52df64449adf5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:51:21.876497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c783502d-0479-456e-9d0b-ec3eda331aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:51:21.932004 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1200/2388] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:51:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:51:23.226613 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=25 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:51:31.926289 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=25 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:52:00.217705 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc16933-2519-4828-8cbd-46ec1237bf4a None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:00.219522 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-fbc16933-2519-4828-8cbd-46ec1237bf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:00.290820 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc16933-2519-4828-8cbd-46ec1237bf4a None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:00.295648 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dfa2d-0dbe-49ce-80e1-d1b5893d9dab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:00.296291 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dfa2d-0dbe-49ce-80e1-d1b5893d9dab service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:00.296592 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dfa2d-0dbe-49ce-80e1-d1b5893d9dab service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:00.296872 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dfa2d-0dbe-49ce-80e1-d1b5893d9dab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:00.298771 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ea6dfa2d-0dbe-49ce-80e1-d1b5893d9dab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:00.392641 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6dfa2d-0dbe-49ce-80e1-d1b5893d9dab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:00.394416 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6dfa2d-0dbe-49ce-80e1-d1b5893d9dab service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:00.408890 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1189/2389] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:52:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:52:00.474621 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783502d-0479-456e-9d0b-ec3eda331aaf None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:00.476320 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c783502d-0479-456e-9d0b-ec3eda331aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:00.490732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783502d-0479-456e-9d0b-ec3eda331aaf None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:00.495140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac629e3-3ab6-46b0-9aa3-8309e3d6acef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:00.496013 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac629e3-3ab6-46b0-9aa3-8309e3d6acef service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:00.496349 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac629e3-3ab6-46b0-9aa3-8309e3d6acef service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:00.496674 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac629e3-3ab6-46b0-9aa3-8309e3d6acef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:00.500230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0ac629e3-3ab6-46b0-9aa3-8309e3d6acef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:00.528121 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac629e3-3ab6-46b0-9aa3-8309e3d6acef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:00.530214 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac629e3-3ab6-46b0-9aa3-8309e3d6acef service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:00.543863 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1201/2390] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:52:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:52:10.005610 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dfa2d-0dbe-49ce-80e1-d1b5893d9dab service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:10.015822 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dfa2d-0dbe-49ce-80e1-d1b5893d9dab service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:10.020185 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf08e0-68e4-48e7-96e9-6d78f9c59126 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:10.020998 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf08e0-68e4-48e7-96e9-6d78f9c59126 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:10.021535 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf08e0-68e4-48e7-96e9-6d78f9c59126 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:10.022004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf08e0-68e4-48e7-96e9-6d78f9c59126 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:10.024215 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-bbcf08e0-68e4-48e7-96e9-6d78f9c59126 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:10.037629 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf08e0-68e4-48e7-96e9-6d78f9c59126 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:10.039212 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf08e0-68e4-48e7-96e9-6d78f9c59126 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:10.050701 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1190/2391] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:52:10 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:52:10.537490 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=6 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:52:20.045649 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=60 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:52:21.267583 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac629e3-3ab6-46b0-9aa3-8309e3d6acef service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:21.269035 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0ac629e3-3ab6-46b0-9aa3-8309e3d6acef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:21.327741 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac629e3-3ab6-46b0-9aa3-8309e3d6acef service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:21.331709 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606a63d-8c68-47cd-a6db-84646baa296c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:21.332274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606a63d-8c68-47cd-a6db-84646baa296c service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:21.332554 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606a63d-8c68-47cd-a6db-84646baa296c service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:21.332828 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606a63d-8c68-47cd-a6db-84646baa296c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:21.334780 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b606a63d-8c68-47cd-a6db-84646baa296c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:21.351620 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b606a63d-8c68-47cd-a6db-84646baa296c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:21.351620 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b606a63d-8c68-47cd-a6db-84646baa296c service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:21.359541 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1202/2392] 10.222.0.26 () {60 vars in 1396 bytes} [Sun Sep 11 08:52:21 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3268 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:52:23.206445 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf08e0-68e4-48e7-96e9-6d78f9c59126 service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:23.208042 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-bbcf08e0-68e4-48e7-96e9-6d78f9c59126 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:23.225782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf08e0-68e4-48e7-96e9-6d78f9c59126 service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:23.231523 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984679ad-a9ea-4f39-9821-deca7ec00d56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:23.232151 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984679ad-a9ea-4f39-9821-deca7ec00d56 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:23.232436 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984679ad-a9ea-4f39-9821-deca7ec00d56 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:23.232716 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984679ad-a9ea-4f39-9821-deca7ec00d56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:23.234611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-984679ad-a9ea-4f39-9821-deca7ec00d56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:23.246466 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984679ad-a9ea-4f39-9821-deca7ec00d56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:23.248144 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984679ad-a9ea-4f39-9821-deca7ec00d56 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:23.258060 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1191/2393] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:52:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:52:28.364542 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606a63d-8c68-47cd-a6db-84646baa296c service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:28.375226 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606a63d-8c68-47cd-a6db-84646baa296c service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:28.380123 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbc7ae-19b4-4589-972a-7b30060347c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:28.380581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbc7ae-19b4-4589-972a-7b30060347c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:28.380863 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbc7ae-19b4-4589-972a-7b30060347c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:28.381362 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbc7ae-19b4-4589-972a-7b30060347c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:28.383399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-36fbc7ae-19b4-4589-972a-7b30060347c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:28.465684 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fbc7ae-19b4-4589-972a-7b30060347c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:28.467177 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fbc7ae-19b4-4589-972a-7b30060347c1 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:28.479650 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1203/2394] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:52:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:52:29.073042 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bf9eb-510e-4db8-8fc1-a593557c1452 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:29.073531 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bf9eb-510e-4db8-8fc1-a593557c1452 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:29.073633 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bf9eb-510e-4db8-8fc1-a593557c1452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:29.094746 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-662bf9eb-510e-4db8-8fc1-a593557c1452 None None] MFA Rules not processed for user `84fcccb19a5e43ac9da5d7ca501563e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:52:29.096011 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-662bf9eb-510e-4db8-8fc1-a593557c1452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:29.164929 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1192/2395] 10.222.0.26 () {58 vars in 1009 bytes} [Sun Sep 11 08:52:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:52:29.347913 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbc7ae-19b4-4589-972a-7b30060347c1 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:29.350991 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-36fbc7ae-19b4-4589-972a-7b30060347c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:29.434016 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbc7ae-19b4-4589-972a-7b30060347c1 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:29.439961 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c458de4-2718-42ae-901a-2c37d3e0aa39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a4f25df9724d34afdd6a41e719546a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:29.440583 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c458de4-2718-42ae-901a-2c37d3e0aa39 service swift] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:29.440859 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c458de4-2718-42ae-901a-2c37d3e0aa39 service swift] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:29.441249 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c458de4-2718-42ae-901a-2c37d3e0aa39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:29.450031 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c458de4-2718-42ae-901a-2c37d3e0aa39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:29.451808 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c458de4-2718-42ae-901a-2c37d3e0aa39 service swift] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:29.460594 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1204/2396] 10.222.0.26 () {60 vars in 1384 bytes} [Sun Sep 11 08:52:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 08:52:33.529381 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662bf9eb-510e-4db8-8fc1-a593557c1452 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:33.535040 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-662bf9eb-510e-4db8-8fc1-a593557c1452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:33.621590 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662bf9eb-510e-4db8-8fc1-a593557c1452 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:33.628470 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f286b72-17fc-4ead-bc72-7383e322e2d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a48c49f7a9f44cef89dd024fecea422f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:33.629122 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f286b72-17fc-4ead-bc72-7383e322e2d4 service placement] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:33.629654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f286b72-17fc-4ead-bc72-7383e322e2d4 service placement] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:33.629908 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f286b72-17fc-4ead-bc72-7383e322e2d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:33.632479 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-0f286b72-17fc-4ead-bc72-7383e322e2d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:33.646652 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f286b72-17fc-4ead-bc72-7383e322e2d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:33.648575 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f286b72-17fc-4ead-bc72-7383e322e2d4 service placement] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:33.662619 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1193/2397] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:52:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:52:33.687077 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c458de4-2718-42ae-901a-2c37d3e0aa39 service swift] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:33.698090 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8c458de4-2718-42ae-901a-2c37d3e0aa39 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:33.717510 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c458de4-2718-42ae-901a-2c37d3e0aa39 service swift] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:33.726020 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698dbad-60ee-4f64-be44-406801b2d6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:33.727080 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698dbad-60ee-4f64-be44-406801b2d6a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:33.727522 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698dbad-60ee-4f64-be44-406801b2d6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:33.728025 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698dbad-60ee-4f64-be44-406801b2d6a0 admin admin] PATH_INFO: `/v3/users/0c035b3b70c340bf9f52df64449adf5e` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:33.730157 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698dbad-60ee-4f64-be44-406801b2d6a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c035b3b70c340bf9f52df64449adf5e)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:33.733829 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698dbad-60ee-4f64-be44-406801b2d6a0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:33.768279 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:52:33.976899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-7698dbad-60ee-4f64-be44-406801b2d6a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c035b3b70c340bf9f52df64449adf5e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:34.093950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-7698dbad-60ee-4f64-be44-406801b2d6a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c035b3b70c340bf9f52df64449adf5e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:34.095809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-7698dbad-60ee-4f64-be44-406801b2d6a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c035b3b70c340bf9f52df64449adf5e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:34.096929 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-7698dbad-60ee-4f64-be44-406801b2d6a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c035b3b70c340bf9f52df64449adf5e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:34.108345 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-7698dbad-60ee-4f64-be44-406801b2d6a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c035b3b70c340bf9f52df64449adf5e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:34.148673 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1205/2398] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:52:33 2022] DELETE /identity/v3/users/0c035b3b70c340bf9f52df64449adf5e => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:52:34.440200 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f286b72-17fc-4ead-bc72-7383e322e2d4 service placement] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:34.459189 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f286b72-17fc-4ead-bc72-7383e322e2d4 service placement] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:34.543400 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f349ab-b402-49bf-9e03-278b0cd45b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:34.544064 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f349ab-b402-49bf-9e03-278b0cd45b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:34.544336 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f349ab-b402-49bf-9e03-278b0cd45b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:34.544791 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f349ab-b402-49bf-9e03-278b0cd45b3d admin admin] PATH_INFO: `/v3/projects/5d3dc5f94d2048268514f90c903ccfb2` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:34.547277 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f349ab-b402-49bf-9e03-278b0cd45b3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d3dc5f94d2048268514f90c903ccfb2)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:34.550769 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f349ab-b402-49bf-9e03-278b0cd45b3d admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:34.627348 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:52:34.667194 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698dbad-60ee-4f64-be44-406801b2d6a0 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:34.669280 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7698dbad-60ee-4f64-be44-406801b2d6a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:34.735717 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-05f349ab-b402-49bf-9e03-278b0cd45b3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d3dc5f94d2048268514f90c903ccfb2', 'request_id': 'req-05f349ab-b402-49bf-9e03-278b0cd45b3d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:34.761188 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-05f349ab-b402-49bf-9e03-278b0cd45b3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d3dc5f94d2048268514f90c903ccfb2', 'request_id': 'req-05f349ab-b402-49bf-9e03-278b0cd45b3d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:34.761324 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698dbad-60ee-4f64-be44-406801b2d6a0 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:34.820864 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5abb5-7392-45fb-82ec-67ffed3793b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:34.821451 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5abb5-7392-45fb-82ec-67ffed3793b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:34.821736 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5abb5-7392-45fb-82ec-67ffed3793b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:34.822012 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5abb5-7392-45fb-82ec-67ffed3793b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:34.824005 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b6a5abb5-7392-45fb-82ec-67ffed3793b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:34.850388 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-05f349ab-b402-49bf-9e03-278b0cd45b3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d3dc5f94d2048268514f90c903ccfb2', 'request_id': 'req-05f349ab-b402-49bf-9e03-278b0cd45b3d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:34.868549 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-05f349ab-b402-49bf-9e03-278b0cd45b3d admin admin] The token cache is being invalidate because project 5d3dc5f94d2048268514f90c903ccfb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:52:34.869152 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-05f349ab-b402-49bf-9e03-278b0cd45b3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:34.870759 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-05f349ab-b402-49bf-9e03-278b0cd45b3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:34.872767 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1194/2399] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:52:34 2022] DELETE /identity/v3/projects/5d3dc5f94d2048268514f90c903ccfb2 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:52:34.878313 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21669d-a72c-4369-946a-bc8c01ea7592 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:34.878738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21669d-a72c-4369-946a-bc8c01ea7592 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:34.879183 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21669d-a72c-4369-946a-bc8c01ea7592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:34.901891 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-1b21669d-a72c-4369-946a-bc8c01ea7592 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:52:34.903384 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1b21669d-a72c-4369-946a-bc8c01ea7592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:34.942970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5abb5-7392-45fb-82ec-67ffed3793b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:34.944916 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5abb5-7392-45fb-82ec-67ffed3793b3 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:34.968519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1206/2400] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:52:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:52:34.993894 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1195/2401] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:52:35.001825 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78db66-3364-404d-8fd0-17e8f8d37e42 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:35.002161 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78db66-3364-404d-8fd0-17e8f8d37e42 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:35.002422 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78db66-3364-404d-8fd0-17e8f8d37e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:35.012392 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:52:35.031654 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-1b78db66-3364-404d-8fd0-17e8f8d37e42 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:52:35.033590 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1b78db66-3364-404d-8fd0-17e8f8d37e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:35.046147 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1207/2402] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:52:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:52:35.052781 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21669d-a72c-4369-946a-bc8c01ea7592 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:35.064274 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21669d-a72c-4369-946a-bc8c01ea7592 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:35.075694 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747851b-d186-4223-8935-2ee992b0dc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:35.076773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747851b-d186-4223-8935-2ee992b0dc83 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:35.077298 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747851b-d186-4223-8935-2ee992b0dc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:35.077583 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747851b-d186-4223-8935-2ee992b0dc83 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:35.078544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747851b-d186-4223-8935-2ee992b0dc83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:52:35.079022 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747851b-d186-4223-8935-2ee992b0dc83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:35.081906 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747851b-d186-4223-8935-2ee992b0dc83 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:35.110358 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1196/2403] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:52:35.115426 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78db66-3364-404d-8fd0-17e8f8d37e42 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:35.129803 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78db66-3364-404d-8fd0-17e8f8d37e42 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:35.135978 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330d901-44f2-42e0-892c-3414e703e662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:35.137063 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330d901-44f2-42e0-892c-3414e703e662 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:35.137559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330d901-44f2-42e0-892c-3414e703e662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:35.138045 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330d901-44f2-42e0-892c-3414e703e662 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:35.138828 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8330d901-44f2-42e0-892c-3414e703e662 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:35.140905 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8330d901-44f2-42e0-892c-3414e703e662 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:35.249558 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1208/2404] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:52:35 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:52:35.249860 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747851b-d186-4223-8935-2ee992b0dc83 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:35.269194 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747851b-d186-4223-8935-2ee992b0dc83 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:35.400988 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a36c63-45dc-4738-8813-20e8b6a002cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:35.401555 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a36c63-45dc-4738-8813-20e8b6a002cc admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:35.401842 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a36c63-45dc-4738-8813-20e8b6a002cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:35.402129 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a36c63-45dc-4738-8813-20e8b6a002cc admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:35.402784 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a36c63-45dc-4738-8813-20e8b6a002cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:35.404810 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a36c63-45dc-4738-8813-20e8b6a002cc admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:35.504341 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1197/2405] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:52:35 2022] POST /identity/v3/users => generated 292 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:52:35.509797 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330d901-44f2-42e0-892c-3414e703e662 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:35.522728 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330d901-44f2-42e0-892c-3414e703e662 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:35.532282 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f040d84-55ea-4605-b0cf-6779eefaa643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:35.533664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f040d84-55ea-4605-b0cf-6779eefaa643 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:35.534055 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f040d84-55ea-4605-b0cf-6779eefaa643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:35.534646 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f040d84-55ea-4605-b0cf-6779eefaa643 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:35.535910 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f040d84-55ea-4605-b0cf-6779eefaa643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:35.538223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f040d84-55ea-4605-b0cf-6779eefaa643 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:35.552382 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1209/2406] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:52:35.556328 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a36c63-45dc-4738-8813-20e8b6a002cc admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:35.568449 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a36c63-45dc-4738-8813-20e8b6a002cc admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:35.577272 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270000d-3471-43b4-b053-4a9ec07f22a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:35.578052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270000d-3471-43b4-b053-4a9ec07f22a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:35.578436 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270000d-3471-43b4-b053-4a9ec07f22a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:35.578808 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270000d-3471-43b4-b053-4a9ec07f22a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:35.579609 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270000d-3471-43b4-b053-4a9ec07f22a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:35.581679 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270000d-3471-43b4-b053-4a9ec07f22a6 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:35.598646 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1198/2407] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:52:35.600975 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f040d84-55ea-4605-b0cf-6779eefaa643 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:35.613932 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f040d84-55ea-4605-b0cf-6779eefaa643 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:35.621526 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73cae3-10e4-4560-8dc1-e311ccf47321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:35.622537 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73cae3-10e4-4560-8dc1-e311ccf47321 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:35.623107 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73cae3-10e4-4560-8dc1-e311ccf47321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:35.623556 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73cae3-10e4-4560-8dc1-e311ccf47321 admin admin] PATH_INFO: `/v3/projects/57206fa8b5c046aa931a1adacf29a511/users/9f2b2835fdcd46e491e246799abd402b/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:35.655303 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73cae3-10e4-4560-8dc1-e311ccf47321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57206fa8b5c046aa931a1adacf29a511, user_id=9f2b2835fdcd46e491e246799abd402b, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:35.659649 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73cae3-10e4-4560-8dc1-e311ccf47321 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:35.758297 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1210/2408] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:52:35 2022] PUT /identity/v3/projects/57206fa8b5c046aa931a1adacf29a511/users/9f2b2835fdcd46e491e246799abd402b/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:52:35.758567 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ffff1-2771-4387-95ae-ae7068997ec8 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:35.758567 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ffff1-2771-4387-95ae-ae7068997ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:35.758567 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ffff1-2771-4387-95ae-ae7068997ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:35.797138 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-8f9ffff1-2771-4387-95ae-ae7068997ec8 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:52:35.799009 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-8f9ffff1-2771-4387-95ae-ae7068997ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:35.820120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:52:35.896816 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1199/2409] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:52:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:52:35.909631 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73cae3-10e4-4560-8dc1-e311ccf47321 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:35.911693 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5e73cae3-10e4-4560-8dc1-e311ccf47321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:35.998206 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73cae3-10e4-4560-8dc1-e311ccf47321 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:36.013650 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ae89c-a1ab-484f-af9a-587341b7b0ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:36.013650 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ae89c-a1ab-484f-af9a-587341b7b0ff service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:36.013650 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ae89c-a1ab-484f-af9a-587341b7b0ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:36.013650 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ae89c-a1ab-484f-af9a-587341b7b0ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:36.021401 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ae89c-a1ab-484f-af9a-587341b7b0ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:36.022617 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ae89c-a1ab-484f-af9a-587341b7b0ff service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:36.034794 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1211/2410] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:52:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:52:40.726242 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ffff1-2771-4387-95ae-ae7068997ec8 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:40.729055 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-8f9ffff1-2771-4387-95ae-ae7068997ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:40.900720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ffff1-2771-4387-95ae-ae7068997ec8 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:40.908951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd5209-0093-4a40-9a4d-fd485eaa3716 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a48c49f7a9f44cef89dd024fecea422f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:40.909744 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd5209-0093-4a40-9a4d-fd485eaa3716 service placement] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:40.915761 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd5209-0093-4a40-9a4d-fd485eaa3716 service placement] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:40.915761 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd5209-0093-4a40-9a4d-fd485eaa3716 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:40.915761 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-68dd5209-0093-4a40-9a4d-fd485eaa3716 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:40.927981 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd5209-0093-4a40-9a4d-fd485eaa3716 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:40.930058 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd5209-0093-4a40-9a4d-fd485eaa3716 service placement] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:40.943223 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1200/2411] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:52:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:52:41.161672 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ae89c-a1ab-484f-af9a-587341b7b0ff service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:41.164372 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2d0ae89c-a1ab-484f-af9a-587341b7b0ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:41.206117 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ae89c-a1ab-484f-af9a-587341b7b0ff service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:41.224736 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a2e15-fc72-4f79-83c8-4c797a7bc5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:41.225398 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a2e15-fc72-4f79-83c8-4c797a7bc5ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:41.225676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a2e15-fc72-4f79-83c8-4c797a7bc5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:41.226132 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a2e15-fc72-4f79-83c8-4c797a7bc5ed admin admin] PATH_INFO: `/v3/users/cf1cba65d61e45179dcc3aa3ba8391e6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:41.227733 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a2e15-fc72-4f79-83c8-4c797a7bc5ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf1cba65d61e45179dcc3aa3ba8391e6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:41.240968 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a2e15-fc72-4f79-83c8-4c797a7bc5ed admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:41.604931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ea0a2e15-fc72-4f79-83c8-4c797a7bc5ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf1cba65d61e45179dcc3aa3ba8391e6'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:41.732812 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ea0a2e15-fc72-4f79-83c8-4c797a7bc5ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf1cba65d61e45179dcc3aa3ba8391e6'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:41.733466 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ea0a2e15-fc72-4f79-83c8-4c797a7bc5ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf1cba65d61e45179dcc3aa3ba8391e6'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:41.734176 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ea0a2e15-fc72-4f79-83c8-4c797a7bc5ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf1cba65d61e45179dcc3aa3ba8391e6'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:41.745347 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ea0a2e15-fc72-4f79-83c8-4c797a7bc5ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf1cba65d61e45179dcc3aa3ba8391e6'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:41.767908 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1212/2412] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:52:41 2022] DELETE /identity/v3/users/cf1cba65d61e45179dcc3aa3ba8391e6 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:52:42.094692 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd5209-0093-4a40-9a4d-fd485eaa3716 service placement] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:42.112011 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd5209-0093-4a40-9a4d-fd485eaa3716 service placement] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:42.251197 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03b760-a8f1-43da-b935-e02804bba416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:42.253671 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03b760-a8f1-43da-b935-e02804bba416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:42.254476 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03b760-a8f1-43da-b935-e02804bba416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:42.254775 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03b760-a8f1-43da-b935-e02804bba416 admin admin] PATH_INFO: `/v3/projects/6a9dc48ca18740828d0757eafb227500` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:42.256893 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03b760-a8f1-43da-b935-e02804bba416 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a9dc48ca18740828d0757eafb227500)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:42.261848 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03b760-a8f1-43da-b935-e02804bba416 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:42.483034 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-9c03b760-a8f1-43da-b935-e02804bba416 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a9dc48ca18740828d0757eafb227500', 'request_id': 'req-9c03b760-a8f1-43da-b935-e02804bba416'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:42.484741 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:52:42.501865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-9c03b760-a8f1-43da-b935-e02804bba416 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a9dc48ca18740828d0757eafb227500', 'request_id': 'req-9c03b760-a8f1-43da-b935-e02804bba416'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:42.633407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-9c03b760-a8f1-43da-b935-e02804bba416 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a9dc48ca18740828d0757eafb227500', 'request_id': 'req-9c03b760-a8f1-43da-b935-e02804bba416'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:42.654966 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-9c03b760-a8f1-43da-b935-e02804bba416 admin admin] The token cache is being invalidate because project 6a9dc48ca18740828d0757eafb227500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:52:42.655800 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-9c03b760-a8f1-43da-b935-e02804bba416 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:42.658214 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-9c03b760-a8f1-43da-b935-e02804bba416 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:42.662888 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1201/2413] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:52:42 2022] DELETE /identity/v3/projects/6a9dc48ca18740828d0757eafb227500 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:52:42.671788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e9c58-864c-4478-a3b5-ab3dc1751429 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:42.671788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e9c58-864c-4478-a3b5-ab3dc1751429 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:42.671788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e9c58-864c-4478-a3b5-ab3dc1751429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:42.721071 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-3c8e9c58-864c-4478-a3b5-ab3dc1751429 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:52:42.722766 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3c8e9c58-864c-4478-a3b5-ab3dc1751429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:42.738003 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:52:42.865862 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1213/2414] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:52:42.867903 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa1859-7da8-4dbe-aa42-2bd3d9e5244d None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:42.871386 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa1859-7da8-4dbe-aa42-2bd3d9e5244d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:42.871798 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa1859-7da8-4dbe-aa42-2bd3d9e5244d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:42.924228 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-28aa1859-7da8-4dbe-aa42-2bd3d9e5244d None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:52:42.928139 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-28aa1859-7da8-4dbe-aa42-2bd3d9e5244d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:42.967318 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1202/2415] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:52:42.968022 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e9c58-864c-4478-a3b5-ab3dc1751429 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:42.985456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e9c58-864c-4478-a3b5-ab3dc1751429 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:43.006540 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ab6a4-5e08-4532-9a2b-0f6f5b2f53e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:43.011318 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ab6a4-5e08-4532-9a2b-0f6f5b2f53e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:43.012060 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ab6a4-5e08-4532-9a2b-0f6f5b2f53e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:43.014280 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ab6a4-5e08-4532-9a2b-0f6f5b2f53e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:43.015161 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ab6a4-5e08-4532-9a2b-0f6f5b2f53e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:52:43.015161 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ab6a4-5e08-4532-9a2b-0f6f5b2f53e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:43.016693 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ab6a4-5e08-4532-9a2b-0f6f5b2f53e5 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:43.079399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1214/2416] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:52:43.081149 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa1859-7da8-4dbe-aa42-2bd3d9e5244d None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:43.098461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa1859-7da8-4dbe-aa42-2bd3d9e5244d None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:43.111145 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238efa97-f476-4512-8454-33332afc97b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:43.111871 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238efa97-f476-4512-8454-33332afc97b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:43.112168 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238efa97-f476-4512-8454-33332afc97b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:43.112442 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238efa97-f476-4512-8454-33332afc97b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:43.113107 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238efa97-f476-4512-8454-33332afc97b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:43.117886 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238efa97-f476-4512-8454-33332afc97b9 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:43.262099 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1203/2417] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:52:43 2022] POST /identity/v3/projects => generated 363 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:52:43.263438 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ab6a4-5e08-4532-9a2b-0f6f5b2f53e5 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:43.274079 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ab6a4-5e08-4532-9a2b-0f6f5b2f53e5 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:43.404289 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf288f-aa74-449f-8562-1b2d93d9544b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:43.414157 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf288f-aa74-449f-8562-1b2d93d9544b admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:43.414157 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf288f-aa74-449f-8562-1b2d93d9544b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:43.414157 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf288f-aa74-449f-8562-1b2d93d9544b admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:43.414157 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf288f-aa74-449f-8562-1b2d93d9544b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:43.414157 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf288f-aa74-449f-8562-1b2d93d9544b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:43.541361 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1215/2418] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:52:43 2022] POST /identity/v3/users => generated 282 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:52:43.545248 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238efa97-f476-4512-8454-33332afc97b9 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:43.567838 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238efa97-f476-4512-8454-33332afc97b9 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:43.574614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca518c6c-0634-45ba-99b3-f3c4285b5a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:43.575529 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca518c6c-0634-45ba-99b3-f3c4285b5a83 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:43.575989 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca518c6c-0634-45ba-99b3-f3c4285b5a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:43.576443 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca518c6c-0634-45ba-99b3-f3c4285b5a83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:43.577119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca518c6c-0634-45ba-99b3-f3c4285b5a83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:43.578761 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca518c6c-0634-45ba-99b3-f3c4285b5a83 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:43.592218 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1204/2419] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:52:43.597328 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf288f-aa74-449f-8562-1b2d93d9544b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:43.616345 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf288f-aa74-449f-8562-1b2d93d9544b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:43.624380 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84196593-a78c-4b6c-a360-d5ff9bf54fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:43.625404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84196593-a78c-4b6c-a360-d5ff9bf54fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:43.625913 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84196593-a78c-4b6c-a360-d5ff9bf54fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:43.626417 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84196593-a78c-4b6c-a360-d5ff9bf54fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:43.627652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84196593-a78c-4b6c-a360-d5ff9bf54fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:43.630816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84196593-a78c-4b6c-a360-d5ff9bf54fd7 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:43.645449 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1216/2420] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:52:43.655375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca518c6c-0634-45ba-99b3-f3c4285b5a83 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:43.680117 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca518c6c-0634-45ba-99b3-f3c4285b5a83 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:43.686045 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6a36c-716e-4958-a21f-9358f7c57bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:43.686750 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6a36c-716e-4958-a21f-9358f7c57bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:43.687031 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6a36c-716e-4958-a21f-9358f7c57bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:43.687929 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6a36c-716e-4958-a21f-9358f7c57bf8 admin admin] PATH_INFO: `/v3/projects/55ea2cfbd2ab4978b1b4e0ca23dfb46d/users/b35c63a0e29b442e917423c9b5c9bbbb/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:43.713051 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6a36c-716e-4958-a21f-9358f7c57bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55ea2cfbd2ab4978b1b4e0ca23dfb46d, user_id=b35c63a0e29b442e917423c9b5c9bbbb, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:43.717288 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6a36c-716e-4958-a21f-9358f7c57bf8 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:43.831194 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1205/2421] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:52:43 2022] PUT /identity/v3/projects/55ea2cfbd2ab4978b1b4e0ca23dfb46d/users/b35c63a0e29b442e917423c9b5c9bbbb/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:52:43.845232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda48a6-380b-45ce-8a35-04230bbfb719 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:43.849021 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda48a6-380b-45ce-8a35-04230bbfb719 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:43.849481 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda48a6-380b-45ce-8a35-04230bbfb719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:43.903241 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-abda48a6-380b-45ce-8a35-04230bbfb719 None None] MFA Rules not processed for user `b35c63a0e29b442e917423c9b5c9bbbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:52:43.904587 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-abda48a6-380b-45ce-8a35-04230bbfb719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:44.017950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1217/2422] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:52:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:52:44.022845 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6a36c-716e-4958-a21f-9358f7c57bf8 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:44.139161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6a36c-716e-4958-a21f-9358f7c57bf8 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:44.152538 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47004cc9-4148-4b03-9699-6c6cf1f5a276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:44.153464 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47004cc9-4148-4b03-9699-6c6cf1f5a276 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:44.154104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47004cc9-4148-4b03-9699-6c6cf1f5a276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:44.158786 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47004cc9-4148-4b03-9699-6c6cf1f5a276 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:44.158786 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47004cc9-4148-4b03-9699-6c6cf1f5a276 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:44.158786 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47004cc9-4148-4b03-9699-6c6cf1f5a276 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:44.253992 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1206/2423] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:52:44 2022] POST /identity/v3/projects => generated 363 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:52:44.255782 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda48a6-380b-45ce-8a35-04230bbfb719 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:44.267756 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda48a6-380b-45ce-8a35-04230bbfb719 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:44.278578 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:52:44.353124 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495b978-c8c9-4f2f-bdcb-437fee4cdcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:44.354253 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495b978-c8c9-4f2f-bdcb-437fee4cdcd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:44.354968 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495b978-c8c9-4f2f-bdcb-437fee4cdcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:44.355444 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495b978-c8c9-4f2f-bdcb-437fee4cdcd1 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:44.356418 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495b978-c8c9-4f2f-bdcb-437fee4cdcd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:44.358780 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495b978-c8c9-4f2f-bdcb-437fee4cdcd1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:44.497181 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1218/2424] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:52:44 2022] POST /identity/v3/users => generated 288 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:52:44.502699 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47004cc9-4148-4b03-9699-6c6cf1f5a276 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:44.521666 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47004cc9-4148-4b03-9699-6c6cf1f5a276 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:44.528684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b55c47-6c62-4be7-bb0f-d18f6fdf3493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:44.529552 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b55c47-6c62-4be7-bb0f-d18f6fdf3493 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:44.530045 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b55c47-6c62-4be7-bb0f-d18f6fdf3493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:44.530395 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b55c47-6c62-4be7-bb0f-d18f6fdf3493 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:44.531360 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b55c47-6c62-4be7-bb0f-d18f6fdf3493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:44.533338 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b55c47-6c62-4be7-bb0f-d18f6fdf3493 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:44.554593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1207/2425] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:52:44.557175 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495b978-c8c9-4f2f-bdcb-437fee4cdcd1 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:44.576285 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495b978-c8c9-4f2f-bdcb-437fee4cdcd1 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:44.584002 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b760ae7-d538-464f-8cd4-1b736fc7b644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:44.584959 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b760ae7-d538-464f-8cd4-1b736fc7b644 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:44.586849 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b760ae7-d538-464f-8cd4-1b736fc7b644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:44.586849 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b760ae7-d538-464f-8cd4-1b736fc7b644 admin admin] PATH_INFO: `/v3/projects/3225bbb40b494be3b57e2912f0fb37f8/users/887d810ee897428ab33d19267d456be8/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:44.608833 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b760ae7-d538-464f-8cd4-1b736fc7b644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3225bbb40b494be3b57e2912f0fb37f8, user_id=887d810ee897428ab33d19267d456be8, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:44.613194 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b760ae7-d538-464f-8cd4-1b736fc7b644 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:44.661498 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9c9a6-0a9f-4ae6-9cc2-143fd34ccf85 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:44.661861 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9c9a6-0a9f-4ae6-9cc2-143fd34ccf85 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:44.662093 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9c9a6-0a9f-4ae6-9cc2-143fd34ccf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:44.698352 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-1eb9c9a6-0a9f-4ae6-9cc2-143fd34ccf85 None None] MFA Rules not processed for user `9f2b2835fdcd46e491e246799abd402b`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:52:44.699844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1eb9c9a6-0a9f-4ae6-9cc2-143fd34ccf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:44.741788 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:52:44.759967 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1219/2426] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:52:44 2022] PUT /identity/v3/projects/3225bbb40b494be3b57e2912f0fb37f8/users/887d810ee897428ab33d19267d456be8/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:52:44.763581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b760ae7-d538-464f-8cd4-1b736fc7b644 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:44.808310 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1208/2427] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:52:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:52:44.824367 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9c9a6-0a9f-4ae6-9cc2-143fd34ccf85 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:44.826923 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1eb9c9a6-0a9f-4ae6-9cc2-143fd34ccf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:44.860100 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b760ae7-d538-464f-8cd4-1b736fc7b644 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:44.866310 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381fec7-9fbc-4f12-8105-a8d52ca394ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:44.867349 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381fec7-9fbc-4f12-8105-a8d52ca394ef admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:44.867881 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381fec7-9fbc-4f12-8105-a8d52ca394ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:44.868970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381fec7-9fbc-4f12-8105-a8d52ca394ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:44.869862 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0381fec7-9fbc-4f12-8105-a8d52ca394ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:44.872285 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0381fec7-9fbc-4f12-8105-a8d52ca394ef admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:44.885674 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1220/2428] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:52:44.893877 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381fec7-9fbc-4f12-8105-a8d52ca394ef admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:44.907103 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381fec7-9fbc-4f12-8105-a8d52ca394ef admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:44.913011 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec1217-095e-4341-a9a7-addb4234a332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:44.913856 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec1217-095e-4341-a9a7-addb4234a332 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:44.914313 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec1217-095e-4341-a9a7-addb4234a332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:44.914631 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec1217-095e-4341-a9a7-addb4234a332 admin admin] PATH_INFO: `/v3/projects/3225bbb40b494be3b57e2912f0fb37f8/users/887d810ee897428ab33d19267d456be8/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:44.918117 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec1217-095e-4341-a9a7-addb4234a332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3225bbb40b494be3b57e2912f0fb37f8, user_id=887d810ee897428ab33d19267d456be8, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:44.921247 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec1217-095e-4341-a9a7-addb4234a332 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:44.950361 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1221/2429] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:52:44 2022] PUT /identity/v3/projects/3225bbb40b494be3b57e2912f0fb37f8/users/887d810ee897428ab33d19267d456be8/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:52:44.950361 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec1217-095e-4341-a9a7-addb4234a332 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:44.950361 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-98ec1217-095e-4341-a9a7-addb4234a332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:44.950738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9c9a6-0a9f-4ae6-9cc2-143fd34ccf85 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:45.045588 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec1217-095e-4341-a9a7-addb4234a332 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:45.051410 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd64c4c-69e2-44cc-9fce-c4b9706e95a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:45.053478 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd64c4c-69e2-44cc-9fce-c4b9706e95a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:45.053478 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd64c4c-69e2-44cc-9fce-c4b9706e95a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:45.053478 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd64c4c-69e2-44cc-9fce-c4b9706e95a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:45.055474 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-fbd64c4c-69e2-44cc-9fce-c4b9706e95a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:45.057003 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dea6f8-73ad-478e-94cf-2a63a48fd6b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:45.057635 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dea6f8-73ad-478e-94cf-2a63a48fd6b1 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:45.057920 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dea6f8-73ad-478e-94cf-2a63a48fd6b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:45.058199 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dea6f8-73ad-478e-94cf-2a63a48fd6b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:45.070775 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd64c4c-69e2-44cc-9fce-c4b9706e95a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:45.075137 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd64c4c-69e2-44cc-9fce-c4b9706e95a0 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:45.085489 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1222/2430] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:52:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:52:45.100106 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476caf47-b447-4b00-8f1d-7c1ea04f727b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:45.102375 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476caf47-b447-4b00-8f1d-7c1ea04f727b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:45.103856 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476caf47-b447-4b00-8f1d-7c1ea04f727b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:45.123611 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:52:45.140059 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dea6f8-73ad-478e-94cf-2a63a48fd6b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:45.144272 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dea6f8-73ad-478e-94cf-2a63a48fd6b1 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:45.152526 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-476caf47-b447-4b00-8f1d-7c1ea04f727b None None] MFA Rules not processed for user `887d810ee897428ab33d19267d456be8`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:52:45.153983 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-476caf47-b447-4b00-8f1d-7c1ea04f727b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:45.171440 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1209/2431] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:52:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:52:45.267197 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1223/2432] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:52:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:52:45.280916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dea6f8-73ad-478e-94cf-2a63a48fd6b1 service nova] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:45.282512 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e5dea6f8-73ad-478e-94cf-2a63a48fd6b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:45.297813 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:52:45.344593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dea6f8-73ad-478e-94cf-2a63a48fd6b1 service nova] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:45.348464 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68259989-a97a-406b-a6b3-fec8b163e95b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:45.349031 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68259989-a97a-406b-a6b3-fec8b163e95b service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:45.349314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68259989-a97a-406b-a6b3-fec8b163e95b service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:45.349590 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68259989-a97a-406b-a6b3-fec8b163e95b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:45.367165 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68259989-a97a-406b-a6b3-fec8b163e95b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:45.368736 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68259989-a97a-406b-a6b3-fec8b163e95b service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:45.380343 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1210/2433] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:52:45 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:52:45.721996 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476caf47-b447-4b00-8f1d-7c1ea04f727b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:45.735626 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476caf47-b447-4b00-8f1d-7c1ea04f727b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:45.736935 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f046b-eb4a-460f-b397-5514ba89bfef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:45.737562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f046b-eb4a-460f-b397-5514ba89bfef service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:45.737853 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f046b-eb4a-460f-b397-5514ba89bfef service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:45.738131 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f046b-eb4a-460f-b397-5514ba89bfef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:45.803702 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3f046b-eb4a-460f-b397-5514ba89bfef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:45.805167 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3f046b-eb4a-460f-b397-5514ba89bfef service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:45.816929 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1224/2434] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:52:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:52:48.038560 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb72a0-5534-42b8-b2e0-e6de9427663d None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:48.039111 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb72a0-5534-42b8-b2e0-e6de9427663d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:48.039111 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb72a0-5534-42b8-b2e0-e6de9427663d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:48.064642 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-14bb72a0-5534-42b8-b2e0-e6de9427663d None None] MFA Rules not processed for user `9f2b2835fdcd46e491e246799abd402b`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:52:48.065946 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-14bb72a0-5534-42b8-b2e0-e6de9427663d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:48.074513 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1211/2435] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:52:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:52:48.522079 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f046b-eb4a-460f-b397-5514ba89bfef service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:48.523734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ee3f046b-eb4a-460f-b397-5514ba89bfef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:48.547175 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f046b-eb4a-460f-b397-5514ba89bfef service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:48.551591 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754d2b9-9f49-4ef9-8496-12af358fd066 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:48.552456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754d2b9-9f49-4ef9-8496-12af358fd066 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:48.552822 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754d2b9-9f49-4ef9-8496-12af358fd066 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:48.553102 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754d2b9-9f49-4ef9-8496-12af358fd066 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:48.555196 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1754d2b9-9f49-4ef9-8496-12af358fd066 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:48.566800 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754d2b9-9f49-4ef9-8496-12af358fd066 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:48.568628 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754d2b9-9f49-4ef9-8496-12af358fd066 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:48.579239 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1225/2436] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:52:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:52:48.996771 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb72a0-5534-42b8-b2e0-e6de9427663d None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:48.998355 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-14bb72a0-5534-42b8-b2e0-e6de9427663d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:49.096319 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb72a0-5534-42b8-b2e0-e6de9427663d None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:49.102146 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562831a-6825-4839-852c-fb2d1abed288 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a48c49f7a9f44cef89dd024fecea422f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:49.103356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562831a-6825-4839-852c-fb2d1abed288 service placement] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:49.103660 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562831a-6825-4839-852c-fb2d1abed288 service placement] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:49.103929 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562831a-6825-4839-852c-fb2d1abed288 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:49.105673 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b562831a-6825-4839-852c-fb2d1abed288 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:49.118379 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562831a-6825-4839-852c-fb2d1abed288 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:49.120211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562831a-6825-4839-852c-fb2d1abed288 service placement] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:49.131416 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1212/2437] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:52:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:52:54.211834 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754d2b9-9f49-4ef9-8496-12af358fd066 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:54.214583 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1754d2b9-9f49-4ef9-8496-12af358fd066 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:54.234579 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754d2b9-9f49-4ef9-8496-12af358fd066 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:54.242238 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1d976-7945-4ab4-ae36-559a0cbe639d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:54.249849 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1d976-7945-4ab4-ae36-559a0cbe639d service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:54.249849 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1d976-7945-4ab4-ae36-559a0cbe639d service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:54.249849 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1d976-7945-4ab4-ae36-559a0cbe639d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:54.249849 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e2f1d976-7945-4ab4-ae36-559a0cbe639d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:54.278290 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1d976-7945-4ab4-ae36-559a0cbe639d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:54.280233 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1d976-7945-4ab4-ae36-559a0cbe639d service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:54.292727 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1226/2438] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:52:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:52:54.900098 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8eb7a6-273a-436a-8333-0a8d57c9efab None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:54.900677 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8eb7a6-273a-436a-8333-0a8d57c9efab None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:54.900677 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8eb7a6-273a-436a-8333-0a8d57c9efab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:54.921106 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-5c8eb7a6-273a-436a-8333-0a8d57c9efab None None] MFA Rules not processed for user `84fcccb19a5e43ac9da5d7ca501563e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:52:54.922340 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5c8eb7a6-273a-436a-8333-0a8d57c9efab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:54.984769 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1213/2439] 10.222.0.26 () {58 vars in 1009 bytes} [Sun Sep 11 08:52:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:52:54.996785 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1d976-7945-4ab4-ae36-559a0cbe639d service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:54.998190 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e2f1d976-7945-4ab4-ae36-559a0cbe639d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:55.065673 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:52:55.072658 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1d976-7945-4ab4-ae36-559a0cbe639d service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:55.081346 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a57141c-3762-4a07-a5c9-98098f733337 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a4f25df9724d34afdd6a41e719546a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:55.082400 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57141c-3762-4a07-a5c9-98098f733337 service swift] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:55.082960 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57141c-3762-4a07-a5c9-98098f733337 service swift] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:55.083523 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57141c-3762-4a07-a5c9-98098f733337 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:55.099812 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a57141c-3762-4a07-a5c9-98098f733337 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:55.106854 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a57141c-3762-4a07-a5c9-98098f733337 service swift] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:55.110744 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1227/2440] 10.222.0.26 () {60 vars in 1384 bytes} [Sun Sep 11 08:52:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 08:52:55.181486 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8eb7a6-273a-436a-8333-0a8d57c9efab None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:55.230753 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:52:55.251637 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8eb7a6-273a-436a-8333-0a8d57c9efab None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:55.257017 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9b0f1-9af1-41c3-9a79-e2a78436d74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:55.257668 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9b0f1-9af1-41c3-9a79-e2a78436d74d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:55.257951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9b0f1-9af1-41c3-9a79-e2a78436d74d admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:55.258229 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9b0f1-9af1-41c3-9a79-e2a78436d74d admin admin] PATH_INFO: `/v3/users/b35c63a0e29b442e917423c9b5c9bbbb` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:55.260015 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9b0f1-9af1-41c3-9a79-e2a78436d74d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b35c63a0e29b442e917423c9b5c9bbbb)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:55.262036 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9b0f1-9af1-41c3-9a79-e2a78436d74d admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:55.478722 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c2a9b0f1-9af1-41c3-9a79-e2a78436d74d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b35c63a0e29b442e917423c9b5c9bbbb'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:55.482267 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c2a9b0f1-9af1-41c3-9a79-e2a78436d74d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b35c63a0e29b442e917423c9b5c9bbbb'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:55.486726 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c2a9b0f1-9af1-41c3-9a79-e2a78436d74d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b35c63a0e29b442e917423c9b5c9bbbb'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:55.487506 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c2a9b0f1-9af1-41c3-9a79-e2a78436d74d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b35c63a0e29b442e917423c9b5c9bbbb'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:55.554890 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c2a9b0f1-9af1-41c3-9a79-e2a78436d74d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b35c63a0e29b442e917423c9b5c9bbbb'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:55.574032 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1214/2441] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:52:55 2022] DELETE /identity/v3/users/b35c63a0e29b442e917423c9b5c9bbbb => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:52:55.578623 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf13ab2-5195-4b83-a83b-11c0e683ab7e None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:55.579207 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf13ab2-5195-4b83-a83b-11c0e683ab7e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:55.579207 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf13ab2-5195-4b83-a83b-11c0e683ab7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:55.608798 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2bf13ab2-5195-4b83-a83b-11c0e683ab7e None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:52:55.611415 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2bf13ab2-5195-4b83-a83b-11c0e683ab7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:55.705941 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1228/2442] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:52:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:52:55.712893 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9b0f1-9af1-41c3-9a79-e2a78436d74d admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:55.715010 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c2a9b0f1-9af1-41c3-9a79-e2a78436d74d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:55.859490 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9b0f1-9af1-41c3-9a79-e2a78436d74d admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:55.865778 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f4652-c32a-43dc-b1e9-e2665401233f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:55.866656 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f4652-c32a-43dc-b1e9-e2665401233f service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:55.867109 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f4652-c32a-43dc-b1e9-e2665401233f service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:55.867587 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f4652-c32a-43dc-b1e9-e2665401233f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:55.896659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f4652-c32a-43dc-b1e9-e2665401233f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:55.896659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f4652-c32a-43dc-b1e9-e2665401233f service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:55.926621 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1215/2443] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:52:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:52:56.491233 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf13ab2-5195-4b83-a83b-11c0e683ab7e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:56.492423 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2bf13ab2-5195-4b83-a83b-11c0e683ab7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:56.512749 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf13ab2-5195-4b83-a83b-11c0e683ab7e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:56.522037 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f7a1b-24dc-4e1e-8d6f-3a049dab9f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:56.522840 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f7a1b-24dc-4e1e-8d6f-3a049dab9f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:56.523192 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f7a1b-24dc-4e1e-8d6f-3a049dab9f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:56.524157 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f7a1b-24dc-4e1e-8d6f-3a049dab9f27 admin admin] PATH_INFO: `/v3/projects/55ea2cfbd2ab4978b1b4e0ca23dfb46d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:56.529019 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f7a1b-24dc-4e1e-8d6f-3a049dab9f27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55ea2cfbd2ab4978b1b4e0ca23dfb46d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:56.533284 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f7a1b-24dc-4e1e-8d6f-3a049dab9f27 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:56.722252 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6d8f7a1b-24dc-4e1e-8d6f-3a049dab9f27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55ea2cfbd2ab4978b1b4e0ca23dfb46d', 'request_id': 'req-6d8f7a1b-24dc-4e1e-8d6f-3a049dab9f27'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:56.734537 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6d8f7a1b-24dc-4e1e-8d6f-3a049dab9f27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55ea2cfbd2ab4978b1b4e0ca23dfb46d', 'request_id': 'req-6d8f7a1b-24dc-4e1e-8d6f-3a049dab9f27'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:56.838771 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6d8f7a1b-24dc-4e1e-8d6f-3a049dab9f27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55ea2cfbd2ab4978b1b4e0ca23dfb46d', 'request_id': 'req-6d8f7a1b-24dc-4e1e-8d6f-3a049dab9f27'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:56.860729 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6d8f7a1b-24dc-4e1e-8d6f-3a049dab9f27 admin admin] The token cache is being invalidate because project 55ea2cfbd2ab4978b1b4e0ca23dfb46d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:52:56.861291 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6d8f7a1b-24dc-4e1e-8d6f-3a049dab9f27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:56.862358 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6d8f7a1b-24dc-4e1e-8d6f-3a049dab9f27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:56.872379 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f4652-c32a-43dc-b1e9-e2665401233f service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:56.880904 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1229/2444] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:52:56 2022] DELETE /identity/v3/projects/55ea2cfbd2ab4978b1b4e0ca23dfb46d => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:52:56.894668 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f4652-c32a-43dc-b1e9-e2665401233f service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:57.005397 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938308c9-8243-4a77-89b5-5c85ac85db0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:57.006400 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938308c9-8243-4a77-89b5-5c85ac85db0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:57.007007 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938308c9-8243-4a77-89b5-5c85ac85db0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:57.007440 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938308c9-8243-4a77-89b5-5c85ac85db0b admin admin] PATH_INFO: `/v3/users/887d810ee897428ab33d19267d456be8` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:57.009888 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938308c9-8243-4a77-89b5-5c85ac85db0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=887d810ee897428ab33d19267d456be8)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:57.013955 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938308c9-8243-4a77-89b5-5c85ac85db0b admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:57.032258 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:52:57.244283 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-938308c9-8243-4a77-89b5-5c85ac85db0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '887d810ee897428ab33d19267d456be8'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:57.245296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-938308c9-8243-4a77-89b5-5c85ac85db0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '887d810ee897428ab33d19267d456be8'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:57.264827 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-938308c9-8243-4a77-89b5-5c85ac85db0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '887d810ee897428ab33d19267d456be8'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:57.264827 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-938308c9-8243-4a77-89b5-5c85ac85db0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '887d810ee897428ab33d19267d456be8'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:57.348094 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-938308c9-8243-4a77-89b5-5c85ac85db0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '887d810ee897428ab33d19267d456be8'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:57.386476 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1216/2445] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:52:56 2022] DELETE /identity/v3/users/887d810ee897428ab33d19267d456be8 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:52:57.968321 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f7a1b-24dc-4e1e-8d6f-3a049dab9f27 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:57.970986 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6d8f7a1b-24dc-4e1e-8d6f-3a049dab9f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:58.016793 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f7a1b-24dc-4e1e-8d6f-3a049dab9f27 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:58.107862 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b5d53-1fee-4e56-9e48-1baf4a645ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:58.108937 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b5d53-1fee-4e56-9e48-1baf4a645ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:58.109337 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b5d53-1fee-4e56-9e48-1baf4a645ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:58.109619 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b5d53-1fee-4e56-9e48-1baf4a645ebf admin admin] PATH_INFO: `/v3/projects/3225bbb40b494be3b57e2912f0fb37f8` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:58.113970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b5d53-1fee-4e56-9e48-1baf4a645ebf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3225bbb40b494be3b57e2912f0fb37f8)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:58.113970 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b5d53-1fee-4e56-9e48-1baf4a645ebf admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:58.150288 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:52:58.362124 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5f6b5d53-1fee-4e56-9e48-1baf4a645ebf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3225bbb40b494be3b57e2912f0fb37f8', 'request_id': 'req-5f6b5d53-1fee-4e56-9e48-1baf4a645ebf'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:58.369169 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5f6b5d53-1fee-4e56-9e48-1baf4a645ebf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3225bbb40b494be3b57e2912f0fb37f8', 'request_id': 'req-5f6b5d53-1fee-4e56-9e48-1baf4a645ebf'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:58.498953 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5f6b5d53-1fee-4e56-9e48-1baf4a645ebf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3225bbb40b494be3b57e2912f0fb37f8', 'request_id': 'req-5f6b5d53-1fee-4e56-9e48-1baf4a645ebf'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:58.518501 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5f6b5d53-1fee-4e56-9e48-1baf4a645ebf admin admin] The token cache is being invalidate because project 3225bbb40b494be3b57e2912f0fb37f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:52:58.518859 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5f6b5d53-1fee-4e56-9e48-1baf4a645ebf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:58.522578 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5f6b5d53-1fee-4e56-9e48-1baf4a645ebf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:52:58.526628 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1230/2446] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:52:57 2022] DELETE /identity/v3/projects/3225bbb40b494be3b57e2912f0fb37f8 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:52:58.533510 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca0413-ace0-4820-966f-0ed121d21147 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:58.534535 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca0413-ace0-4820-966f-0ed121d21147 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:58.535572 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca0413-ace0-4820-966f-0ed121d21147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:58.568207 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-5fca0413-ace0-4820-966f-0ed121d21147 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:52:58.569790 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5fca0413-ace0-4820-966f-0ed121d21147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:58.770646 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1217/2447] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:52:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:52:58.780409 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862464dc-dab4-4b0e-8398-01bd7d9a6589 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:58.780702 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862464dc-dab4-4b0e-8398-01bd7d9a6589 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:58.781168 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862464dc-dab4-4b0e-8398-01bd7d9a6589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:58.814740 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-862464dc-dab4-4b0e-8398-01bd7d9a6589 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:52:58.816061 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-862464dc-dab4-4b0e-8398-01bd7d9a6589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:58.831554 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1231/2448] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:52:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:52:58.834558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca0413-ace0-4820-966f-0ed121d21147 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:58.852364 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca0413-ace0-4820-966f-0ed121d21147 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:58.859002 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e347ec7-0c85-45a1-bb43-9dadd6ffe44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:58.859873 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e347ec7-0c85-45a1-bb43-9dadd6ffe44d admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:58.865697 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e347ec7-0c85-45a1-bb43-9dadd6ffe44d admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:58.865697 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e347ec7-0c85-45a1-bb43-9dadd6ffe44d admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:58.865697 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e347ec7-0c85-45a1-bb43-9dadd6ffe44d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:52:58.865697 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e347ec7-0c85-45a1-bb43-9dadd6ffe44d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:58.865697 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e347ec7-0c85-45a1-bb43-9dadd6ffe44d admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:58.881463 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1218/2449] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:52:58.885934 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862464dc-dab4-4b0e-8398-01bd7d9a6589 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:58.899067 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862464dc-dab4-4b0e-8398-01bd7d9a6589 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:58.910476 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff603f98-398d-4498-811b-04b4e3a13ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:58.911138 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff603f98-398d-4498-811b-04b4e3a13ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:58.911432 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff603f98-398d-4498-811b-04b4e3a13ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:58.911955 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff603f98-398d-4498-811b-04b4e3a13ab0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:58.912591 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff603f98-398d-4498-811b-04b4e3a13ab0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:58.919393 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff603f98-398d-4498-811b-04b4e3a13ab0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:59.018087 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1232/2450] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:52:58 2022] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:52:59.023575 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e347ec7-0c85-45a1-bb43-9dadd6ffe44d admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:59.035155 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e347ec7-0c85-45a1-bb43-9dadd6ffe44d admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:59.116943 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146169d-9f79-4496-8d64-bf00ae542cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:59.118958 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146169d-9f79-4496-8d64-bf00ae542cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:59.119560 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146169d-9f79-4496-8d64-bf00ae542cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:59.120174 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146169d-9f79-4496-8d64-bf00ae542cc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:59.121002 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146169d-9f79-4496-8d64-bf00ae542cc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:59.123291 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146169d-9f79-4496-8d64-bf00ae542cc5 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:59.240627 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1219/2451] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:52:59 2022] POST /identity/v3/users => generated 290 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:52:59.245760 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff603f98-398d-4498-811b-04b4e3a13ab0 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:59.257978 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff603f98-398d-4498-811b-04b4e3a13ab0 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:59.265714 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124657a3-33b7-45e5-ba8e-7d4ba8052f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:59.267686 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124657a3-33b7-45e5-ba8e-7d4ba8052f4f admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:59.267686 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124657a3-33b7-45e5-ba8e-7d4ba8052f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:59.267686 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124657a3-33b7-45e5-ba8e-7d4ba8052f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:59.267987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124657a3-33b7-45e5-ba8e-7d4ba8052f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:59.269675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124657a3-33b7-45e5-ba8e-7d4ba8052f4f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:59.285255 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1233/2452] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:52:59.289426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146169d-9f79-4496-8d64-bf00ae542cc5 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:59.297087 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:52:59.307191 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146169d-9f79-4496-8d64-bf00ae542cc5 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:59.315950 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c6baa-9ce5-4cf9-8880-1ef3a5d8ab36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:59.316590 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c6baa-9ce5-4cf9-8880-1ef3a5d8ab36 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:59.316904 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c6baa-9ce5-4cf9-8880-1ef3a5d8ab36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:59.317162 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c6baa-9ce5-4cf9-8880-1ef3a5d8ab36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:59.317846 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c6baa-9ce5-4cf9-8880-1ef3a5d8ab36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:59.319677 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c6baa-9ce5-4cf9-8880-1ef3a5d8ab36 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:59.332264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1220/2453] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:52:59.337798 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124657a3-33b7-45e5-ba8e-7d4ba8052f4f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:59.350342 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124657a3-33b7-45e5-ba8e-7d4ba8052f4f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:59.356348 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb38c4-83a8-496e-9bca-e18dd0d63bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:59.357134 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb38c4-83a8-496e-9bca-e18dd0d63bab admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:59.357490 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb38c4-83a8-496e-9bca-e18dd0d63bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:59.357840 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb38c4-83a8-496e-9bca-e18dd0d63bab admin admin] PATH_INFO: `/v3/projects/181b6b66b4404ab2a0279d4d524a2c3a/users/b026ccf37828480f9ffd3b40529fe8ea/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:59.387028 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb38c4-83a8-496e-9bca-e18dd0d63bab admin admin] RBAC: Authorizing `identity:create_grant(project_id=181b6b66b4404ab2a0279d4d524a2c3a, user_id=b026ccf37828480f9ffd3b40529fe8ea, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:59.390224 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb38c4-83a8-496e-9bca-e18dd0d63bab admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:59.483572 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1234/2454] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:52:59 2022] PUT /identity/v3/projects/181b6b66b4404ab2a0279d4d524a2c3a/users/b026ccf37828480f9ffd3b40529fe8ea/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:52:59.495655 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61861a0-1504-4814-a8f4-40d57c9d9e0b None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:59.495933 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61861a0-1504-4814-a8f4-40d57c9d9e0b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:59.496208 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61861a0-1504-4814-a8f4-40d57c9d9e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:59.529336 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-d61861a0-1504-4814-a8f4-40d57c9d9e0b None None] MFA Rules not processed for user `b026ccf37828480f9ffd3b40529fe8ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:52:59.530582 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d61861a0-1504-4814-a8f4-40d57c9d9e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:52:59.634347 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1221/2455] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:52:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:52:59.639101 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb38c4-83a8-496e-9bca-e18dd0d63bab admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:59.718588 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb38c4-83a8-496e-9bca-e18dd0d63bab admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:59.725472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebfeae-274d-4650-9884-89d6dd6110b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:52:59.726316 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebfeae-274d-4650-9884-89d6dd6110b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:52:59.726646 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebfeae-274d-4650-9884-89d6dd6110b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:52:59.726992 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebfeae-274d-4650-9884-89d6dd6110b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:52:59.728387 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ebfeae-274d-4650-9884-89d6dd6110b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:52:59.731573 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ebfeae-274d-4650-9884-89d6dd6110b7 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:52:59.837721 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1235/2456] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:52:59 2022] POST /identity/v3/projects => generated 377 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:52:59.844837 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61861a0-1504-4814-a8f4-40d57c9d9e0b None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:52:59.862061 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61861a0-1504-4814-a8f4-40d57c9d9e0b None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:52:59.999103 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15def3e4-c94f-4ce1-9277-46b73068c4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:00.000345 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15def3e4-c94f-4ce1-9277-46b73068c4a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:00.000856 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15def3e4-c94f-4ce1-9277-46b73068c4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:00.001497 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15def3e4-c94f-4ce1-9277-46b73068c4a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:00.002701 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15def3e4-c94f-4ce1-9277-46b73068c4a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:00.008261 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15def3e4-c94f-4ce1-9277-46b73068c4a5 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:00.104184 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1222/2457] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:52:59 2022] POST /identity/v3/users => generated 289 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:53:00.111269 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebfeae-274d-4650-9884-89d6dd6110b7 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:00.128158 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebfeae-274d-4650-9884-89d6dd6110b7 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:00.135047 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa52330-bd48-4f95-8d8e-0bd7b19aefc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:00.135893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa52330-bd48-4f95-8d8e-0bd7b19aefc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:00.136731 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa52330-bd48-4f95-8d8e-0bd7b19aefc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:00.137201 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa52330-bd48-4f95-8d8e-0bd7b19aefc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:00.137912 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa52330-bd48-4f95-8d8e-0bd7b19aefc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:00.140000 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa52330-bd48-4f95-8d8e-0bd7b19aefc8 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:00.154632 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1236/2458] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:53:00.159010 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15def3e4-c94f-4ce1-9277-46b73068c4a5 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:00.173703 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15def3e4-c94f-4ce1-9277-46b73068c4a5 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:00.179516 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66940211-f2d4-4ef3-bcd5-19b1aa116938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:00.180149 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66940211-f2d4-4ef3-bcd5-19b1aa116938 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:00.181174 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66940211-f2d4-4ef3-bcd5-19b1aa116938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:00.181491 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66940211-f2d4-4ef3-bcd5-19b1aa116938 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:00.182206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66940211-f2d4-4ef3-bcd5-19b1aa116938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:00.183895 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66940211-f2d4-4ef3-bcd5-19b1aa116938 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:00.195742 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1223/2459] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:53:00.202046 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa52330-bd48-4f95-8d8e-0bd7b19aefc8 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:00.215016 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa52330-bd48-4f95-8d8e-0bd7b19aefc8 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:00.222876 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e813a1-acf2-433b-a11d-c4f5e9bd5f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:00.223754 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e813a1-acf2-433b-a11d-c4f5e9bd5f3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:00.224093 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e813a1-acf2-433b-a11d-c4f5e9bd5f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:00.224391 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e813a1-acf2-433b-a11d-c4f5e9bd5f3a admin admin] PATH_INFO: `/v3/projects/3e9bbabbe7534ab2b711808468cb7533/users/51cebd22ebff42c69423ae9bc0e26c09/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:00.239766 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:53:00.250961 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e813a1-acf2-433b-a11d-c4f5e9bd5f3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e9bbabbe7534ab2b711808468cb7533, user_id=51cebd22ebff42c69423ae9bc0e26c09, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:00.255054 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e813a1-acf2-433b-a11d-c4f5e9bd5f3a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:00.380560 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1237/2460] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:53:00 2022] PUT /identity/v3/projects/3e9bbabbe7534ab2b711808468cb7533/users/51cebd22ebff42c69423ae9bc0e26c09/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:53:00.392343 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28ecbd-9a6a-4e95-9ffc-3b406cd1440a None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:00.392657 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28ecbd-9a6a-4e95-9ffc-3b406cd1440a None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:00.392923 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28ecbd-9a6a-4e95-9ffc-3b406cd1440a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:00.435619 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-3c28ecbd-9a6a-4e95-9ffc-3b406cd1440a None None] MFA Rules not processed for user `51cebd22ebff42c69423ae9bc0e26c09`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:53:00.437391 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3c28ecbd-9a6a-4e95-9ffc-3b406cd1440a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:53:00.515995 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:53:00.551300 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1224/2461] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:53:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:53:00.561656 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e813a1-acf2-433b-a11d-c4f5e9bd5f3a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:00.652669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e813a1-acf2-433b-a11d-c4f5e9bd5f3a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:00.659476 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de8560-921f-4a7b-a672-254079e32d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:00.660174 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de8560-921f-4a7b-a672-254079e32d74 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:00.660456 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de8560-921f-4a7b-a672-254079e32d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:00.660730 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de8560-921f-4a7b-a672-254079e32d74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:00.661707 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de8560-921f-4a7b-a672-254079e32d74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:00.663807 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de8560-921f-4a7b-a672-254079e32d74 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:00.697820 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28ecbd-9a6a-4e95-9ffc-3b406cd1440a None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:00.699459 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3c28ecbd-9a6a-4e95-9ffc-3b406cd1440a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:53:00.848687 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28ecbd-9a6a-4e95-9ffc-3b406cd1440a None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:00.856192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c04c67-840e-46c4-a975-491c884461fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:00.856862 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c04c67-840e-46c4-a975-491c884461fb service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:00.857171 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c04c67-840e-46c4-a975-491c884461fb service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:00.857414 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c04c67-840e-46c4-a975-491c884461fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:00.859573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-42c04c67-840e-46c4-a975-491c884461fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:53:00.878538 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c04c67-840e-46c4-a975-491c884461fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:00.878538 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c04c67-840e-46c4-a975-491c884461fb service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:00.890954 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1225/2462] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:53:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:53:00.928818 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c04c67-840e-46c4-a975-491c884461fb service nova] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:00.936086 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1238/2463] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:53:00 2022] POST /identity/v3/projects => generated 371 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:53:00.951509 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c04c67-840e-46c4-a975-491c884461fb service nova] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:01.035035 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b9c89-23be-4f37-945f-77e26678f12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:01.035802 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b9c89-23be-4f37-945f-77e26678f12f admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:01.036089 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b9c89-23be-4f37-945f-77e26678f12f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:01.036362 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b9c89-23be-4f37-945f-77e26678f12f admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:01.037017 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b9c89-23be-4f37-945f-77e26678f12f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:01.039375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b9c89-23be-4f37-945f-77e26678f12f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:01.178769 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de8560-921f-4a7b-a672-254079e32d74 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:01.183420 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1226/2464] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:53:00 2022] POST /identity/v3/users => generated 292 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:53:01.189883 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de8560-921f-4a7b-a672-254079e32d74 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:01.195114 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1493bc-b8b6-4b70-96e7-5e8a92c7cd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:01.195666 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1493bc-b8b6-4b70-96e7-5e8a92c7cd8e admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:01.195988 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1493bc-b8b6-4b70-96e7-5e8a92c7cd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:01.196430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1493bc-b8b6-4b70-96e7-5e8a92c7cd8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:01.197106 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1493bc-b8b6-4b70-96e7-5e8a92c7cd8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:01.198754 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1493bc-b8b6-4b70-96e7-5e8a92c7cd8e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:01.218669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1239/2465] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:53:01.224486 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b9c89-23be-4f37-945f-77e26678f12f admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:01.239571 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b9c89-23be-4f37-945f-77e26678f12f admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:01.265466 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13b7db-3afb-4eca-91f6-0116fba3a04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:01.266871 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13b7db-3afb-4eca-91f6-0116fba3a04e admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:01.267180 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13b7db-3afb-4eca-91f6-0116fba3a04e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:01.267547 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13b7db-3afb-4eca-91f6-0116fba3a04e admin admin] PATH_INFO: `/v3/projects/70c41b1ed0a6405db9cec4cfc13fed35/users/56dd787f517343eb9ca6682da5ce1ab4/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:01.288746 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13b7db-3afb-4eca-91f6-0116fba3a04e admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c41b1ed0a6405db9cec4cfc13fed35, user_id=56dd787f517343eb9ca6682da5ce1ab4, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:01.292370 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13b7db-3afb-4eca-91f6-0116fba3a04e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:01.371837 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1227/2466] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:53:01 2022] PUT /identity/v3/projects/70c41b1ed0a6405db9cec4cfc13fed35/users/56dd787f517343eb9ca6682da5ce1ab4/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:53:01.377555 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1493bc-b8b6-4b70-96e7-5e8a92c7cd8e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:01.390255 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1493bc-b8b6-4b70-96e7-5e8a92c7cd8e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:01.468859 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00964a-d9e3-4ba2-9566-624ecd0a570b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:01.469650 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00964a-d9e3-4ba2-9566-624ecd0a570b admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:01.470342 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00964a-d9e3-4ba2-9566-624ecd0a570b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:01.470342 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00964a-d9e3-4ba2-9566-624ecd0a570b admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:01.471163 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00964a-d9e3-4ba2-9566-624ecd0a570b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:01.472933 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00964a-d9e3-4ba2-9566-624ecd0a570b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:01.492165 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1240/2467] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:53:01.498867 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13b7db-3afb-4eca-91f6-0116fba3a04e admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:01.511713 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13b7db-3afb-4eca-91f6-0116fba3a04e admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:01.517420 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dff244-7daf-4541-a0d8-16e096ba2237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:01.518109 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dff244-7daf-4541-a0d8-16e096ba2237 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:01.518396 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dff244-7daf-4541-a0d8-16e096ba2237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:01.518676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dff244-7daf-4541-a0d8-16e096ba2237 admin admin] PATH_INFO: `/v3/projects/70c41b1ed0a6405db9cec4cfc13fed35/users/56dd787f517343eb9ca6682da5ce1ab4/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:01.520722 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dff244-7daf-4541-a0d8-16e096ba2237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c41b1ed0a6405db9cec4cfc13fed35, user_id=56dd787f517343eb9ca6682da5ce1ab4, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:01.523561 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dff244-7daf-4541-a0d8-16e096ba2237 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:01.535953 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1228/2468] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:53:01 2022] PUT /identity/v3/projects/70c41b1ed0a6405db9cec4cfc13fed35/users/56dd787f517343eb9ca6682da5ce1ab4/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:53:01.555602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec5eed-deaa-4d75-934d-bf90060b7c71 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:01.556146 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec5eed-deaa-4d75-934d-bf90060b7c71 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:01.556646 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec5eed-deaa-4d75-934d-bf90060b7c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:01.593262 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-5bec5eed-deaa-4d75-934d-bf90060b7c71 None None] MFA Rules not processed for user `56dd787f517343eb9ca6682da5ce1ab4`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:53:01.604868 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5bec5eed-deaa-4d75-934d-bf90060b7c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:53:01.659726 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:53:01.702418 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1241/2469] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:53:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:53:01.728414 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dff244-7daf-4541-a0d8-16e096ba2237 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:01.730950 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f5dff244-7daf-4541-a0d8-16e096ba2237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:53:01.777081 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:53:01.818167 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dff244-7daf-4541-a0d8-16e096ba2237 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:01.824062 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42572cda-fedc-4fbf-9f42-13073901b5e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:01.825035 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42572cda-fedc-4fbf-9f42-13073901b5e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:01.825892 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42572cda-fedc-4fbf-9f42-13073901b5e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:01.826221 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42572cda-fedc-4fbf-9f42-13073901b5e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:01.841178 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42572cda-fedc-4fbf-9f42-13073901b5e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:01.843090 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42572cda-fedc-4fbf-9f42-13073901b5e1 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:01.854542 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1229/2470] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:53:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:53:02.009327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec5eed-deaa-4d75-934d-bf90060b7c71 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:02.010959 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5bec5eed-deaa-4d75-934d-bf90060b7c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:53:02.031769 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec5eed-deaa-4d75-934d-bf90060b7c71 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:02.037832 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f531b-1132-40b2-ba19-7c2c72239b9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:02.038640 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f531b-1132-40b2-ba19-7c2c72239b9c service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:02.039181 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f531b-1132-40b2-ba19-7c2c72239b9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:02.040325 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f531b-1132-40b2-ba19-7c2c72239b9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:02.169558 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f531b-1132-40b2-ba19-7c2c72239b9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:02.172458 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f531b-1132-40b2-ba19-7c2c72239b9c service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:02.192691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1242/2471] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:53:02 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:53:06.484277 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42572cda-fedc-4fbf-9f42-13073901b5e1 service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:06.559690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42572cda-fedc-4fbf-9f42-13073901b5e1 service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:06.564817 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d00b9a-2626-4455-b973-9fb12ee98f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:06.567638 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d00b9a-2626-4455-b973-9fb12ee98f53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:06.567638 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d00b9a-2626-4455-b973-9fb12ee98f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:06.567638 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d00b9a-2626-4455-b973-9fb12ee98f53 admin admin] PATH_INFO: `/v3/users/b026ccf37828480f9ffd3b40529fe8ea` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:06.567638 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d00b9a-2626-4455-b973-9fb12ee98f53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b026ccf37828480f9ffd3b40529fe8ea)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:06.569280 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d00b9a-2626-4455-b973-9fb12ee98f53 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:06.771407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-71d00b9a-2626-4455-b973-9fb12ee98f53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b026ccf37828480f9ffd3b40529fe8ea'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:53:06.772081 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-71d00b9a-2626-4455-b973-9fb12ee98f53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b026ccf37828480f9ffd3b40529fe8ea'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:53:06.779281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-71d00b9a-2626-4455-b973-9fb12ee98f53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b026ccf37828480f9ffd3b40529fe8ea'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:53:06.779947 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-71d00b9a-2626-4455-b973-9fb12ee98f53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b026ccf37828480f9ffd3b40529fe8ea'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:53:06.846212 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-71d00b9a-2626-4455-b973-9fb12ee98f53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b026ccf37828480f9ffd3b40529fe8ea'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:53:06.868864 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1230/2472] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:53:06 2022] DELETE /identity/v3/users/b026ccf37828480f9ffd3b40529fe8ea => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:53:06.873326 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e78c4-a3f8-4560-8d2e-29670531ba87 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:06.873834 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e78c4-a3f8-4560-8d2e-29670531ba87 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:06.873949 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e78c4-a3f8-4560-8d2e-29670531ba87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:06.893410 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-ae3e78c4-a3f8-4560-8d2e-29670531ba87 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:53:06.894599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ae3e78c4-a3f8-4560-8d2e-29670531ba87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:53:06.963321 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1243/2473] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:53:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:53:06.980269 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d00b9a-2626-4455-b973-9fb12ee98f53 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:06.981900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-71d00b9a-2626-4455-b973-9fb12ee98f53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:53:07.043913 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:53:07.048437 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d00b9a-2626-4455-b973-9fb12ee98f53 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:07.052233 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73628633-7785-46c5-9e39-8a43cd75615f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:07.053089 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73628633-7785-46c5-9e39-8a43cd75615f service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:07.053377 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73628633-7785-46c5-9e39-8a43cd75615f service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:07.053657 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73628633-7785-46c5-9e39-8a43cd75615f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:07.065183 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73628633-7785-46c5-9e39-8a43cd75615f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:07.066637 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73628633-7785-46c5-9e39-8a43cd75615f service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:07.077175 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1231/2474] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:53:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:53:08.209605 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e78c4-a3f8-4560-8d2e-29670531ba87 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:08.210861 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ae3e78c4-a3f8-4560-8d2e-29670531ba87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:53:08.226690 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e78c4-a3f8-4560-8d2e-29670531ba87 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:08.241978 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e562f33-a5d1-4221-b146-424a45bf6e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:08.243702 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e562f33-a5d1-4221-b146-424a45bf6e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:08.244184 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e562f33-a5d1-4221-b146-424a45bf6e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:08.245002 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e562f33-a5d1-4221-b146-424a45bf6e53 admin admin] PATH_INFO: `/v3/projects/181b6b66b4404ab2a0279d4d524a2c3a` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:08.247092 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e562f33-a5d1-4221-b146-424a45bf6e53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=181b6b66b4404ab2a0279d4d524a2c3a)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:08.250935 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e562f33-a5d1-4221-b146-424a45bf6e53 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:08.408909 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0e562f33-a5d1-4221-b146-424a45bf6e53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '181b6b66b4404ab2a0279d4d524a2c3a', 'request_id': 'req-0e562f33-a5d1-4221-b146-424a45bf6e53'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:53:08.416823 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0e562f33-a5d1-4221-b146-424a45bf6e53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '181b6b66b4404ab2a0279d4d524a2c3a', 'request_id': 'req-0e562f33-a5d1-4221-b146-424a45bf6e53'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:53:08.480936 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0e562f33-a5d1-4221-b146-424a45bf6e53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '181b6b66b4404ab2a0279d4d524a2c3a', 'request_id': 'req-0e562f33-a5d1-4221-b146-424a45bf6e53'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:53:08.513209 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0e562f33-a5d1-4221-b146-424a45bf6e53 admin admin] The token cache is being invalidate because project 181b6b66b4404ab2a0279d4d524a2c3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:53:08.513651 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0e562f33-a5d1-4221-b146-424a45bf6e53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:53:08.514347 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0e562f33-a5d1-4221-b146-424a45bf6e53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:53:08.516000 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1244/2475] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:53:08 2022] DELETE /identity/v3/projects/181b6b66b4404ab2a0279d4d524a2c3a => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:53:08.520159 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73628633-7785-46c5-9e39-8a43cd75615f service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:08.532564 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73628633-7785-46c5-9e39-8a43cd75615f service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:08.604880 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7f661-52bf-43be-9dff-276a065020bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:08.605678 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7f661-52bf-43be-9dff-276a065020bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:08.606035 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7f661-52bf-43be-9dff-276a065020bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:08.606390 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7f661-52bf-43be-9dff-276a065020bf admin admin] PATH_INFO: `/v3/users/51cebd22ebff42c69423ae9bc0e26c09` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:08.607757 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7f661-52bf-43be-9dff-276a065020bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=51cebd22ebff42c69423ae9bc0e26c09)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:08.614882 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7f661-52bf-43be-9dff-276a065020bf admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:08.938721 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-45a7f661-52bf-43be-9dff-276a065020bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51cebd22ebff42c69423ae9bc0e26c09'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:53:08.939453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-45a7f661-52bf-43be-9dff-276a065020bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51cebd22ebff42c69423ae9bc0e26c09'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:53:08.948279 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-45a7f661-52bf-43be-9dff-276a065020bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51cebd22ebff42c69423ae9bc0e26c09'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:53:08.949038 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-45a7f661-52bf-43be-9dff-276a065020bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51cebd22ebff42c69423ae9bc0e26c09'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:53:09.035034 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-45a7f661-52bf-43be-9dff-276a065020bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51cebd22ebff42c69423ae9bc0e26c09'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:53:09.062647 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1232/2476] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:53:08 2022] DELETE /identity/v3/users/51cebd22ebff42c69423ae9bc0e26c09 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:53:09.565690 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e562f33-a5d1-4221-b146-424a45bf6e53 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:09.567276 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0e562f33-a5d1-4221-b146-424a45bf6e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:53:09.582165 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e562f33-a5d1-4221-b146-424a45bf6e53 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:09.586077 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:53:09.643141 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a25a7-cf02-4770-8171-3a6868cc403c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:09.643833 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a25a7-cf02-4770-8171-3a6868cc403c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:09.644110 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a25a7-cf02-4770-8171-3a6868cc403c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:09.644415 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a25a7-cf02-4770-8171-3a6868cc403c admin admin] PATH_INFO: `/v3/projects/3e9bbabbe7534ab2b711808468cb7533` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:09.645578 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a25a7-cf02-4770-8171-3a6868cc403c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e9bbabbe7534ab2b711808468cb7533)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:09.647735 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a25a7-cf02-4770-8171-3a6868cc403c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:09.794558 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ce9a25a7-cf02-4770-8171-3a6868cc403c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e9bbabbe7534ab2b711808468cb7533', 'request_id': 'req-ce9a25a7-cf02-4770-8171-3a6868cc403c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:53:09.801004 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ce9a25a7-cf02-4770-8171-3a6868cc403c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e9bbabbe7534ab2b711808468cb7533', 'request_id': 'req-ce9a25a7-cf02-4770-8171-3a6868cc403c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:53:09.892756 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ce9a25a7-cf02-4770-8171-3a6868cc403c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e9bbabbe7534ab2b711808468cb7533', 'request_id': 'req-ce9a25a7-cf02-4770-8171-3a6868cc403c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:53:09.906247 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ce9a25a7-cf02-4770-8171-3a6868cc403c admin admin] The token cache is being invalidate because project 3e9bbabbe7534ab2b711808468cb7533 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:53:09.906554 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ce9a25a7-cf02-4770-8171-3a6868cc403c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:53:09.907237 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ce9a25a7-cf02-4770-8171-3a6868cc403c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:53:09.909086 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1245/2477] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:53:09 2022] DELETE /identity/v3/projects/3e9bbabbe7534ab2b711808468cb7533 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:53:09.913151 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7f661-52bf-43be-9dff-276a065020bf admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:09.915668 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-45a7f661-52bf-43be-9dff-276a065020bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:53:09.940077 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7f661-52bf-43be-9dff-276a065020bf admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:10.012549 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40006a41-d6a0-4f59-9bfa-fb3548d1a18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:10.013652 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40006a41-d6a0-4f59-9bfa-fb3548d1a18d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:10.014253 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40006a41-d6a0-4f59-9bfa-fb3548d1a18d admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:10.014724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40006a41-d6a0-4f59-9bfa-fb3548d1a18d admin admin] PATH_INFO: `/v3/users/56dd787f517343eb9ca6682da5ce1ab4` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:10.019481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40006a41-d6a0-4f59-9bfa-fb3548d1a18d admin admin] RBAC: Authorizing `identity:delete_user(user_id=56dd787f517343eb9ca6682da5ce1ab4)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:10.020718 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40006a41-d6a0-4f59-9bfa-fb3548d1a18d admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:10.042425 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:53:10.261246 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-40006a41-d6a0-4f59-9bfa-fb3548d1a18d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56dd787f517343eb9ca6682da5ce1ab4'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:53:10.262046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-40006a41-d6a0-4f59-9bfa-fb3548d1a18d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56dd787f517343eb9ca6682da5ce1ab4'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:53:10.270164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-40006a41-d6a0-4f59-9bfa-fb3548d1a18d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56dd787f517343eb9ca6682da5ce1ab4'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:53:10.270900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-40006a41-d6a0-4f59-9bfa-fb3548d1a18d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56dd787f517343eb9ca6682da5ce1ab4'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:53:10.387675 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-40006a41-d6a0-4f59-9bfa-fb3548d1a18d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56dd787f517343eb9ca6682da5ce1ab4'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:53:10.409551 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1233/2478] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:53:09 2022] DELETE /identity/v3/users/56dd787f517343eb9ca6682da5ce1ab4 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:53:10.714455 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48c950-bf03-47b7-a368-098223841cbe None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:10.714966 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48c950-bf03-47b7-a368-098223841cbe None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:10.719158 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48c950-bf03-47b7-a368-098223841cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:10.737806 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-7c48c950-bf03-47b7-a368-098223841cbe None None] MFA Rules not processed for user `84fcccb19a5e43ac9da5d7ca501563e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:53:10.739059 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7c48c950-bf03-47b7-a368-098223841cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:53:10.802478 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1246/2479] 10.222.0.26 () {58 vars in 967 bytes} [Sun Sep 11 08:53:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:53:10.815479 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40006a41-d6a0-4f59-9bfa-fb3548d1a18d admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:10.817023 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-40006a41-d6a0-4f59-9bfa-fb3548d1a18d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:53:10.905016 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48c950-bf03-47b7-a368-098223841cbe None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:10.905016 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7c48c950-bf03-47b7-a368-098223841cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:53:10.905210 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40006a41-d6a0-4f59-9bfa-fb3548d1a18d admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:10.905210 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af763280-249d-468a-9838-b82c71af0806 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a4f25df9724d34afdd6a41e719546a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:10.905210 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af763280-249d-468a-9838-b82c71af0806 service swift] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:10.905210 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af763280-249d-468a-9838-b82c71af0806 service swift] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:10.906807 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af763280-249d-468a-9838-b82c71af0806 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:10.913478 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af763280-249d-468a-9838-b82c71af0806 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:10.915789 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af763280-249d-468a-9838-b82c71af0806 service swift] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:10.928119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1234/2480] 10.222.0.26 () {60 vars in 1384 bytes} [Sun Sep 11 08:53:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 08:53:10.966946 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:53:10.990602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48c950-bf03-47b7-a368-098223841cbe None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:10.995654 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f90933-5ad0-4603-881d-740bd291246d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:10.996326 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f90933-5ad0-4603-881d-740bd291246d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:10.996584 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f90933-5ad0-4603-881d-740bd291246d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:10.996901 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f90933-5ad0-4603-881d-740bd291246d admin admin] PATH_INFO: `/v3/projects/70c41b1ed0a6405db9cec4cfc13fed35` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:10.998176 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f90933-5ad0-4603-881d-740bd291246d admin admin] RBAC: Authorizing `identity:delete_project(project_id=70c41b1ed0a6405db9cec4cfc13fed35)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:11.000060 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f90933-5ad0-4603-881d-740bd291246d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:11.108251 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-34f90933-5ad0-4603-881d-740bd291246d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70c41b1ed0a6405db9cec4cfc13fed35', 'request_id': 'req-34f90933-5ad0-4603-881d-740bd291246d'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:53:11.114356 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-34f90933-5ad0-4603-881d-740bd291246d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70c41b1ed0a6405db9cec4cfc13fed35', 'request_id': 'req-34f90933-5ad0-4603-881d-740bd291246d'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:53:11.204553 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-34f90933-5ad0-4603-881d-740bd291246d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70c41b1ed0a6405db9cec4cfc13fed35', 'request_id': 'req-34f90933-5ad0-4603-881d-740bd291246d'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:53:11.217886 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-34f90933-5ad0-4603-881d-740bd291246d admin admin] The token cache is being invalidate because project 70c41b1ed0a6405db9cec4cfc13fed35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:53:11.218180 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-34f90933-5ad0-4603-881d-740bd291246d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:53:11.218851 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-34f90933-5ad0-4603-881d-740bd291246d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:53:11.220416 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1247/2481] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:53:10 2022] DELETE /identity/v3/projects/70c41b1ed0a6405db9cec4cfc13fed35 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:53:11.226414 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae4199-07d9-4e14-9e6a-39dcd04eafb5 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:11.226706 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae4199-07d9-4e14-9e6a-39dcd04eafb5 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:11.226981 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae4199-07d9-4e14-9e6a-39dcd04eafb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:11.247154 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-9dae4199-07d9-4e14-9e6a-39dcd04eafb5 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:53:11.248455 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9dae4199-07d9-4e14-9e6a-39dcd04eafb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:53:11.315163 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1235/2482] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:53:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:53:11.324387 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd6d38-e292-4389-998a-03c3991477dd None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:11.324987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd6d38-e292-4389-998a-03c3991477dd None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:11.327530 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd6d38-e292-4389-998a-03c3991477dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:11.347296 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e0bd6d38-e292-4389-998a-03c3991477dd None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:53:11.350437 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e0bd6d38-e292-4389-998a-03c3991477dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:53:11.356717 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1248/2483] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:53:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:53:11.361358 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae4199-07d9-4e14-9e6a-39dcd04eafb5 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:11.372468 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae4199-07d9-4e14-9e6a-39dcd04eafb5 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:11.378698 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f02f5-0f8d-48e5-8e27-972d1f244cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:11.379612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f02f5-0f8d-48e5-8e27-972d1f244cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:11.379898 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f02f5-0f8d-48e5-8e27-972d1f244cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:11.380254 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f02f5-0f8d-48e5-8e27-972d1f244cc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:11.380825 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f02f5-0f8d-48e5-8e27-972d1f244cc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:53:11.381134 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f02f5-0f8d-48e5-8e27-972d1f244cc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:11.382859 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f02f5-0f8d-48e5-8e27-972d1f244cc5 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:11.396024 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1236/2484] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:53:11.400734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd6d38-e292-4389-998a-03c3991477dd None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:11.410178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd6d38-e292-4389-998a-03c3991477dd None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:11.414869 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1dcfea-f365-454a-8b4c-5b27c128cef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:11.415518 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dcfea-f365-454a-8b4c-5b27c128cef4 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:11.419232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dcfea-f365-454a-8b4c-5b27c128cef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:11.419232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dcfea-f365-454a-8b4c-5b27c128cef4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:11.419232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1dcfea-f365-454a-8b4c-5b27c128cef4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:11.419232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1dcfea-f365-454a-8b4c-5b27c128cef4 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:11.534106 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1249/2485] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:53:11 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:53:11.538390 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f02f5-0f8d-48e5-8e27-972d1f244cc5 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:11.548810 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f02f5-0f8d-48e5-8e27-972d1f244cc5 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:11.552770 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:53:11.630822 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279429e6-169a-4988-8645-451aa689556b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:11.631637 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279429e6-169a-4988-8645-451aa689556b admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:11.632514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279429e6-169a-4988-8645-451aa689556b admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:11.633020 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279429e6-169a-4988-8645-451aa689556b admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:11.634209 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279429e6-169a-4988-8645-451aa689556b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:11.636739 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279429e6-169a-4988-8645-451aa689556b admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:11.756020 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1237/2486] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:53:11 2022] POST /identity/v3/users => generated 286 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:53:11.760272 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1dcfea-f365-454a-8b4c-5b27c128cef4 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:11.770805 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1dcfea-f365-454a-8b4c-5b27c128cef4 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:11.775694 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d32f6-0a97-4f69-bf5c-162d465c894f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:11.776352 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d32f6-0a97-4f69-bf5c-162d465c894f admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:11.776612 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d32f6-0a97-4f69-bf5c-162d465c894f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:11.776889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d32f6-0a97-4f69-bf5c-162d465c894f admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:11.777681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d32f6-0a97-4f69-bf5c-162d465c894f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:11.779315 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d32f6-0a97-4f69-bf5c-162d465c894f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:11.790368 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1250/2487] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:53:11.794754 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279429e6-169a-4988-8645-451aa689556b admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:11.805937 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279429e6-169a-4988-8645-451aa689556b admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:11.810743 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1551b-4076-40c8-a937-83f5e01ea495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:11.811382 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1551b-4076-40c8-a937-83f5e01ea495 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:11.811666 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1551b-4076-40c8-a937-83f5e01ea495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:11.811943 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1551b-4076-40c8-a937-83f5e01ea495 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:11.812581 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1551b-4076-40c8-a937-83f5e01ea495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:11.814294 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1551b-4076-40c8-a937-83f5e01ea495 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:11.825454 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1238/2488] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:53:11.832437 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d32f6-0a97-4f69-bf5c-162d465c894f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:11.843564 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d32f6-0a97-4f69-bf5c-162d465c894f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:11.848331 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d0150-22fc-4f9e-b8b3-687ee03366c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:11.848984 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d0150-22fc-4f9e-b8b3-687ee03366c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:11.849269 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d0150-22fc-4f9e-b8b3-687ee03366c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:11.849521 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d0150-22fc-4f9e-b8b3-687ee03366c9 admin admin] PATH_INFO: `/v3/projects/059ea7e64b5048e9935d72f48338129e/users/ed58d569c3e74761bb2295ee04deb8b4/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:11.866711 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d0150-22fc-4f9e-b8b3-687ee03366c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=059ea7e64b5048e9935d72f48338129e, user_id=ed58d569c3e74761bb2295ee04deb8b4, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:11.871101 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d0150-22fc-4f9e-b8b3-687ee03366c9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:11.978838 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1251/2489] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:53:11 2022] PUT /identity/v3/projects/059ea7e64b5048e9935d72f48338129e/users/ed58d569c3e74761bb2295ee04deb8b4/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:53:11.983985 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09ae75-158a-4bc1-9c43-125a789fe12f None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:11.984528 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09ae75-158a-4bc1-9c43-125a789fe12f None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:11.984528 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09ae75-158a-4bc1-9c43-125a789fe12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:12.004218 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-cc09ae75-158a-4bc1-9c43-125a789fe12f None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:53:12.005471 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-cc09ae75-158a-4bc1-9c43-125a789fe12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:53:12.065423 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1239/2490] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:53:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:53:12.075106 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d0150-22fc-4f9e-b8b3-687ee03366c9 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:12.076867 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2a4d0150-22fc-4f9e-b8b3-687ee03366c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:53:12.135601 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d0150-22fc-4f9e-b8b3-687ee03366c9 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:12.139214 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be543101-b8a2-4f25-8583-68f03657b835 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:12.139848 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be543101-b8a2-4f25-8583-68f03657b835 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:12.140131 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be543101-b8a2-4f25-8583-68f03657b835 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:12.140405 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be543101-b8a2-4f25-8583-68f03657b835 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:12.150029 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be543101-b8a2-4f25-8583-68f03657b835 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:12.151496 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be543101-b8a2-4f25-8583-68f03657b835 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:12.161407 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1252/2491] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:53:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:53:13.498811 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a44a47-6241-4bde-a8cb-ba7a47fa309e None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:13.499419 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a44a47-6241-4bde-a8cb-ba7a47fa309e None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:13.499658 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a44a47-6241-4bde-a8cb-ba7a47fa309e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:13.541940 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-30a44a47-6241-4bde-a8cb-ba7a47fa309e None None] MFA Rules not processed for user `ed58d569c3e74761bb2295ee04deb8b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:53:13.543206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-30a44a47-6241-4bde-a8cb-ba7a47fa309e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:53:13.619947 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:53:13.635083 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1240/2492] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:53:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:53:13.639914 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be543101-b8a2-4f25-8583-68f03657b835 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:13.651987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:53:13.704689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be543101-b8a2-4f25-8583-68f03657b835 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:13.709803 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537251e-38b3-4c9c-8ade-5e440c65f787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:13.710421 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537251e-38b3-4c9c-8ade-5e440c65f787 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:13.710955 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537251e-38b3-4c9c-8ade-5e440c65f787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:13.710955 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537251e-38b3-4c9c-8ade-5e440c65f787 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:13.711733 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537251e-38b3-4c9c-8ade-5e440c65f787 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:13.714035 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537251e-38b3-4c9c-8ade-5e440c65f787 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:13.837282 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1253/2493] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:53:13 2022] POST /identity/v3/projects => generated 373 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:53:13.841627 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a44a47-6241-4bde-a8cb-ba7a47fa309e None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:13.853530 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a44a47-6241-4bde-a8cb-ba7a47fa309e None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:13.916900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b230f-15ba-42d8-9d0f-d35fdf8a3556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:13.917518 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b230f-15ba-42d8-9d0f-d35fdf8a3556 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:13.917794 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b230f-15ba-42d8-9d0f-d35fdf8a3556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:13.918066 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b230f-15ba-42d8-9d0f-d35fdf8a3556 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:13.918728 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b230f-15ba-42d8-9d0f-d35fdf8a3556 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:13.920688 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b230f-15ba-42d8-9d0f-d35fdf8a3556 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:14.050947 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1241/2494] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:53:13 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:53:14.051870 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537251e-38b3-4c9c-8ade-5e440c65f787 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:14.062892 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537251e-38b3-4c9c-8ade-5e440c65f787 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:14.067813 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2348024-59e2-4063-8fbf-7ef0b93eb76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:14.068453 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2348024-59e2-4063-8fbf-7ef0b93eb76f admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:14.068735 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2348024-59e2-4063-8fbf-7ef0b93eb76f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:14.069013 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2348024-59e2-4063-8fbf-7ef0b93eb76f admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:14.069692 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2348024-59e2-4063-8fbf-7ef0b93eb76f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:14.071363 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2348024-59e2-4063-8fbf-7ef0b93eb76f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:14.082137 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1254/2495] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:53:14.086383 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b230f-15ba-42d8-9d0f-d35fdf8a3556 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:14.097691 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b230f-15ba-42d8-9d0f-d35fdf8a3556 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:14.102467 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a0992-3422-4c92-b72b-c84649b325a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:14.103800 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a0992-3422-4c92-b72b-c84649b325a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:14.104085 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a0992-3422-4c92-b72b-c84649b325a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:14.104365 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a0992-3422-4c92-b72b-c84649b325a2 admin admin] PATH_INFO: `/v3/projects/e68344dfc3e546dfb50fe4b635262d31/users/0ec5178f85ba4819a760882b731673b1/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:14.120206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a0992-3422-4c92-b72b-c84649b325a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e68344dfc3e546dfb50fe4b635262d31, user_id=0ec5178f85ba4819a760882b731673b1, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:14.122901 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a0992-3422-4c92-b72b-c84649b325a2 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:14.189320 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1242/2496] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:53:14 2022] PUT /identity/v3/projects/e68344dfc3e546dfb50fe4b635262d31/users/0ec5178f85ba4819a760882b731673b1/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:53:14.193809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2348024-59e2-4063-8fbf-7ef0b93eb76f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:14.204959 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2348024-59e2-4063-8fbf-7ef0b93eb76f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:14.270017 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ce2de-e9e8-4452-92e9-3f3bf8388c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:14.270645 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ce2de-e9e8-4452-92e9-3f3bf8388c1d admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:14.270928 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ce2de-e9e8-4452-92e9-3f3bf8388c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:14.271205 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ce2de-e9e8-4452-92e9-3f3bf8388c1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:14.271914 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ce2de-e9e8-4452-92e9-3f3bf8388c1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:14.273548 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ce2de-e9e8-4452-92e9-3f3bf8388c1d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:14.285001 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1255/2497] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:53:14.290096 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a0992-3422-4c92-b72b-c84649b325a2 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:14.301800 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a0992-3422-4c92-b72b-c84649b325a2 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:14.306776 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661eb7c-710a-4da4-b32d-b512910e5d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:14.307493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661eb7c-710a-4da4-b32d-b512910e5d0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:14.307777 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661eb7c-710a-4da4-b32d-b512910e5d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:14.308052 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661eb7c-710a-4da4-b32d-b512910e5d0e admin admin] PATH_INFO: `/v3/projects/e68344dfc3e546dfb50fe4b635262d31/users/0ec5178f85ba4819a760882b731673b1/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:14.310086 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661eb7c-710a-4da4-b32d-b512910e5d0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e68344dfc3e546dfb50fe4b635262d31, user_id=0ec5178f85ba4819a760882b731673b1, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:14.312830 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661eb7c-710a-4da4-b32d-b512910e5d0e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:14.324231 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1243/2498] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:53:14 2022] PUT /identity/v3/projects/e68344dfc3e546dfb50fe4b635262d31/users/0ec5178f85ba4819a760882b731673b1/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:53:15.748779 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbde1a-d22e-4bac-9f9a-0e1fb705edb0 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:15.749314 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbde1a-d22e-4bac-9f9a-0e1fb705edb0 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:15.749314 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbde1a-d22e-4bac-9f9a-0e1fb705edb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:15.779281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-aefbde1a-d22e-4bac-9f9a-0e1fb705edb0 None None] MFA Rules not processed for user `0ec5178f85ba4819a760882b731673b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:53:15.780530 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-aefbde1a-d22e-4bac-9f9a-0e1fb705edb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:53:15.858276 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:53:15.861408 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1256/2499] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:53:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:53:15.872180 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5645a3-f5b2-4b14-a77a-7eb2f9a395dd None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:15.872698 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5645a3-f5b2-4b14-a77a-7eb2f9a395dd None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:15.872698 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5645a3-f5b2-4b14-a77a-7eb2f9a395dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:15.892486 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-9b5645a3-f5b2-4b14-a77a-7eb2f9a395dd None None] MFA Rules not processed for user `ed58d569c3e74761bb2295ee04deb8b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:53:15.893628 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9b5645a3-f5b2-4b14-a77a-7eb2f9a395dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:53:15.948214 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1244/2500] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:53:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:53:15.960436 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbde1a-d22e-4bac-9f9a-0e1fb705edb0 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:15.961850 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-aefbde1a-d22e-4bac-9f9a-0e1fb705edb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:53:16.050689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbde1a-d22e-4bac-9f9a-0e1fb705edb0 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:16.056246 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f302d-6bd4-4047-b882-ce05473a76ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:16.056879 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f302d-6bd4-4047-b882-ce05473a76ae service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:16.057158 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f302d-6bd4-4047-b882-ce05473a76ae service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:16.057431 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f302d-6bd4-4047-b882-ce05473a76ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:16.065210 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f302d-6bd4-4047-b882-ce05473a76ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:16.066813 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f302d-6bd4-4047-b882-ce05473a76ae service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:16.076249 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1257/2501] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:53:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:53:16.302765 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5645a3-f5b2-4b14-a77a-7eb2f9a395dd None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:16.353779 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:53:16.368285 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5645a3-f5b2-4b14-a77a-7eb2f9a395dd None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:16.372533 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa815f4-cca8-4c8a-b48b-a941c87eb2dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:16.373195 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa815f4-cca8-4c8a-b48b-a941c87eb2dc service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:16.373477 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa815f4-cca8-4c8a-b48b-a941c87eb2dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:16.373755 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa815f4-cca8-4c8a-b48b-a941c87eb2dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:16.375768 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4aa815f4-cca8-4c8a-b48b-a941c87eb2dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:53:16.400223 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa815f4-cca8-4c8a-b48b-a941c87eb2dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:16.402356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa815f4-cca8-4c8a-b48b-a941c87eb2dc service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:16.411077 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1245/2502] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:53:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:53:21.427375 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f302d-6bd4-4047-b882-ce05473a76ae service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:21.428815 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c44f302d-6bd4-4047-b882-ce05473a76ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:53:21.443952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f302d-6bd4-4047-b882-ce05473a76ae service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:21.449882 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382a318-caf0-4a81-b723-0a3d1693d091 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:21.450497 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382a318-caf0-4a81-b723-0a3d1693d091 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:21.450774 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382a318-caf0-4a81-b723-0a3d1693d091 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:21.451042 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382a318-caf0-4a81-b723-0a3d1693d091 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:21.452843 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6382a318-caf0-4a81-b723-0a3d1693d091 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:53:21.466028 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382a318-caf0-4a81-b723-0a3d1693d091 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:21.467657 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382a318-caf0-4a81-b723-0a3d1693d091 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:21.479239 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1258/2503] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:53:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:53:26.423385 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=14 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:53:31.474042 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=47 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:53:33.985793 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa815f4-cca8-4c8a-b48b-a941c87eb2dc service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:33.987264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4aa815f4-cca8-4c8a-b48b-a941c87eb2dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:53:34.070564 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa815f4-cca8-4c8a-b48b-a941c87eb2dc service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:34.075621 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3765fb1-5d88-40bd-8bf0-585cc13780a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:34.076240 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3765fb1-5d88-40bd-8bf0-585cc13780a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:34.076524 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3765fb1-5d88-40bd-8bf0-585cc13780a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:34.076801 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3765fb1-5d88-40bd-8bf0-585cc13780a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:34.087285 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3765fb1-5d88-40bd-8bf0-585cc13780a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:34.089451 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3765fb1-5d88-40bd-8bf0-585cc13780a1 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:34.099777 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1246/2504] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:53:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:53:44.095353 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=35 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:53:54.409548 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ebb04-a432-465a-9246-54b3fe6be525 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:54.411059 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ebb04-a432-465a-9246-54b3fe6be525 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:54.411059 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ebb04-a432-465a-9246-54b3fe6be525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:54.431000 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-369ebb04-a432-465a-9246-54b3fe6be525 None None] MFA Rules not processed for user `9f2b2835fdcd46e491e246799abd402b`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:53:54.432297 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-369ebb04-a432-465a-9246-54b3fe6be525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:53:54.505078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1259/2505] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:53:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:53:56.184773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3765fb1-5d88-40bd-8bf0-585cc13780a1 service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:53:56.186188 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f3765fb1-5d88-40bd-8bf0-585cc13780a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:53:56.198646 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3765fb1-5d88-40bd-8bf0-585cc13780a1 service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:53:56.202538 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b08dec-085b-4e62-98d6-1747b130316e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:53:56.203143 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b08dec-085b-4e62-98d6-1747b130316e service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:53:56.203448 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b08dec-085b-4e62-98d6-1747b130316e service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:53:56.203759 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b08dec-085b-4e62-98d6-1747b130316e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:53:56.205459 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e9b08dec-085b-4e62-98d6-1747b130316e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:53:56.288309 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b08dec-085b-4e62-98d6-1747b130316e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:53:56.289784 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b08dec-085b-4e62-98d6-1747b130316e service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:53:56.300321 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1247/2506] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:53:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:54:01.368179 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ebb04-a432-465a-9246-54b3fe6be525 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:01.370849 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-369ebb04-a432-465a-9246-54b3fe6be525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:01.389659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ebb04-a432-465a-9246-54b3fe6be525 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:01.394854 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff769381-f5b4-457c-acbf-dbe21433b388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:01.395498 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff769381-f5b4-457c-acbf-dbe21433b388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:01.395777 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff769381-f5b4-457c-acbf-dbe21433b388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:01.396047 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff769381-f5b4-457c-acbf-dbe21433b388 admin admin] PATH_INFO: `/v3/users/b0b04eae45014585a0fb2205adf946c8` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:01.397191 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff769381-f5b4-457c-acbf-dbe21433b388 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0b04eae45014585a0fb2205adf946c8)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:01.399724 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff769381-f5b4-457c-acbf-dbe21433b388 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:01.608308 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ff769381-f5b4-457c-acbf-dbe21433b388 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0b04eae45014585a0fb2205adf946c8'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:01.725854 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ff769381-f5b4-457c-acbf-dbe21433b388 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0b04eae45014585a0fb2205adf946c8'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:01.726726 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ff769381-f5b4-457c-acbf-dbe21433b388 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0b04eae45014585a0fb2205adf946c8'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:01.727366 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ff769381-f5b4-457c-acbf-dbe21433b388 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0b04eae45014585a0fb2205adf946c8'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:01.734852 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ff769381-f5b4-457c-acbf-dbe21433b388 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0b04eae45014585a0fb2205adf946c8'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:01.752123 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1260/2507] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:54:01 2022] DELETE /identity/v3/users/b0b04eae45014585a0fb2205adf946c8 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:54:02.041859 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b08dec-085b-4e62-98d6-1747b130316e service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:02.053876 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b08dec-085b-4e62-98d6-1747b130316e service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:02.122416 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b73f12-0a0a-4f72-bed4-3c6f44323ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:02.123058 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b73f12-0a0a-4f72-bed4-3c6f44323ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:02.123367 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b73f12-0a0a-4f72-bed4-3c6f44323ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:02.123641 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b73f12-0a0a-4f72-bed4-3c6f44323ed2 admin admin] PATH_INFO: `/v3/projects/ade8a06e18214ac08056c3743fed0132` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:02.124896 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b73f12-0a0a-4f72-bed4-3c6f44323ed2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ade8a06e18214ac08056c3743fed0132)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:02.127346 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b73f12-0a0a-4f72-bed4-3c6f44323ed2 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:02.262504 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-88b73f12-0a0a-4f72-bed4-3c6f44323ed2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ade8a06e18214ac08056c3743fed0132', 'request_id': 'req-88b73f12-0a0a-4f72-bed4-3c6f44323ed2'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:02.269042 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-88b73f12-0a0a-4f72-bed4-3c6f44323ed2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ade8a06e18214ac08056c3743fed0132', 'request_id': 'req-88b73f12-0a0a-4f72-bed4-3c6f44323ed2'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:02.352126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-88b73f12-0a0a-4f72-bed4-3c6f44323ed2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ade8a06e18214ac08056c3743fed0132', 'request_id': 'req-88b73f12-0a0a-4f72-bed4-3c6f44323ed2'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:02.363919 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-88b73f12-0a0a-4f72-bed4-3c6f44323ed2 admin admin] The token cache is being invalidate because project ade8a06e18214ac08056c3743fed0132 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:54:02.364219 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-88b73f12-0a0a-4f72-bed4-3c6f44323ed2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:02.364875 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-88b73f12-0a0a-4f72-bed4-3c6f44323ed2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:02.366385 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1248/2508] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:54:02 2022] DELETE /identity/v3/projects/ade8a06e18214ac08056c3743fed0132 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:54:02.371598 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d108ef-c01e-414b-b7db-012618baaf26 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:02.372125 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d108ef-c01e-414b-b7db-012618baaf26 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:02.372311 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d108ef-c01e-414b-b7db-012618baaf26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:02.437752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-35d108ef-c01e-414b-b7db-012618baaf26 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:54:02.439141 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-35d108ef-c01e-414b-b7db-012618baaf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:02.491771 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:02.512652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1261/2509] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:54:02.522062 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784646a-f026-4344-891b-fc9be521f653 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:02.522434 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784646a-f026-4344-891b-fc9be521f653 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:02.522722 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784646a-f026-4344-891b-fc9be521f653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:02.547040 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-1784646a-f026-4344-891b-fc9be521f653 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:54:02.584022 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1784646a-f026-4344-891b-fc9be521f653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:02.584022 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1249/2510] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:54:02.587001 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d108ef-c01e-414b-b7db-012618baaf26 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:02.598108 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d108ef-c01e-414b-b7db-012618baaf26 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:02.603773 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb64b1-e1f1-4b6f-9d9c-90e5112db069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:02.604399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb64b1-e1f1-4b6f-9d9c-90e5112db069 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:02.604677 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb64b1-e1f1-4b6f-9d9c-90e5112db069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:02.604953 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb64b1-e1f1-4b6f-9d9c-90e5112db069 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:02.605651 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb64b1-e1f1-4b6f-9d9c-90e5112db069 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:54:02.606059 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb64b1-e1f1-4b6f-9d9c-90e5112db069 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:02.607687 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb64b1-e1f1-4b6f-9d9c-90e5112db069 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:02.621342 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1262/2511] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:54:02.629457 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784646a-f026-4344-891b-fc9be521f653 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:02.658452 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784646a-f026-4344-891b-fc9be521f653 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:02.664585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeccc4dd-c9a1-48df-9ba0-0fd8e490371c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:02.665324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeccc4dd-c9a1-48df-9ba0-0fd8e490371c admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:02.665556 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeccc4dd-c9a1-48df-9ba0-0fd8e490371c admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:02.665825 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeccc4dd-c9a1-48df-9ba0-0fd8e490371c admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:02.666469 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeccc4dd-c9a1-48df-9ba0-0fd8e490371c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:02.668496 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeccc4dd-c9a1-48df-9ba0-0fd8e490371c admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:02.687382 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:02.803440 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1250/2512] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:54:02 2022] POST /identity/v3/projects => generated 369 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:54:02.807867 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb64b1-e1f1-4b6f-9d9c-90e5112db069 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:02.817997 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb64b1-e1f1-4b6f-9d9c-90e5112db069 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:02.881316 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303183eb-56f3-4195-85ad-43677137f4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:02.881951 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303183eb-56f3-4195-85ad-43677137f4b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:02.882234 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303183eb-56f3-4195-85ad-43677137f4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:02.882503 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303183eb-56f3-4195-85ad-43677137f4b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:02.883138 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303183eb-56f3-4195-85ad-43677137f4b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:02.885800 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303183eb-56f3-4195-85ad-43677137f4b5 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:02.978437 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1263/2513] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:54:02 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:54:02.982784 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeccc4dd-c9a1-48df-9ba0-0fd8e490371c admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:02.994452 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeccc4dd-c9a1-48df-9ba0-0fd8e490371c admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:02.999439 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0fa62-0db7-456f-b3d3-39b2ee5053e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:03.000046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0fa62-0db7-456f-b3d3-39b2ee5053e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:03.000350 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0fa62-0db7-456f-b3d3-39b2ee5053e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:03.000623 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0fa62-0db7-456f-b3d3-39b2ee5053e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:03.001260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0fa62-0db7-456f-b3d3-39b2ee5053e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:03.002853 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0fa62-0db7-456f-b3d3-39b2ee5053e9 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:03.013127 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1251/2514] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:54:03.017631 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303183eb-56f3-4195-85ad-43677137f4b5 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:03.028176 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303183eb-56f3-4195-85ad-43677137f4b5 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:03.034218 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9d7ce-bac4-4ce9-96c6-f16cd332e41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:03.035044 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9d7ce-bac4-4ce9-96c6-f16cd332e41c admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:03.038996 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9d7ce-bac4-4ce9-96c6-f16cd332e41c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:03.038996 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9d7ce-bac4-4ce9-96c6-f16cd332e41c admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:03.038996 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9d7ce-bac4-4ce9-96c6-f16cd332e41c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:03.038996 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9d7ce-bac4-4ce9-96c6-f16cd332e41c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:03.052921 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1264/2515] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:54:03.057261 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0fa62-0db7-456f-b3d3-39b2ee5053e9 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:03.072531 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0fa62-0db7-456f-b3d3-39b2ee5053e9 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:03.078199 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb909f-f268-48d0-b1dc-c967d92b1114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:03.078820 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb909f-f268-48d0-b1dc-c967d92b1114 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:03.079126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb909f-f268-48d0-b1dc-c967d92b1114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:03.079424 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb909f-f268-48d0-b1dc-c967d92b1114 admin admin] PATH_INFO: `/v3/projects/25a783f2f92d43639db8c3c5da581a36/users/8f6339480ca941c2a637651e1abc8ef0/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:03.098268 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb909f-f268-48d0-b1dc-c967d92b1114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25a783f2f92d43639db8c3c5da581a36, user_id=8f6339480ca941c2a637651e1abc8ef0, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:03.101394 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb909f-f268-48d0-b1dc-c967d92b1114 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:03.213121 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1252/2516] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:54:03 2022] PUT /identity/v3/projects/25a783f2f92d43639db8c3c5da581a36/users/8f6339480ca941c2a637651e1abc8ef0/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:54:03.224906 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61fd10-568a-437c-8a2a-fa0f6753e4e8 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:03.225258 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61fd10-568a-437c-8a2a-fa0f6753e4e8 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:03.225536 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61fd10-568a-437c-8a2a-fa0f6753e4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:03.255479 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-ba61fd10-568a-437c-8a2a-fa0f6753e4e8 None None] MFA Rules not processed for user `8f6339480ca941c2a637651e1abc8ef0`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:54:03.256981 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ba61fd10-568a-437c-8a2a-fa0f6753e4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:03.367988 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1265/2517] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:54:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:54:03.369280 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb909f-f268-48d0-b1dc-c967d92b1114 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:03.439584 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb909f-f268-48d0-b1dc-c967d92b1114 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:03.440644 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4068d-a381-4122-8f07-d4eab0697efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:03.441267 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4068d-a381-4122-8f07-d4eab0697efa admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:03.441555 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4068d-a381-4122-8f07-d4eab0697efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:03.441835 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4068d-a381-4122-8f07-d4eab0697efa admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:03.442477 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4068d-a381-4122-8f07-d4eab0697efa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:03.444466 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4068d-a381-4122-8f07-d4eab0697efa admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:03.469597 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61fd10-568a-437c-8a2a-fa0f6753e4e8 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:03.471090 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ba61fd10-568a-437c-8a2a-fa0f6753e4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:03.485835 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61fd10-568a-437c-8a2a-fa0f6753e4e8 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:03.490603 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157b611-db44-4928-b27f-5396c7b125d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:03.491179 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157b611-db44-4928-b27f-5396c7b125d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:03.491500 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157b611-db44-4928-b27f-5396c7b125d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:03.491782 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157b611-db44-4928-b27f-5396c7b125d1 admin admin] PATH_INFO: `/v3/users/ed58d569c3e74761bb2295ee04deb8b4` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:03.492949 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157b611-db44-4928-b27f-5396c7b125d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed58d569c3e74761bb2295ee04deb8b4)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:03.494918 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157b611-db44-4928-b27f-5396c7b125d1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:03.554030 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1253/2518] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:54:03 2022] POST /identity/v3/projects => generated 371 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:54:03.558989 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4068d-a381-4122-8f07-d4eab0697efa admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:03.621962 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4068d-a381-4122-8f07-d4eab0697efa admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:03.626733 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08552b-a59e-4154-9030-866165ebb66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:03.627377 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08552b-a59e-4154-9030-866165ebb66b admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:03.627666 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08552b-a59e-4154-9030-866165ebb66b admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:03.627942 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08552b-a59e-4154-9030-866165ebb66b admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:03.628586 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08552b-a59e-4154-9030-866165ebb66b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:03.630570 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08552b-a59e-4154-9030-866165ebb66b admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:03.672059 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:03.680262 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e157b611-db44-4928-b27f-5396c7b125d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed58d569c3e74761bb2295ee04deb8b4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:03.724972 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1254/2519] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:54:03 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:54:03.729202 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08552b-a59e-4154-9030-866165ebb66b admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:03.739484 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08552b-a59e-4154-9030-866165ebb66b admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:03.745260 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d814f5-df77-4472-8458-501536994e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:03.745880 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d814f5-df77-4472-8458-501536994e87 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:03.746190 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d814f5-df77-4472-8458-501536994e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:03.746511 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d814f5-df77-4472-8458-501536994e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:03.747124 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d814f5-df77-4472-8458-501536994e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:03.748780 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d814f5-df77-4472-8458-501536994e87 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:03.760922 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1255/2520] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:54:03.765246 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d814f5-df77-4472-8458-501536994e87 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:03.772186 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e157b611-db44-4928-b27f-5396c7b125d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed58d569c3e74761bb2295ee04deb8b4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:03.772888 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e157b611-db44-4928-b27f-5396c7b125d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed58d569c3e74761bb2295ee04deb8b4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:03.773492 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e157b611-db44-4928-b27f-5396c7b125d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed58d569c3e74761bb2295ee04deb8b4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:03.775679 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d814f5-df77-4472-8458-501536994e87 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:03.780750 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96668c-d5c3-4620-babd-d2de54e9a1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:03.781415 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96668c-d5c3-4620-babd-d2de54e9a1e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:03.781699 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96668c-d5c3-4620-babd-d2de54e9a1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:03.781831 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e157b611-db44-4928-b27f-5396c7b125d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed58d569c3e74761bb2295ee04deb8b4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:03.782053 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96668c-d5c3-4620-babd-d2de54e9a1e2 admin admin] PATH_INFO: `/v3/projects/c55124672d6a488b819d76947621c3d8/users/6175beb338634264aa587f77652077b6/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:03.798065 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96668c-d5c3-4620-babd-d2de54e9a1e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c55124672d6a488b819d76947621c3d8, user_id=6175beb338634264aa587f77652077b6, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:03.803224 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1266/2521] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:54:03 2022] DELETE /identity/v3/users/ed58d569c3e74761bb2295ee04deb8b4 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:54:03.803395 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96668c-d5c3-4620-babd-d2de54e9a1e2 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:03.893277 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:03.899188 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1256/2522] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:54:03 2022] PUT /identity/v3/projects/c55124672d6a488b819d76947621c3d8/users/6175beb338634264aa587f77652077b6/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:54:03.903925 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157b611-db44-4928-b27f-5396c7b125d1 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:03.905465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e157b611-db44-4928-b27f-5396c7b125d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:03.986029 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157b611-db44-4928-b27f-5396c7b125d1 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:04.073667 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3b1a1-1f46-4331-b3f9-a7d948736194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:04.073667 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3b1a1-1f46-4331-b3f9-a7d948736194 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:04.073667 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3b1a1-1f46-4331-b3f9-a7d948736194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:04.073667 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3b1a1-1f46-4331-b3f9-a7d948736194 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:04.074442 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3b1a1-1f46-4331-b3f9-a7d948736194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:04.074442 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3b1a1-1f46-4331-b3f9-a7d948736194 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:04.074442 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1267/2523] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:54:04.077318 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96668c-d5c3-4620-babd-d2de54e9a1e2 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:04.077803 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3b1a1-1f46-4331-b3f9-a7d948736194 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:04.079375 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9e96668c-d5c3-4620-babd-d2de54e9a1e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:04.091286 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3b1a1-1f46-4331-b3f9-a7d948736194 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:04.095160 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96668c-d5c3-4620-babd-d2de54e9a1e2 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:04.096361 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a14cd-faee-4549-adaf-ee32eb14e053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:04.099196 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a14cd-faee-4549-adaf-ee32eb14e053 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:04.099196 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a14cd-faee-4549-adaf-ee32eb14e053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:04.099196 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a14cd-faee-4549-adaf-ee32eb14e053 admin admin] PATH_INFO: `/v3/projects/c55124672d6a488b819d76947621c3d8/users/6175beb338634264aa587f77652077b6/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:04.099630 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a14cd-faee-4549-adaf-ee32eb14e053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c55124672d6a488b819d76947621c3d8, user_id=6175beb338634264aa587f77652077b6, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:04.100197 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d64ecb-dece-4c98-891c-04e0016b4d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:04.100845 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d64ecb-dece-4c98-891c-04e0016b4d76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:04.101129 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d64ecb-dece-4c98-891c-04e0016b4d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:04.101404 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d64ecb-dece-4c98-891c-04e0016b4d76 admin admin] PATH_INFO: `/v3/projects/059ea7e64b5048e9935d72f48338129e` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:04.102358 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a14cd-faee-4549-adaf-ee32eb14e053 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:04.102581 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d64ecb-dece-4c98-891c-04e0016b4d76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=059ea7e64b5048e9935d72f48338129e)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:04.104540 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d64ecb-dece-4c98-891c-04e0016b4d76 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:04.113305 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1268/2524] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:54:04 2022] PUT /identity/v3/projects/c55124672d6a488b819d76947621c3d8/users/6175beb338634264aa587f77652077b6/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:54:04.125293 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7394c7d-f942-4798-b80b-de09f48fe6e8 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:04.125678 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7394c7d-f942-4798-b80b-de09f48fe6e8 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:04.126062 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7394c7d-f942-4798-b80b-de09f48fe6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:04.155716 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-a7394c7d-f942-4798-b80b-de09f48fe6e8 None None] MFA Rules not processed for user `6175beb338634264aa587f77652077b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:54:04.156972 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a7394c7d-f942-4798-b80b-de09f48fe6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:04.189889 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:04.227076 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1269/2525] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:54:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:54:04.233259 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-26d64ecb-dece-4c98-891c-04e0016b4d76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '059ea7e64b5048e9935d72f48338129e', 'request_id': 'req-26d64ecb-dece-4c98-891c-04e0016b4d76'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:04.240696 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-26d64ecb-dece-4c98-891c-04e0016b4d76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '059ea7e64b5048e9935d72f48338129e', 'request_id': 'req-26d64ecb-dece-4c98-891c-04e0016b4d76'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:04.242559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7394c7d-f942-4798-b80b-de09f48fe6e8 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:04.242559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a7394c7d-f942-4798-b80b-de09f48fe6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:04.302328 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7394c7d-f942-4798-b80b-de09f48fe6e8 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:04.325550 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-26d64ecb-dece-4c98-891c-04e0016b4d76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '059ea7e64b5048e9935d72f48338129e', 'request_id': 'req-26d64ecb-dece-4c98-891c-04e0016b4d76'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:04.345512 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-26d64ecb-dece-4c98-891c-04e0016b4d76 admin admin] The token cache is being invalidate because project 059ea7e64b5048e9935d72f48338129e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:54:04.345916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-26d64ecb-dece-4c98-891c-04e0016b4d76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:04.346493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-26d64ecb-dece-4c98-891c-04e0016b4d76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:04.348384 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1257/2526] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:54:04 2022] DELETE /identity/v3/projects/059ea7e64b5048e9935d72f48338129e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:54:04.353143 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d64ecb-dece-4c98-891c-04e0016b4d76 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:04.354870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-26d64ecb-dece-4c98-891c-04e0016b4d76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:04.359159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504032a-efab-4928-984f-ef0d55635a1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:04.359809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504032a-efab-4928-984f-ef0d55635a1a service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:04.360091 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504032a-efab-4928-984f-ef0d55635a1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:04.360367 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504032a-efab-4928-984f-ef0d55635a1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:04.362345 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8504032a-efab-4928-984f-ef0d55635a1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:04.425338 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d64ecb-dece-4c98-891c-04e0016b4d76 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:04.430403 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d0262-f595-481e-88f5-b70c79ac3ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:04.431040 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d0262-f595-481e-88f5-b70c79ac3ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:04.431357 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d0262-f595-481e-88f5-b70c79ac3ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:04.431634 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d0262-f595-481e-88f5-b70c79ac3ba7 admin admin] PATH_INFO: `/v3/users/0ec5178f85ba4819a760882b731673b1` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:04.432784 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d0262-f595-481e-88f5-b70c79ac3ba7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ec5178f85ba4819a760882b731673b1)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:04.434721 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d0262-f595-481e-88f5-b70c79ac3ba7 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:04.441211 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8504032a-efab-4928-984f-ef0d55635a1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:04.442722 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8504032a-efab-4928-984f-ef0d55635a1a service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:04.453021 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1270/2527] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:54:04 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:54:04.675099 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-091d0262-f595-481e-88f5-b70c79ac3ba7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ec5178f85ba4819a760882b731673b1'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:04.675310 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-091d0262-f595-481e-88f5-b70c79ac3ba7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ec5178f85ba4819a760882b731673b1'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:04.684207 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-091d0262-f595-481e-88f5-b70c79ac3ba7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ec5178f85ba4819a760882b731673b1'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:04.684966 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-091d0262-f595-481e-88f5-b70c79ac3ba7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ec5178f85ba4819a760882b731673b1'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:04.752166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504032a-efab-4928-984f-ef0d55635a1a service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:04.753747 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8504032a-efab-4928-984f-ef0d55635a1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:04.765266 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504032a-efab-4928-984f-ef0d55635a1a service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:04.769239 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0a082-19d5-4a31-90f5-699c75fc163d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:04.769983 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0a082-19d5-4a31-90f5-699c75fc163d service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:04.770355 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0a082-19d5-4a31-90f5-699c75fc163d service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:04.770700 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0a082-19d5-4a31-90f5-699c75fc163d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:04.773253 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9cc0a082-19d5-4a31-90f5-699c75fc163d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:04.803533 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-091d0262-f595-481e-88f5-b70c79ac3ba7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ec5178f85ba4819a760882b731673b1'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:04.817200 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:04.861089 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1258/2528] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:54:04 2022] DELETE /identity/v3/users/0ec5178f85ba4819a760882b731673b1 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:54:04.861786 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0a082-19d5-4a31-90f5-699c75fc163d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:04.861786 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0a082-19d5-4a31-90f5-699c75fc163d service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:04.861786 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1271/2529] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:54:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:54:05.229396 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d0262-f595-481e-88f5-b70c79ac3ba7 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:05.231200 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-091d0262-f595-481e-88f5-b70c79ac3ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:05.238494 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:05.330094 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d0262-f595-481e-88f5-b70c79ac3ba7 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:05.339676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b36e0-332b-445b-aa7b-6d5b9c264e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:05.341628 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b36e0-332b-445b-aa7b-6d5b9c264e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:05.341628 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b36e0-332b-445b-aa7b-6d5b9c264e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:05.341985 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b36e0-332b-445b-aa7b-6d5b9c264e8c admin admin] PATH_INFO: `/v3/projects/e68344dfc3e546dfb50fe4b635262d31` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:05.344100 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b36e0-332b-445b-aa7b-6d5b9c264e8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e68344dfc3e546dfb50fe4b635262d31)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:05.346472 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b36e0-332b-445b-aa7b-6d5b9c264e8c admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:05.507420 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-835b36e0-332b-445b-aa7b-6d5b9c264e8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e68344dfc3e546dfb50fe4b635262d31', 'request_id': 'req-835b36e0-332b-445b-aa7b-6d5b9c264e8c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:05.513862 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-835b36e0-332b-445b-aa7b-6d5b9c264e8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e68344dfc3e546dfb50fe4b635262d31', 'request_id': 'req-835b36e0-332b-445b-aa7b-6d5b9c264e8c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:05.600764 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-835b36e0-332b-445b-aa7b-6d5b9c264e8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e68344dfc3e546dfb50fe4b635262d31', 'request_id': 'req-835b36e0-332b-445b-aa7b-6d5b9c264e8c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:05.616076 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-835b36e0-332b-445b-aa7b-6d5b9c264e8c admin admin] The token cache is being invalidate because project e68344dfc3e546dfb50fe4b635262d31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:54:05.616363 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-835b36e0-332b-445b-aa7b-6d5b9c264e8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:05.617046 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-835b36e0-332b-445b-aa7b-6d5b9c264e8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:05.619155 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1259/2530] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:54:05 2022] DELETE /identity/v3/projects/e68344dfc3e546dfb50fe4b635262d31 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:54:05.625426 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22315835-6c6d-4e75-a69d-60102eb11011 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:05.625927 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22315835-6c6d-4e75-a69d-60102eb11011 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:05.626407 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22315835-6c6d-4e75-a69d-60102eb11011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:05.656992 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-22315835-6c6d-4e75-a69d-60102eb11011 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:54:05.658256 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-22315835-6c6d-4e75-a69d-60102eb11011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:05.726435 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1272/2531] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:54:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:54:05.736688 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9d0a4-9e58-446a-80c8-bd44141dd2c9 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:05.736974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9d0a4-9e58-446a-80c8-bd44141dd2c9 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:05.737303 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9d0a4-9e58-446a-80c8-bd44141dd2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:05.758779 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-e2a9d0a4-9e58-446a-80c8-bd44141dd2c9 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:54:05.760104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e2a9d0a4-9e58-446a-80c8-bd44141dd2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:05.770392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1260/2532] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:54:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:54:05.775638 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22315835-6c6d-4e75-a69d-60102eb11011 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:05.786568 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22315835-6c6d-4e75-a69d-60102eb11011 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:05.792355 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f44c9e-5a44-4015-9275-720a3a9ffd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:05.792991 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f44c9e-5a44-4015-9275-720a3a9ffd1a admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:05.794422 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f44c9e-5a44-4015-9275-720a3a9ffd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:05.794422 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f44c9e-5a44-4015-9275-720a3a9ffd1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:05.794422 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f44c9e-5a44-4015-9275-720a3a9ffd1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:54:05.794793 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f44c9e-5a44-4015-9275-720a3a9ffd1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:05.796222 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f44c9e-5a44-4015-9275-720a3a9ffd1a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:05.810086 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1273/2533] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:54:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:54:05.815230 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9d0a4-9e58-446a-80c8-bd44141dd2c9 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:05.827626 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9d0a4-9e58-446a-80c8-bd44141dd2c9 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:05.834504 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc50a7-5977-4595-b98b-c5b70e97f69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:05.834504 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc50a7-5977-4595-b98b-c5b70e97f69e admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:05.834504 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc50a7-5977-4595-b98b-c5b70e97f69e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:05.834504 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc50a7-5977-4595-b98b-c5b70e97f69e admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:05.834922 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc50a7-5977-4595-b98b-c5b70e97f69e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:05.836484 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc50a7-5977-4595-b98b-c5b70e97f69e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:05.937869 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1261/2534] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:54:05 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:54:05.942357 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f44c9e-5a44-4015-9275-720a3a9ffd1a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:05.953979 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f44c9e-5a44-4015-9275-720a3a9ffd1a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:06.017649 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a59eee-a1ef-40ef-9e44-c7ffc771c924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:06.018274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a59eee-a1ef-40ef-9e44-c7ffc771c924 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:06.018556 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a59eee-a1ef-40ef-9e44-c7ffc771c924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:06.019552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a59eee-a1ef-40ef-9e44-c7ffc771c924 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:06.019552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a59eee-a1ef-40ef-9e44-c7ffc771c924 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:06.021583 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a59eee-a1ef-40ef-9e44-c7ffc771c924 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:06.138257 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1274/2535] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:54:05 2022] POST /identity/v3/users => generated 292 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:54:06.143761 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc50a7-5977-4595-b98b-c5b70e97f69e admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:06.162813 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc50a7-5977-4595-b98b-c5b70e97f69e admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:06.170151 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a5baa-317e-434f-9ee4-3626fb74a17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:06.170781 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a5baa-317e-434f-9ee4-3626fb74a17c admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:06.171059 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a5baa-317e-434f-9ee4-3626fb74a17c admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:06.171367 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a5baa-317e-434f-9ee4-3626fb74a17c admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:06.172015 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a5baa-317e-434f-9ee4-3626fb74a17c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:06.173627 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a5baa-317e-434f-9ee4-3626fb74a17c admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:06.185710 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1262/2536] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:54:06.192231 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a59eee-a1ef-40ef-9e44-c7ffc771c924 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:06.203720 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a59eee-a1ef-40ef-9e44-c7ffc771c924 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:06.208668 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbc8e4-b803-446a-b3cd-c84297719ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:06.209352 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbc8e4-b803-446a-b3cd-c84297719ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:06.209736 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbc8e4-b803-446a-b3cd-c84297719ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:06.210019 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbc8e4-b803-446a-b3cd-c84297719ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:06.210675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bbc8e4-b803-446a-b3cd-c84297719ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:06.213008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bbc8e4-b803-446a-b3cd-c84297719ed2 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:06.226403 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1275/2537] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:54:06.230757 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a5baa-317e-434f-9ee4-3626fb74a17c admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:06.241206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a5baa-317e-434f-9ee4-3626fb74a17c admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:06.247947 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb4a50-9ff6-4650-9ab0-02f7254c8a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:06.248646 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb4a50-9ff6-4650-9ab0-02f7254c8a8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:06.248940 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb4a50-9ff6-4650-9ab0-02f7254c8a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:06.249211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb4a50-9ff6-4650-9ab0-02f7254c8a8d admin admin] PATH_INFO: `/v3/projects/7b25702e9d4541d3abc6a733460e95b0/users/cac648ee80d54a739805101f9572ddb9/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:06.267999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb4a50-9ff6-4650-9ab0-02f7254c8a8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b25702e9d4541d3abc6a733460e95b0, user_id=cac648ee80d54a739805101f9572ddb9, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:06.270911 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb4a50-9ff6-4650-9ab0-02f7254c8a8d admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:06.372153 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1263/2538] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:54:06 2022] PUT /identity/v3/projects/7b25702e9d4541d3abc6a733460e95b0/users/cac648ee80d54a739805101f9572ddb9/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:54:06.382823 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42aca1e-b704-4fba-b182-a1ac58d5d411 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:06.383111 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42aca1e-b704-4fba-b182-a1ac58d5d411 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:06.384182 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42aca1e-b704-4fba-b182-a1ac58d5d411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:06.416909 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-a42aca1e-b704-4fba-b182-a1ac58d5d411 None None] MFA Rules not processed for user `cac648ee80d54a739805101f9572ddb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:54:06.418333 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a42aca1e-b704-4fba-b182-a1ac58d5d411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:06.466000 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:06.511636 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1276/2539] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:54:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:54:06.516716 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb4a50-9ff6-4650-9ab0-02f7254c8a8d admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:06.558452 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:06.607337 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb4a50-9ff6-4650-9ab0-02f7254c8a8d admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:06.613367 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1daea-adca-4d1e-870b-da0a9c11f905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:06.613901 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1daea-adca-4d1e-870b-da0a9c11f905 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:06.614186 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1daea-adca-4d1e-870b-da0a9c11f905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:06.614466 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1daea-adca-4d1e-870b-da0a9c11f905 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:06.615189 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1daea-adca-4d1e-870b-da0a9c11f905 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:06.617201 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1daea-adca-4d1e-870b-da0a9c11f905 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:06.745621 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1264/2540] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:54:06 2022] POST /identity/v3/projects => generated 383 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:54:06.749900 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42aca1e-b704-4fba-b182-a1ac58d5d411 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:06.761882 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42aca1e-b704-4fba-b182-a1ac58d5d411 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:06.831046 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785167e6-304a-4e64-83e6-c3700a2ba215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:06.831805 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785167e6-304a-4e64-83e6-c3700a2ba215 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:06.831974 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785167e6-304a-4e64-83e6-c3700a2ba215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:06.832244 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785167e6-304a-4e64-83e6-c3700a2ba215 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:06.832881 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785167e6-304a-4e64-83e6-c3700a2ba215 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:06.834927 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785167e6-304a-4e64-83e6-c3700a2ba215 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:06.997280 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1277/2541] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:54:06 2022] POST /identity/v3/users => generated 298 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:54:07.001744 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1daea-adca-4d1e-870b-da0a9c11f905 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:07.015740 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1daea-adca-4d1e-870b-da0a9c11f905 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:07.021238 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378af960-a99e-4c07-8cf8-6d13c3630eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:07.021680 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378af960-a99e-4c07-8cf8-6d13c3630eee admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:07.021993 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378af960-a99e-4c07-8cf8-6d13c3630eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:07.022283 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378af960-a99e-4c07-8cf8-6d13c3630eee admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:07.022940 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378af960-a99e-4c07-8cf8-6d13c3630eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:07.025346 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378af960-a99e-4c07-8cf8-6d13c3630eee admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:07.036932 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1265/2542] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:54:07.043938 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785167e6-304a-4e64-83e6-c3700a2ba215 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:07.055476 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785167e6-304a-4e64-83e6-c3700a2ba215 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:07.060761 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb328aa-a48b-401a-b3e7-a4e52959c0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:07.061540 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb328aa-a48b-401a-b3e7-a4e52959c0ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:07.061890 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb328aa-a48b-401a-b3e7-a4e52959c0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:07.062169 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb328aa-a48b-401a-b3e7-a4e52959c0ee admin admin] PATH_INFO: `/v3/projects/0144165ad84843949fd900ff7a4e6bc6/users/9efd8b9d93fe44d7816f16751bf279b4/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:07.082395 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb328aa-a48b-401a-b3e7-a4e52959c0ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=0144165ad84843949fd900ff7a4e6bc6, user_id=9efd8b9d93fe44d7816f16751bf279b4, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:07.085314 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb328aa-a48b-401a-b3e7-a4e52959c0ee admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:07.207185 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1278/2543] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:54:07 2022] PUT /identity/v3/projects/0144165ad84843949fd900ff7a4e6bc6/users/9efd8b9d93fe44d7816f16751bf279b4/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:54:07.211405 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378af960-a99e-4c07-8cf8-6d13c3630eee admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:07.227860 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378af960-a99e-4c07-8cf8-6d13c3630eee admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:07.292941 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976ee1e-5eae-47f7-aec5-d360457cfb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:07.293734 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976ee1e-5eae-47f7-aec5-d360457cfb1d admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:07.293922 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976ee1e-5eae-47f7-aec5-d360457cfb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:07.294112 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976ee1e-5eae-47f7-aec5-d360457cfb1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:07.294778 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976ee1e-5eae-47f7-aec5-d360457cfb1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:07.296543 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976ee1e-5eae-47f7-aec5-d360457cfb1d admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:07.308518 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1266/2544] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:54:07.315123 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb328aa-a48b-401a-b3e7-a4e52959c0ee admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:07.327925 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb328aa-a48b-401a-b3e7-a4e52959c0ee admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:07.333612 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b834b8f-0d24-42c7-a437-4305dc938405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:07.334396 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b834b8f-0d24-42c7-a437-4305dc938405 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:07.334719 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b834b8f-0d24-42c7-a437-4305dc938405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:07.335035 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b834b8f-0d24-42c7-a437-4305dc938405 admin admin] PATH_INFO: `/v3/projects/0144165ad84843949fd900ff7a4e6bc6/users/9efd8b9d93fe44d7816f16751bf279b4/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:07.337853 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b834b8f-0d24-42c7-a437-4305dc938405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0144165ad84843949fd900ff7a4e6bc6, user_id=9efd8b9d93fe44d7816f16751bf279b4, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:07.342450 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b834b8f-0d24-42c7-a437-4305dc938405 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:07.371804 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1279/2545] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:54:07 2022] PUT /identity/v3/projects/0144165ad84843949fd900ff7a4e6bc6/users/9efd8b9d93fe44d7816f16751bf279b4/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:54:07.386824 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08580b2-6c99-4e22-8b8f-c55d9f95c2b1 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:07.387340 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08580b2-6c99-4e22-8b8f-c55d9f95c2b1 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:07.387805 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08580b2-6c99-4e22-8b8f-c55d9f95c2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:07.424105 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-c08580b2-6c99-4e22-8b8f-c55d9f95c2b1 None None] MFA Rules not processed for user `9efd8b9d93fe44d7816f16751bf279b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:54:07.425437 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c08580b2-6c99-4e22-8b8f-c55d9f95c2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:07.527371 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1267/2546] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:54:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:54:07.549884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b834b8f-0d24-42c7-a437-4305dc938405 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:07.555044 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6b834b8f-0d24-42c7-a437-4305dc938405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:07.659411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b834b8f-0d24-42c7-a437-4305dc938405 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:07.667488 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b03374-f303-4d98-a243-1e6484cb0745 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:07.668255 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b03374-f303-4d98-a243-1e6484cb0745 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:07.668599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b03374-f303-4d98-a243-1e6484cb0745 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:07.668934 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b03374-f303-4d98-a243-1e6484cb0745 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:07.745108 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:07.780572 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b03374-f303-4d98-a243-1e6484cb0745 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:07.782198 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b03374-f303-4d98-a243-1e6484cb0745 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:07.800988 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1280/2547] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:54:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:54:13.768608 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08580b2-6c99-4e22-8b8f-c55d9f95c2b1 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:13.779939 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08580b2-6c99-4e22-8b8f-c55d9f95c2b1 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:13.783733 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c9290-deec-4750-9aa3-7c891f4aa6da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:13.784358 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c9290-deec-4750-9aa3-7c891f4aa6da service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:13.784642 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c9290-deec-4750-9aa3-7c891f4aa6da service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:13.784917 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c9290-deec-4750-9aa3-7c891f4aa6da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:13.794924 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c9290-deec-4750-9aa3-7c891f4aa6da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:13.796428 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c9290-deec-4750-9aa3-7c891f4aa6da service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:13.807367 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1268/2548] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:54:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:54:18.491059 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=11 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:20.162399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b03374-f303-4d98-a243-1e6484cb0745 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:20.233137 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b03374-f303-4d98-a243-1e6484cb0745 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:20.237965 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a6d48-8117-4b55-bd49-f7dcbc5b40bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:20.238602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a6d48-8117-4b55-bd49-f7dcbc5b40bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:20.238884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a6d48-8117-4b55-bd49-f7dcbc5b40bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:20.239226 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a6d48-8117-4b55-bd49-f7dcbc5b40bd admin admin] PATH_INFO: `/v3/users/cac648ee80d54a739805101f9572ddb9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:20.240496 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a6d48-8117-4b55-bd49-f7dcbc5b40bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=cac648ee80d54a739805101f9572ddb9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:20.243093 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a6d48-8117-4b55-bd49-f7dcbc5b40bd admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:20.572376 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-7a1a6d48-8117-4b55-bd49-f7dcbc5b40bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cac648ee80d54a739805101f9572ddb9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:20.725651 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-7a1a6d48-8117-4b55-bd49-f7dcbc5b40bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cac648ee80d54a739805101f9572ddb9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:20.726494 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-7a1a6d48-8117-4b55-bd49-f7dcbc5b40bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cac648ee80d54a739805101f9572ddb9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:20.727368 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-7a1a6d48-8117-4b55-bd49-f7dcbc5b40bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cac648ee80d54a739805101f9572ddb9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:20.738542 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-7a1a6d48-8117-4b55-bd49-f7dcbc5b40bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cac648ee80d54a739805101f9572ddb9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:20.764724 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1281/2549] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:54:20 2022] DELETE /identity/v3/users/cac648ee80d54a739805101f9572ddb9 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:54:20.769955 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983363b-0972-4a7d-bd7a-3a0dae92820e None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:20.770603 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983363b-0972-4a7d-bd7a-3a0dae92820e None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:20.772090 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983363b-0972-4a7d-bd7a-3a0dae92820e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:20.802619 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-d983363b-0972-4a7d-bd7a-3a0dae92820e None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:54:20.804324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d983363b-0972-4a7d-bd7a-3a0dae92820e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:20.811775 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:20.889848 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1269/2550] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:54:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:54:20.904480 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a6d48-8117-4b55-bd49-f7dcbc5b40bd admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:20.906052 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7a1a6d48-8117-4b55-bd49-f7dcbc5b40bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:20.980920 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a6d48-8117-4b55-bd49-f7dcbc5b40bd admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:20.984997 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0408b3-6523-4bc8-b9b3-ac082e3d7507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:20.985631 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0408b3-6523-4bc8-b9b3-ac082e3d7507 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:20.985914 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0408b3-6523-4bc8-b9b3-ac082e3d7507 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:20.986269 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0408b3-6523-4bc8-b9b3-ac082e3d7507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:21.000214 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0408b3-6523-4bc8-b9b3-ac082e3d7507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:21.001704 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0408b3-6523-4bc8-b9b3-ac082e3d7507 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:21.012472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1282/2551] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:54:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:54:21.582937 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983363b-0972-4a7d-bd7a-3a0dae92820e None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:21.584557 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d983363b-0972-4a7d-bd7a-3a0dae92820e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:21.603829 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983363b-0972-4a7d-bd7a-3a0dae92820e None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:21.612232 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd85742-fd19-40ae-a8f0-523f1e571808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:21.615687 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd85742-fd19-40ae-a8f0-523f1e571808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:21.615989 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd85742-fd19-40ae-a8f0-523f1e571808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:21.616887 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd85742-fd19-40ae-a8f0-523f1e571808 admin admin] PATH_INFO: `/v3/projects/7b25702e9d4541d3abc6a733460e95b0` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:21.617969 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd85742-fd19-40ae-a8f0-523f1e571808 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b25702e9d4541d3abc6a733460e95b0)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:21.620043 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd85742-fd19-40ae-a8f0-523f1e571808 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:21.768033 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1fd85742-fd19-40ae-a8f0-523f1e571808 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b25702e9d4541d3abc6a733460e95b0', 'request_id': 'req-1fd85742-fd19-40ae-a8f0-523f1e571808'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:21.774870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1fd85742-fd19-40ae-a8f0-523f1e571808 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b25702e9d4541d3abc6a733460e95b0', 'request_id': 'req-1fd85742-fd19-40ae-a8f0-523f1e571808'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:21.849319 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1fd85742-fd19-40ae-a8f0-523f1e571808 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b25702e9d4541d3abc6a733460e95b0', 'request_id': 'req-1fd85742-fd19-40ae-a8f0-523f1e571808'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:21.862206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1fd85742-fd19-40ae-a8f0-523f1e571808 admin admin] The token cache is being invalidate because project 7b25702e9d4541d3abc6a733460e95b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:54:21.862494 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1fd85742-fd19-40ae-a8f0-523f1e571808 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:21.865603 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1fd85742-fd19-40ae-a8f0-523f1e571808 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:21.865603 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1270/2552] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:54:21 2022] DELETE /identity/v3/projects/7b25702e9d4541d3abc6a733460e95b0 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:54:21.869840 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0408b3-6523-4bc8-b9b3-ac082e3d7507 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:21.880211 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0408b3-6523-4bc8-b9b3-ac082e3d7507 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:21.904434 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:21.951766 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae0782-3df4-45bc-b44b-ad9ac12909e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:21.952420 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae0782-3df4-45bc-b44b-ad9ac12909e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:21.952736 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae0782-3df4-45bc-b44b-ad9ac12909e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:21.953559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae0782-3df4-45bc-b44b-ad9ac12909e2 admin admin] PATH_INFO: `/v3/users/9efd8b9d93fe44d7816f16751bf279b4` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:21.954245 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae0782-3df4-45bc-b44b-ad9ac12909e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9efd8b9d93fe44d7816f16751bf279b4)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:21.956236 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae0782-3df4-45bc-b44b-ad9ac12909e2 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:22.202335 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-48ae0782-3df4-45bc-b44b-ad9ac12909e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9efd8b9d93fe44d7816f16751bf279b4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:22.273892 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-48ae0782-3df4-45bc-b44b-ad9ac12909e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9efd8b9d93fe44d7816f16751bf279b4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:22.274646 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-48ae0782-3df4-45bc-b44b-ad9ac12909e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9efd8b9d93fe44d7816f16751bf279b4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:22.275571 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-48ae0782-3df4-45bc-b44b-ad9ac12909e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9efd8b9d93fe44d7816f16751bf279b4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:22.288572 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-48ae0782-3df4-45bc-b44b-ad9ac12909e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9efd8b9d93fe44d7816f16751bf279b4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:22.307623 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1283/2553] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:54:21 2022] DELETE /identity/v3/users/9efd8b9d93fe44d7816f16751bf279b4 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:54:22.764616 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd85742-fd19-40ae-a8f0-523f1e571808 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:22.766204 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1fd85742-fd19-40ae-a8f0-523f1e571808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:22.783665 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd85742-fd19-40ae-a8f0-523f1e571808 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:22.855042 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd8f69-5a60-463a-961b-0e1071336683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:22.855723 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd8f69-5a60-463a-961b-0e1071336683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:22.856086 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd8f69-5a60-463a-961b-0e1071336683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:22.856270 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd8f69-5a60-463a-961b-0e1071336683 admin admin] PATH_INFO: `/v3/projects/0144165ad84843949fd900ff7a4e6bc6` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:22.857479 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd8f69-5a60-463a-961b-0e1071336683 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0144165ad84843949fd900ff7a4e6bc6)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:22.859590 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd8f69-5a60-463a-961b-0e1071336683 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:23.020756 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:23.030108 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-acdd8f69-5a60-463a-961b-0e1071336683 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0144165ad84843949fd900ff7a4e6bc6', 'request_id': 'req-acdd8f69-5a60-463a-961b-0e1071336683'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:23.036023 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-acdd8f69-5a60-463a-961b-0e1071336683 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0144165ad84843949fd900ff7a4e6bc6', 'request_id': 'req-acdd8f69-5a60-463a-961b-0e1071336683'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:23.198355 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-acdd8f69-5a60-463a-961b-0e1071336683 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0144165ad84843949fd900ff7a4e6bc6', 'request_id': 'req-acdd8f69-5a60-463a-961b-0e1071336683'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:23.223878 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-acdd8f69-5a60-463a-961b-0e1071336683 admin admin] The token cache is being invalidate because project 0144165ad84843949fd900ff7a4e6bc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:54:23.223878 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-acdd8f69-5a60-463a-961b-0e1071336683 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:23.223878 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-acdd8f69-5a60-463a-961b-0e1071336683 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:23.227652 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1271/2554] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:54:22 2022] DELETE /identity/v3/projects/0144165ad84843949fd900ff7a4e6bc6 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:54:23.232419 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81baf231-2979-4e83-b9a7-491aa96ecd7b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:23.232968 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81baf231-2979-4e83-b9a7-491aa96ecd7b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:23.233568 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81baf231-2979-4e83-b9a7-491aa96ecd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:23.267083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-81baf231-2979-4e83-b9a7-491aa96ecd7b None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:54:23.267083 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-81baf231-2979-4e83-b9a7-491aa96ecd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:23.336863 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1284/2555] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:54:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:54:23.346954 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a77f66-21b5-4154-830d-8dc3a22a8ae6 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:23.347438 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a77f66-21b5-4154-830d-8dc3a22a8ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:23.347745 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a77f66-21b5-4154-830d-8dc3a22a8ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:23.378673 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-b4a77f66-21b5-4154-830d-8dc3a22a8ae6 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:54:23.379022 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b4a77f66-21b5-4154-830d-8dc3a22a8ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:23.396467 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1272/2556] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:54:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:54:23.406227 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81baf231-2979-4e83-b9a7-491aa96ecd7b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:23.423995 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81baf231-2979-4e83-b9a7-491aa96ecd7b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:23.433066 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a686d7-8e31-41de-9b4d-64c8472ce2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:23.434131 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a686d7-8e31-41de-9b4d-64c8472ce2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:23.434622 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a686d7-8e31-41de-9b4d-64c8472ce2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:23.435119 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a686d7-8e31-41de-9b4d-64c8472ce2e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:23.436310 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a686d7-8e31-41de-9b4d-64c8472ce2e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:54:23.436712 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a686d7-8e31-41de-9b4d-64c8472ce2e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:23.439885 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a686d7-8e31-41de-9b4d-64c8472ce2e1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:23.462759 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1285/2557] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:54:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:54:23.468519 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a77f66-21b5-4154-830d-8dc3a22a8ae6 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:23.484754 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a77f66-21b5-4154-830d-8dc3a22a8ae6 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:23.489779 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9bbc8a-1fd4-4a10-9793-54813c548b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:23.493144 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9bbc8a-1fd4-4a10-9793-54813c548b96 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:23.493144 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9bbc8a-1fd4-4a10-9793-54813c548b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:23.493144 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9bbc8a-1fd4-4a10-9793-54813c548b96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:23.493144 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9bbc8a-1fd4-4a10-9793-54813c548b96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:23.493701 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9bbc8a-1fd4-4a10-9793-54813c548b96 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:23.587860 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1273/2558] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:54:23 2022] POST /identity/v3/projects => generated 369 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:54:23.592296 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a686d7-8e31-41de-9b4d-64c8472ce2e1 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:23.602265 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a686d7-8e31-41de-9b4d-64c8472ce2e1 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:23.629517 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:23.665343 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495ba98-2f70-49e9-838c-f2909c0e804e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:23.665958 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495ba98-2f70-49e9-838c-f2909c0e804e admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:23.666239 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495ba98-2f70-49e9-838c-f2909c0e804e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:23.666676 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495ba98-2f70-49e9-838c-f2909c0e804e admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:23.667335 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495ba98-2f70-49e9-838c-f2909c0e804e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:23.674110 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495ba98-2f70-49e9-838c-f2909c0e804e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:23.798391 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1286/2559] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:54:23 2022] POST /identity/v3/users => generated 285 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:54:23.802867 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9bbc8a-1fd4-4a10-9793-54813c548b96 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:23.813347 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9bbc8a-1fd4-4a10-9793-54813c548b96 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:23.817959 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50426d0-f63c-4c49-a2f6-e3f3942c07e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:23.818608 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50426d0-f63c-4c49-a2f6-e3f3942c07e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:23.818889 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50426d0-f63c-4c49-a2f6-e3f3942c07e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:23.819164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50426d0-f63c-4c49-a2f6-e3f3942c07e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:23.819841 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50426d0-f63c-4c49-a2f6-e3f3942c07e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:23.822073 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50426d0-f63c-4c49-a2f6-e3f3942c07e3 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:23.832475 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1274/2560] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:54:23.837218 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495ba98-2f70-49e9-838c-f2909c0e804e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:23.848073 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495ba98-2f70-49e9-838c-f2909c0e804e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:23.853028 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc787c75-e2e3-4c9b-9d13-604403df505d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:23.853762 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc787c75-e2e3-4c9b-9d13-604403df505d admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:23.854050 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc787c75-e2e3-4c9b-9d13-604403df505d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:23.854324 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc787c75-e2e3-4c9b-9d13-604403df505d admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:23.854975 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc787c75-e2e3-4c9b-9d13-604403df505d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:23.856677 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc787c75-e2e3-4c9b-9d13-604403df505d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:23.868395 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1287/2561] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:54:23.872563 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50426d0-f63c-4c49-a2f6-e3f3942c07e3 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:23.882417 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50426d0-f63c-4c49-a2f6-e3f3942c07e3 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:23.887527 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868350e-bc7c-46bf-babb-a58ca32f42d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:23.888181 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868350e-bc7c-46bf-babb-a58ca32f42d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:23.888467 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868350e-bc7c-46bf-babb-a58ca32f42d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:23.890408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868350e-bc7c-46bf-babb-a58ca32f42d4 admin admin] PATH_INFO: `/v3/projects/e173c620ab9147c98e87c8e65e9224bb/users/d416f3ca9a8a4e569bf3a20847d69dc5/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:23.904406 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868350e-bc7c-46bf-babb-a58ca32f42d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e173c620ab9147c98e87c8e65e9224bb, user_id=d416f3ca9a8a4e569bf3a20847d69dc5, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:23.907129 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868350e-bc7c-46bf-babb-a58ca32f42d4 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:24.015879 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1275/2562] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:54:23 2022] PUT /identity/v3/projects/e173c620ab9147c98e87c8e65e9224bb/users/d416f3ca9a8a4e569bf3a20847d69dc5/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:54:24.028345 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b65c16-755a-40cd-a3e4-d546eebe7b19 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:24.028635 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b65c16-755a-40cd-a3e4-d546eebe7b19 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:24.028914 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b65c16-755a-40cd-a3e4-d546eebe7b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:24.059544 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-53b65c16-755a-40cd-a3e4-d546eebe7b19 None None] MFA Rules not processed for user `d416f3ca9a8a4e569bf3a20847d69dc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:54:24.059544 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-53b65c16-755a-40cd-a3e4-d546eebe7b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:24.125523 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1288/2563] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:54:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:54:24.137705 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868350e-bc7c-46bf-babb-a58ca32f42d4 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:24.139487 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4868350e-bc7c-46bf-babb-a58ca32f42d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:24.196688 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868350e-bc7c-46bf-babb-a58ca32f42d4 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:24.200456 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbdacb-8577-47fa-8171-b6fb2cac9a9f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7690af0cd266458f9cdd799c98ff5bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:24.201061 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbdacb-8577-47fa-8171-b6fb2cac9a9f service glance] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:24.201346 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbdacb-8577-47fa-8171-b6fb2cac9a9f service glance] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:24.201623 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbdacb-8577-47fa-8171-b6fb2cac9a9f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:24.209989 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdbdacb-8577-47fa-8171-b6fb2cac9a9f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:24.211982 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdbdacb-8577-47fa-8171-b6fb2cac9a9f service glance] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:24.221117 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1276/2564] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:54:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:54:34.122468 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=53,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:34.217013 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=64,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:46.027369 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b65c16-755a-40cd-a3e4-d546eebe7b19 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:46.029632 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-53b65c16-755a-40cd-a3e4-d546eebe7b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:46.107324 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b65c16-755a-40cd-a3e4-d546eebe7b19 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:46.112005 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe1d80-9967-4bb4-9f7f-c633a44ac596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:46.112642 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe1d80-9967-4bb4-9f7f-c633a44ac596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:46.112942 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe1d80-9967-4bb4-9f7f-c633a44ac596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:46.113203 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe1d80-9967-4bb4-9f7f-c633a44ac596 admin admin] PATH_INFO: `/v3/users/8f6339480ca941c2a637651e1abc8ef0` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:46.114351 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe1d80-9967-4bb4-9f7f-c633a44ac596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f6339480ca941c2a637651e1abc8ef0)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:46.116329 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe1d80-9967-4bb4-9f7f-c633a44ac596 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:46.316246 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2ffe1d80-9967-4bb4-9f7f-c633a44ac596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f6339480ca941c2a637651e1abc8ef0'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:46.404956 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2ffe1d80-9967-4bb4-9f7f-c633a44ac596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f6339480ca941c2a637651e1abc8ef0'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:46.407403 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2ffe1d80-9967-4bb4-9f7f-c633a44ac596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f6339480ca941c2a637651e1abc8ef0'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:46.407403 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2ffe1d80-9967-4bb4-9f7f-c633a44ac596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f6339480ca941c2a637651e1abc8ef0'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:46.414470 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2ffe1d80-9967-4bb4-9f7f-c633a44ac596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f6339480ca941c2a637651e1abc8ef0'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:46.434916 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1289/2565] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:54:46 2022] DELETE /identity/v3/users/8f6339480ca941c2a637651e1abc8ef0 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:54:46.439591 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f20ba-2fa8-4bf2-b199-7eab84152694 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:46.441999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f20ba-2fa8-4bf2-b199-7eab84152694 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:46.441999 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f20ba-2fa8-4bf2-b199-7eab84152694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:46.460716 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-7b6f20ba-2fa8-4bf2-b199-7eab84152694 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:54:46.461972 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7b6f20ba-2fa8-4bf2-b199-7eab84152694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:46.524078 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1277/2566] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:54:46.534547 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe1d80-9967-4bb4-9f7f-c633a44ac596 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:46.536012 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2ffe1d80-9967-4bb4-9f7f-c633a44ac596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:46.604431 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe1d80-9967-4bb4-9f7f-c633a44ac596 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:46.612270 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d3997-7653-4c88-8793-0f7d7b4ede22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:46.612936 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d3997-7653-4c88-8793-0f7d7b4ede22 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:46.613406 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d3997-7653-4c88-8793-0f7d7b4ede22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:46.613569 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d3997-7653-4c88-8793-0f7d7b4ede22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:46.624669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d3997-7653-4c88-8793-0f7d7b4ede22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:46.626061 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d3997-7653-4c88-8793-0f7d7b4ede22 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:46.636771 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1290/2567] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:54:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:54:47.207607 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f20ba-2fa8-4bf2-b199-7eab84152694 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:47.209082 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7b6f20ba-2fa8-4bf2-b199-7eab84152694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:47.221303 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f20ba-2fa8-4bf2-b199-7eab84152694 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:47.226493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4921f0-c294-4da8-8331-08eef7e6e9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:47.227137 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4921f0-c294-4da8-8331-08eef7e6e9b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:47.227449 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4921f0-c294-4da8-8331-08eef7e6e9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:47.227725 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4921f0-c294-4da8-8331-08eef7e6e9b3 admin admin] PATH_INFO: `/v3/projects/25a783f2f92d43639db8c3c5da581a36` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:47.229781 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4921f0-c294-4da8-8331-08eef7e6e9b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25a783f2f92d43639db8c3c5da581a36)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:47.232077 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4921f0-c294-4da8-8331-08eef7e6e9b3 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:47.384775 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5e4921f0-c294-4da8-8331-08eef7e6e9b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25a783f2f92d43639db8c3c5da581a36', 'request_id': 'req-5e4921f0-c294-4da8-8331-08eef7e6e9b3'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:47.392556 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5e4921f0-c294-4da8-8331-08eef7e6e9b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25a783f2f92d43639db8c3c5da581a36', 'request_id': 'req-5e4921f0-c294-4da8-8331-08eef7e6e9b3'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:47.513179 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5e4921f0-c294-4da8-8331-08eef7e6e9b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25a783f2f92d43639db8c3c5da581a36', 'request_id': 'req-5e4921f0-c294-4da8-8331-08eef7e6e9b3'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:47.525957 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5e4921f0-c294-4da8-8331-08eef7e6e9b3 admin admin] The token cache is being invalidate because project 25a783f2f92d43639db8c3c5da581a36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:54:47.526248 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5e4921f0-c294-4da8-8331-08eef7e6e9b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:47.526902 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5e4921f0-c294-4da8-8331-08eef7e6e9b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:47.528407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1278/2568] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:54:47 2022] DELETE /identity/v3/projects/25a783f2f92d43639db8c3c5da581a36 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:54:47.532465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d3997-7653-4c88-8793-0f7d7b4ede22 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:47.542905 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d3997-7653-4c88-8793-0f7d7b4ede22 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:47.560795 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:47.600193 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff53c9-5c91-409b-ba11-d5dd9c5f2cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:47.600946 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff53c9-5c91-409b-ba11-d5dd9c5f2cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:47.601224 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff53c9-5c91-409b-ba11-d5dd9c5f2cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:47.601501 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff53c9-5c91-409b-ba11-d5dd9c5f2cab admin admin] PATH_INFO: `/v3/users/6175beb338634264aa587f77652077b6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:47.602661 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff53c9-5c91-409b-ba11-d5dd9c5f2cab admin admin] RBAC: Authorizing `identity:delete_user(user_id=6175beb338634264aa587f77652077b6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:47.605263 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff53c9-5c91-409b-ba11-d5dd9c5f2cab admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:47.818451 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a3ff53c9-5c91-409b-ba11-d5dd9c5f2cab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6175beb338634264aa587f77652077b6'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:47.931446 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a3ff53c9-5c91-409b-ba11-d5dd9c5f2cab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6175beb338634264aa587f77652077b6'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:47.937398 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a3ff53c9-5c91-409b-ba11-d5dd9c5f2cab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6175beb338634264aa587f77652077b6'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:47.937398 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a3ff53c9-5c91-409b-ba11-d5dd9c5f2cab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6175beb338634264aa587f77652077b6'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:47.945796 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a3ff53c9-5c91-409b-ba11-d5dd9c5f2cab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6175beb338634264aa587f77652077b6'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:47.964090 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1291/2569] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:54:47 2022] DELETE /identity/v3/users/6175beb338634264aa587f77652077b6 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:54:48.473677 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4921f0-c294-4da8-8331-08eef7e6e9b3 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:48.475739 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5e4921f0-c294-4da8-8331-08eef7e6e9b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:48.495583 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4921f0-c294-4da8-8331-08eef7e6e9b3 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:48.564168 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac7377-7c66-4e6e-a0b7-4ef5050d687d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:48.565443 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac7377-7c66-4e6e-a0b7-4ef5050d687d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:48.565730 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac7377-7c66-4e6e-a0b7-4ef5050d687d admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:48.566005 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac7377-7c66-4e6e-a0b7-4ef5050d687d admin admin] PATH_INFO: `/v3/projects/c55124672d6a488b819d76947621c3d8` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:48.567323 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac7377-7c66-4e6e-a0b7-4ef5050d687d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c55124672d6a488b819d76947621c3d8)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:48.569405 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac7377-7c66-4e6e-a0b7-4ef5050d687d admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:48.692234 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:48.710351 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-99ac7377-7c66-4e6e-a0b7-4ef5050d687d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c55124672d6a488b819d76947621c3d8', 'request_id': 'req-99ac7377-7c66-4e6e-a0b7-4ef5050d687d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:48.716311 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-99ac7377-7c66-4e6e-a0b7-4ef5050d687d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c55124672d6a488b819d76947621c3d8', 'request_id': 'req-99ac7377-7c66-4e6e-a0b7-4ef5050d687d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:48.850425 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-99ac7377-7c66-4e6e-a0b7-4ef5050d687d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c55124672d6a488b819d76947621c3d8', 'request_id': 'req-99ac7377-7c66-4e6e-a0b7-4ef5050d687d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:48.864453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-99ac7377-7c66-4e6e-a0b7-4ef5050d687d admin admin] The token cache is being invalidate because project c55124672d6a488b819d76947621c3d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:54:48.864749 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-99ac7377-7c66-4e6e-a0b7-4ef5050d687d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:48.865443 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-99ac7377-7c66-4e6e-a0b7-4ef5050d687d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:48.867041 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1279/2570] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:54:48 2022] DELETE /identity/v3/projects/c55124672d6a488b819d76947621c3d8 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:54:48.873285 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc9f79-c8c3-41f3-a5af-48a6889a5d37 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:48.873841 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc9f79-c8c3-41f3-a5af-48a6889a5d37 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:48.873841 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc9f79-c8c3-41f3-a5af-48a6889a5d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:48.897820 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-efdc9f79-c8c3-41f3-a5af-48a6889a5d37 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:54:48.899061 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-efdc9f79-c8c3-41f3-a5af-48a6889a5d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:48.967823 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1292/2571] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:54:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:54:48.975882 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7042378-189f-47b8-9957-5ad0f857b344 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:48.976265 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7042378-189f-47b8-9957-5ad0f857b344 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:48.976619 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7042378-189f-47b8-9957-5ad0f857b344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:49.011574 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-d7042378-189f-47b8-9957-5ad0f857b344 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:54:49.013782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d7042378-189f-47b8-9957-5ad0f857b344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:49.028117 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1280/2572] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:54:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:54:49.034643 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc9f79-c8c3-41f3-a5af-48a6889a5d37 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:49.052925 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc9f79-c8c3-41f3-a5af-48a6889a5d37 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:49.060280 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf3d22-0194-497d-8b73-7f5ffd6019eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:49.060903 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf3d22-0194-497d-8b73-7f5ffd6019eb admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:49.061182 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf3d22-0194-497d-8b73-7f5ffd6019eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:49.061459 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf3d22-0194-497d-8b73-7f5ffd6019eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:49.062135 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf3d22-0194-497d-8b73-7f5ffd6019eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:54:49.062438 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf3d22-0194-497d-8b73-7f5ffd6019eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:49.064106 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf3d22-0194-497d-8b73-7f5ffd6019eb admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:49.076600 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1293/2573] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:54:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:54:49.081167 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7042378-189f-47b8-9957-5ad0f857b344 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:49.091676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7042378-189f-47b8-9957-5ad0f857b344 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:49.096802 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590cd8e-2af1-40d3-bba4-f6a69fc7b683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:49.097425 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590cd8e-2af1-40d3-bba4-f6a69fc7b683 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:49.097709 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590cd8e-2af1-40d3-bba4-f6a69fc7b683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:49.097988 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590cd8e-2af1-40d3-bba4-f6a69fc7b683 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:49.098646 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590cd8e-2af1-40d3-bba4-f6a69fc7b683 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:49.100605 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590cd8e-2af1-40d3-bba4-f6a69fc7b683 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:49.206340 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1281/2574] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:54:49 2022] POST /identity/v3/projects => generated 369 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:54:49.210532 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf3d22-0194-497d-8b73-7f5ffd6019eb admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:49.227303 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf3d22-0194-497d-8b73-7f5ffd6019eb admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:49.254249 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:49.288145 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2d97e-5ddc-42ca-9a1e-192bd7b985bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:49.288694 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2d97e-5ddc-42ca-9a1e-192bd7b985bb admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:49.289001 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2d97e-5ddc-42ca-9a1e-192bd7b985bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:49.289322 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2d97e-5ddc-42ca-9a1e-192bd7b985bb admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:49.289917 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d2d97e-5ddc-42ca-9a1e-192bd7b985bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:49.291913 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d2d97e-5ddc-42ca-9a1e-192bd7b985bb admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:49.386865 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1294/2575] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:54:49 2022] POST /identity/v3/users => generated 285 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:54:49.394598 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590cd8e-2af1-40d3-bba4-f6a69fc7b683 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:49.406039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590cd8e-2af1-40d3-bba4-f6a69fc7b683 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:49.412288 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f20c4-a7ff-4217-aed7-f44913f7adad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:49.412923 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f20c4-a7ff-4217-aed7-f44913f7adad admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:49.413199 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f20c4-a7ff-4217-aed7-f44913f7adad admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:49.413504 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f20c4-a7ff-4217-aed7-f44913f7adad admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:49.414157 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f20c4-a7ff-4217-aed7-f44913f7adad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:49.415900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f20c4-a7ff-4217-aed7-f44913f7adad admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:49.426880 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1282/2576] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:54:49.431086 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2d97e-5ddc-42ca-9a1e-192bd7b985bb admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:49.442291 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2d97e-5ddc-42ca-9a1e-192bd7b985bb admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:49.447800 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fa97a-e499-4d52-a13e-f11f9f481476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:49.448418 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fa97a-e499-4d52-a13e-f11f9f481476 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:49.448699 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fa97a-e499-4d52-a13e-f11f9f481476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:49.448981 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fa97a-e499-4d52-a13e-f11f9f481476 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:49.449632 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5fa97a-e499-4d52-a13e-f11f9f481476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:49.451229 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5fa97a-e499-4d52-a13e-f11f9f481476 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:49.463098 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1295/2577] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:54:49.467786 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f20c4-a7ff-4217-aed7-f44913f7adad admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:49.478103 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f20c4-a7ff-4217-aed7-f44913f7adad admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:49.482823 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b7c6a-2f94-482a-ad38-4e80b99b3a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:49.483528 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b7c6a-2f94-482a-ad38-4e80b99b3a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:49.483810 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b7c6a-2f94-482a-ad38-4e80b99b3a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:49.484087 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b7c6a-2f94-482a-ad38-4e80b99b3a4a admin admin] PATH_INFO: `/v3/projects/0788326e26de4c32a437d16bf49e1b83/users/cde77b5fbbb3459ba80f826a5fc06e54/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:49.500686 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b7c6a-2f94-482a-ad38-4e80b99b3a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0788326e26de4c32a437d16bf49e1b83, user_id=cde77b5fbbb3459ba80f826a5fc06e54, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:49.503491 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b7c6a-2f94-482a-ad38-4e80b99b3a4a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:49.615264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1283/2578] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:54:49 2022] PUT /identity/v3/projects/0788326e26de4c32a437d16bf49e1b83/users/cde77b5fbbb3459ba80f826a5fc06e54/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:54:49.628507 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d6bf5-7489-4311-9209-c1c1e2f848af None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:49.628886 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d6bf5-7489-4311-9209-c1c1e2f848af None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:49.629163 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d6bf5-7489-4311-9209-c1c1e2f848af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:49.661205 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-905d6bf5-7489-4311-9209-c1c1e2f848af None None] MFA Rules not processed for user `cde77b5fbbb3459ba80f826a5fc06e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:54:49.662616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-905d6bf5-7489-4311-9209-c1c1e2f848af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:49.735313 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1296/2579] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:54:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:54:49.740156 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b7c6a-2f94-482a-ad38-4e80b99b3a4a admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:49.818129 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b7c6a-2f94-482a-ad38-4e80b99b3a4a admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:49.824062 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d179674-b654-4229-9444-8cfe0f0982fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:49.825127 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d179674-b654-4229-9444-8cfe0f0982fc admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:49.825693 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d179674-b654-4229-9444-8cfe0f0982fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:49.826001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d179674-b654-4229-9444-8cfe0f0982fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:49.826947 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d179674-b654-4229-9444-8cfe0f0982fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:49.829438 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d179674-b654-4229-9444-8cfe0f0982fc admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:49.933855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1284/2580] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:54:49 2022] POST /identity/v3/projects => generated 367 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:54:49.935386 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d6bf5-7489-4311-9209-c1c1e2f848af None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:49.959452 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d6bf5-7489-4311-9209-c1c1e2f848af None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:50.024532 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55634dee-9b72-4eee-b19d-a3120b3c4a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:50.025707 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55634dee-9b72-4eee-b19d-a3120b3c4a47 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:50.025989 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55634dee-9b72-4eee-b19d-a3120b3c4a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:50.026262 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55634dee-9b72-4eee-b19d-a3120b3c4a47 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:50.026895 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55634dee-9b72-4eee-b19d-a3120b3c4a47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:50.028951 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55634dee-9b72-4eee-b19d-a3120b3c4a47 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:50.112217 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1297/2581] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:54:49 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:54:50.116258 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d179674-b654-4229-9444-8cfe0f0982fc admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:50.127391 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d179674-b654-4229-9444-8cfe0f0982fc admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:50.135848 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccae551-3444-4644-853d-8ca39f4c015f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:50.135848 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccae551-3444-4644-853d-8ca39f4c015f admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:50.135848 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccae551-3444-4644-853d-8ca39f4c015f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:50.135848 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccae551-3444-4644-853d-8ca39f4c015f admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:50.136248 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccae551-3444-4644-853d-8ca39f4c015f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:50.136248 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccae551-3444-4644-853d-8ca39f4c015f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:50.147722 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1285/2582] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:54:50.152679 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55634dee-9b72-4eee-b19d-a3120b3c4a47 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:50.163072 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55634dee-9b72-4eee-b19d-a3120b3c4a47 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:50.168261 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea06c2-9cd6-4849-9b34-ab0f8da5dc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:50.168901 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea06c2-9cd6-4849-9b34-ab0f8da5dc68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:50.169179 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea06c2-9cd6-4849-9b34-ab0f8da5dc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:50.169453 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea06c2-9cd6-4849-9b34-ab0f8da5dc68 admin admin] PATH_INFO: `/v3/projects/e70a2e0837044eec9ba7cd9b66b1a0ba/users/9d59d5496884437e9fbbec266c8367d2/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:50.184556 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea06c2-9cd6-4849-9b34-ab0f8da5dc68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e70a2e0837044eec9ba7cd9b66b1a0ba, user_id=9d59d5496884437e9fbbec266c8367d2, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:50.187230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea06c2-9cd6-4849-9b34-ab0f8da5dc68 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:50.251905 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1298/2583] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:54:50 2022] PUT /identity/v3/projects/e70a2e0837044eec9ba7cd9b66b1a0ba/users/9d59d5496884437e9fbbec266c8367d2/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:54:50.265463 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea06c2-9cd6-4849-9b34-ab0f8da5dc68 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:50.265636 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccae551-3444-4644-853d-8ca39f4c015f admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:50.268139 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-fcea06c2-9cd6-4849-9b34-ab0f8da5dc68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:50.275519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:50.280699 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccae551-3444-4644-853d-8ca39f4c015f admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:50.306309 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:50.348641 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea06c2-9cd6-4849-9b34-ab0f8da5dc68 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:50.348947 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca017d-6d96-4158-aebe-3b44c6d1c2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:50.349576 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca017d-6d96-4158-aebe-3b44c6d1c2cb admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:50.349862 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca017d-6d96-4158-aebe-3b44c6d1c2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:50.350144 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca017d-6d96-4158-aebe-3b44c6d1c2cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:50.350793 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca017d-6d96-4158-aebe-3b44c6d1c2cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:50.352558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca017d-6d96-4158-aebe-3b44c6d1c2cb admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:50.356751 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdb9e3-43da-4028-ad37-fe57b50cbaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:50.357398 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdb9e3-43da-4028-ad37-fe57b50cbaa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:50.357683 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdb9e3-43da-4028-ad37-fe57b50cbaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:50.357967 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdb9e3-43da-4028-ad37-fe57b50cbaa4 admin admin] PATH_INFO: `/v3/users/d416f3ca9a8a4e569bf3a20847d69dc5` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:50.359132 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cdb9e3-43da-4028-ad37-fe57b50cbaa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d416f3ca9a8a4e569bf3a20847d69dc5)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:50.361327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cdb9e3-43da-4028-ad37-fe57b50cbaa4 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:50.363772 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1286/2584] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:54:50.367659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca017d-6d96-4158-aebe-3b44c6d1c2cb admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:50.382103 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca017d-6d96-4158-aebe-3b44c6d1c2cb admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:50.389924 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7c141-cb3f-46d6-8d1e-abf795054589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:50.390787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7c141-cb3f-46d6-8d1e-abf795054589 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:50.391142 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7c141-cb3f-46d6-8d1e-abf795054589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:50.391469 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7c141-cb3f-46d6-8d1e-abf795054589 admin admin] PATH_INFO: `/v3/projects/e70a2e0837044eec9ba7cd9b66b1a0ba/users/9d59d5496884437e9fbbec266c8367d2/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:50.393477 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7c141-cb3f-46d6-8d1e-abf795054589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e70a2e0837044eec9ba7cd9b66b1a0ba, user_id=9d59d5496884437e9fbbec266c8367d2, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:50.396593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7c141-cb3f-46d6-8d1e-abf795054589 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:50.408192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1287/2585] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:54:50 2022] PUT /identity/v3/projects/e70a2e0837044eec9ba7cd9b66b1a0ba/users/9d59d5496884437e9fbbec266c8367d2/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:54:50.420081 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882f9a9-33c1-4016-a7cc-feb5a076efbe None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:50.420590 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882f9a9-33c1-4016-a7cc-feb5a076efbe None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:50.421350 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882f9a9-33c1-4016-a7cc-feb5a076efbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:50.453773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-e882f9a9-33c1-4016-a7cc-feb5a076efbe None None] MFA Rules not processed for user `9d59d5496884437e9fbbec266c8367d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:54:50.455037 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e882f9a9-33c1-4016-a7cc-feb5a076efbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:50.541170 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1288/2586] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:54:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:54:50.554386 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882f9a9-33c1-4016-a7cc-feb5a076efbe None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:50.555817 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e882f9a9-33c1-4016-a7cc-feb5a076efbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:50.569666 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b7cdb9e3-43da-4028-ad37-fe57b50cbaa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd416f3ca9a8a4e569bf3a20847d69dc5'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:50.621586 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882f9a9-33c1-4016-a7cc-feb5a076efbe None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:50.626393 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d48ff3-99eb-45b4-b34a-b4e2b942adbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:50.627050 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d48ff3-99eb-45b4-b34a-b4e2b942adbd service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:50.627347 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d48ff3-99eb-45b4-b34a-b4e2b942adbd service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:50.627644 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d48ff3-99eb-45b4-b34a-b4e2b942adbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:50.638425 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d48ff3-99eb-45b4-b34a-b4e2b942adbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:50.639919 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d48ff3-99eb-45b4-b34a-b4e2b942adbd service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:50.643141 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b7cdb9e3-43da-4028-ad37-fe57b50cbaa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd416f3ca9a8a4e569bf3a20847d69dc5'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:50.644872 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b7cdb9e3-43da-4028-ad37-fe57b50cbaa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd416f3ca9a8a4e569bf3a20847d69dc5'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:50.646306 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b7cdb9e3-43da-4028-ad37-fe57b50cbaa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd416f3ca9a8a4e569bf3a20847d69dc5'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:50.651583 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1289/2587] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:54:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:54:50.655470 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b7cdb9e3-43da-4028-ad37-fe57b50cbaa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd416f3ca9a8a4e569bf3a20847d69dc5'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:50.682585 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1299/2588] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:54:50 2022] DELETE /identity/v3/users/d416f3ca9a8a4e569bf3a20847d69dc5 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:54:50.692692 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf120e4e-37d3-4fba-a632-7982ad76f84b None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:50.693102 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf120e4e-37d3-4fba-a632-7982ad76f84b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:50.693318 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf120e4e-37d3-4fba-a632-7982ad76f84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:50.716917 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-cf120e4e-37d3-4fba-a632-7982ad76f84b None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:54:50.718157 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-cf120e4e-37d3-4fba-a632-7982ad76f84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:50.751589 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:50.781906 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1290/2589] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:54:50.792376 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdb9e3-43da-4028-ad37-fe57b50cbaa4 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:50.794173 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b7cdb9e3-43da-4028-ad37-fe57b50cbaa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:50.871477 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdb9e3-43da-4028-ad37-fe57b50cbaa4 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:50.875638 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f071ae-35bd-48c3-b1c9-368c87b89846 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:50.876298 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f071ae-35bd-48c3-b1c9-368c87b89846 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:50.876617 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f071ae-35bd-48c3-b1c9-368c87b89846 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:50.876890 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f071ae-35bd-48c3-b1c9-368c87b89846 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:50.887835 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f071ae-35bd-48c3-b1c9-368c87b89846 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:50.889311 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f071ae-35bd-48c3-b1c9-368c87b89846 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:50.900294 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1300/2590] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:54:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:54:51.496182 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf120e4e-37d3-4fba-a632-7982ad76f84b None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:51.497647 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-cf120e4e-37d3-4fba-a632-7982ad76f84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:51.518060 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf120e4e-37d3-4fba-a632-7982ad76f84b None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:51.527924 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347e6de-c7dd-4b83-9e25-993c7ce7615f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:51.529022 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347e6de-c7dd-4b83-9e25-993c7ce7615f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:51.529304 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347e6de-c7dd-4b83-9e25-993c7ce7615f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:51.530181 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347e6de-c7dd-4b83-9e25-993c7ce7615f admin admin] PATH_INFO: `/v3/projects/e173c620ab9147c98e87c8e65e9224bb` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:51.531634 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e347e6de-c7dd-4b83-9e25-993c7ce7615f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e173c620ab9147c98e87c8e65e9224bb)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:51.533666 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e347e6de-c7dd-4b83-9e25-993c7ce7615f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:51.674373 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e347e6de-c7dd-4b83-9e25-993c7ce7615f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e173c620ab9147c98e87c8e65e9224bb', 'request_id': 'req-e347e6de-c7dd-4b83-9e25-993c7ce7615f'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:51.680110 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e347e6de-c7dd-4b83-9e25-993c7ce7615f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e173c620ab9147c98e87c8e65e9224bb', 'request_id': 'req-e347e6de-c7dd-4b83-9e25-993c7ce7615f'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:51.840387 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e347e6de-c7dd-4b83-9e25-993c7ce7615f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e173c620ab9147c98e87c8e65e9224bb', 'request_id': 'req-e347e6de-c7dd-4b83-9e25-993c7ce7615f'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:51.856225 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e347e6de-c7dd-4b83-9e25-993c7ce7615f admin admin] The token cache is being invalidate because project e173c620ab9147c98e87c8e65e9224bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:54:51.856522 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e347e6de-c7dd-4b83-9e25-993c7ce7615f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:51.857405 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e347e6de-c7dd-4b83-9e25-993c7ce7615f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:51.859350 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1291/2591] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:54:51 2022] DELETE /identity/v3/projects/e173c620ab9147c98e87c8e65e9224bb => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:54:51.864486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76785340-9706-4bc0-96a4-30adb7020287 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:51.865347 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76785340-9706-4bc0-96a4-30adb7020287 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:51.865629 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76785340-9706-4bc0-96a4-30adb7020287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:51.887357 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-76785340-9706-4bc0-96a4-30adb7020287 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:54:51.888802 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-76785340-9706-4bc0-96a4-30adb7020287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:51.912899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:51.963028 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1301/2592] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:54:52.033005 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b553c-d871-43dd-96a8-387c578f93e1 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:52.033296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b553c-d871-43dd-96a8-387c578f93e1 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:52.033578 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b553c-d871-43dd-96a8-387c578f93e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:52.054100 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-af4b553c-d871-43dd-96a8-387c578f93e1 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:54:52.055419 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-af4b553c-d871-43dd-96a8-387c578f93e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:52.064076 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1292/2593] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:54:52.068428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76785340-9706-4bc0-96a4-30adb7020287 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:52.079209 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76785340-9706-4bc0-96a4-30adb7020287 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:52.084067 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91144cb0-8937-4c92-b002-63fc998c7cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:52.084726 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91144cb0-8937-4c92-b002-63fc998c7cba admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:52.084964 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91144cb0-8937-4c92-b002-63fc998c7cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:52.085238 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91144cb0-8937-4c92-b002-63fc998c7cba admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:52.085905 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91144cb0-8937-4c92-b002-63fc998c7cba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:54:52.086207 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91144cb0-8937-4c92-b002-63fc998c7cba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:52.087913 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91144cb0-8937-4c92-b002-63fc998c7cba admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:52.100251 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1302/2594] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:54:52.104954 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b553c-d871-43dd-96a8-387c578f93e1 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:52.114592 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b553c-d871-43dd-96a8-387c578f93e1 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:52.124584 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631650e-56e5-4b7a-904f-f65991267e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:52.124584 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631650e-56e5-4b7a-904f-f65991267e68 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:52.124584 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631650e-56e5-4b7a-904f-f65991267e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:52.124584 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631650e-56e5-4b7a-904f-f65991267e68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:52.124973 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631650e-56e5-4b7a-904f-f65991267e68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:52.124973 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631650e-56e5-4b7a-904f-f65991267e68 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:52.248649 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1293/2595] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:54:52 2022] POST /identity/v3/projects => generated 363 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:54:52.254398 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91144cb0-8937-4c92-b002-63fc998c7cba admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:52.269574 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91144cb0-8937-4c92-b002-63fc998c7cba admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:52.348225 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d949e-0d4b-40a6-a0d1-68556fcba799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:52.348962 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d949e-0d4b-40a6-a0d1-68556fcba799 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:52.349320 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d949e-0d4b-40a6-a0d1-68556fcba799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:52.349712 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d949e-0d4b-40a6-a0d1-68556fcba799 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:52.350460 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d949e-0d4b-40a6-a0d1-68556fcba799 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:52.352677 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d949e-0d4b-40a6-a0d1-68556fcba799 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:52.522616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1303/2596] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:54:52 2022] POST /identity/v3/users => generated 282 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:54:52.524020 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631650e-56e5-4b7a-904f-f65991267e68 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:52.539657 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631650e-56e5-4b7a-904f-f65991267e68 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:52.545641 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cba72b-a379-4707-a38e-53b4f0914c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:52.546498 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cba72b-a379-4707-a38e-53b4f0914c2f admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:52.546847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cba72b-a379-4707-a38e-53b4f0914c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:52.547178 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cba72b-a379-4707-a38e-53b4f0914c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:52.547929 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cba72b-a379-4707-a38e-53b4f0914c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:52.553974 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cba72b-a379-4707-a38e-53b4f0914c2f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:52.572401 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1294/2597] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:54:52.576694 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d949e-0d4b-40a6-a0d1-68556fcba799 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:52.588887 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d949e-0d4b-40a6-a0d1-68556fcba799 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:52.595781 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b15e7-4adb-402f-b3c8-fee9049547e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:52.597999 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b15e7-4adb-402f-b3c8-fee9049547e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:52.598490 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b15e7-4adb-402f-b3c8-fee9049547e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:52.599599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b15e7-4adb-402f-b3c8-fee9049547e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:52.600987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b15e7-4adb-402f-b3c8-fee9049547e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:52.603892 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b15e7-4adb-402f-b3c8-fee9049547e8 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:52.619739 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1304/2598] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:54:52.623841 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cba72b-a379-4707-a38e-53b4f0914c2f admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:52.634646 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cba72b-a379-4707-a38e-53b4f0914c2f admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:52.639819 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9e6bb-55e9-44ca-98c5-020258fa060e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:52.640496 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9e6bb-55e9-44ca-98c5-020258fa060e admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:52.640782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9e6bb-55e9-44ca-98c5-020258fa060e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:52.641062 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9e6bb-55e9-44ca-98c5-020258fa060e admin admin] PATH_INFO: `/v3/projects/32bf320247584c40b18400a439217921/users/860de976faec4582b6a6a8153d6d4f3f/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:52.657122 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9e6bb-55e9-44ca-98c5-020258fa060e admin admin] RBAC: Authorizing `identity:create_grant(project_id=32bf320247584c40b18400a439217921, user_id=860de976faec4582b6a6a8153d6d4f3f, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:52.659971 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9e6bb-55e9-44ca-98c5-020258fa060e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:52.779711 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1295/2599] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:54:52 2022] PUT /identity/v3/projects/32bf320247584c40b18400a439217921/users/860de976faec4582b6a6a8153d6d4f3f/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:54:52.791645 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b001d1e-4911-4368-945a-51b7502e81cc None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:52.791938 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b001d1e-4911-4368-945a-51b7502e81cc None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:52.792218 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b001d1e-4911-4368-945a-51b7502e81cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:52.823072 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-3b001d1e-4911-4368-945a-51b7502e81cc None None] MFA Rules not processed for user `860de976faec4582b6a6a8153d6d4f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:54:52.824671 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3b001d1e-4911-4368-945a-51b7502e81cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:52.896710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1305/2600] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:54:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:54:52.910763 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9e6bb-55e9-44ca-98c5-020258fa060e admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:52.914448 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-92d9e6bb-55e9-44ca-98c5-020258fa060e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:53.002786 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9e6bb-55e9-44ca-98c5-020258fa060e admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:53.007114 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26edd3-826d-4828-80e0-6470b471def8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:53.007919 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26edd3-826d-4828-80e0-6470b471def8 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:53.008317 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26edd3-826d-4828-80e0-6470b471def8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:53.008709 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26edd3-826d-4828-80e0-6470b471def8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:53.018643 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26edd3-826d-4828-80e0-6470b471def8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:53.020137 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26edd3-826d-4828-80e0-6470b471def8 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:53.024131 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:53.031523 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1296/2601] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:54:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:54:54.551890 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b001d1e-4911-4368-945a-51b7502e81cc None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:54.555850 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3b001d1e-4911-4368-945a-51b7502e81cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:54.583967 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:54.639169 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b001d1e-4911-4368-945a-51b7502e81cc None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:54.643995 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4530595-eb71-4dd8-829b-7f36b5e758e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:54.644663 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4530595-eb71-4dd8-829b-7f36b5e758e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:54.644946 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4530595-eb71-4dd8-829b-7f36b5e758e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:54.645224 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4530595-eb71-4dd8-829b-7f36b5e758e4 admin admin] PATH_INFO: `/v3/users/cde77b5fbbb3459ba80f826a5fc06e54` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:54.646369 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4530595-eb71-4dd8-829b-7f36b5e758e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cde77b5fbbb3459ba80f826a5fc06e54)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:54.648353 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4530595-eb71-4dd8-829b-7f36b5e758e4 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:54.896677 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b4530595-eb71-4dd8-829b-7f36b5e758e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cde77b5fbbb3459ba80f826a5fc06e54'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:55.003420 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b4530595-eb71-4dd8-829b-7f36b5e758e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cde77b5fbbb3459ba80f826a5fc06e54'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:55.004252 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b4530595-eb71-4dd8-829b-7f36b5e758e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cde77b5fbbb3459ba80f826a5fc06e54'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:55.004985 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b4530595-eb71-4dd8-829b-7f36b5e758e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cde77b5fbbb3459ba80f826a5fc06e54'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:55.017049 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b4530595-eb71-4dd8-829b-7f36b5e758e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cde77b5fbbb3459ba80f826a5fc06e54'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:55.043207 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1306/2602] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:54:54 2022] DELETE /identity/v3/users/cde77b5fbbb3459ba80f826a5fc06e54 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:54:55.048759 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b2b3d-73f3-4aff-bf38-da8c21c73471 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:55.049387 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b2b3d-73f3-4aff-bf38-da8c21c73471 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:55.049387 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b2b3d-73f3-4aff-bf38-da8c21c73471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:55.077690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-371b2b3d-73f3-4aff-bf38-da8c21c73471 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:54:55.077690 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-371b2b3d-73f3-4aff-bf38-da8c21c73471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:55.153094 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1297/2603] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:54:55.164563 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4530595-eb71-4dd8-829b-7f36b5e758e4 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:55.166127 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b4530595-eb71-4dd8-829b-7f36b5e758e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:55.245022 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4530595-eb71-4dd8-829b-7f36b5e758e4 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:55.251828 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3955669-4447-4b3c-8291-cac5d3f32a9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:55.253059 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3955669-4447-4b3c-8291-cac5d3f32a9d service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:55.253554 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3955669-4447-4b3c-8291-cac5d3f32a9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:55.254152 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3955669-4447-4b3c-8291-cac5d3f32a9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:55.268948 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3955669-4447-4b3c-8291-cac5d3f32a9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:55.289802 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3955669-4447-4b3c-8291-cac5d3f32a9d service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:55.289802 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1307/2604] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:54:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:54:55.873932 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b2b3d-73f3-4aff-bf38-da8c21c73471 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:55.873932 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-371b2b3d-73f3-4aff-bf38-da8c21c73471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:55.887569 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b2b3d-73f3-4aff-bf38-da8c21c73471 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:55.897944 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9158c8-be94-404c-971e-56437f65af63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:55.902993 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9158c8-be94-404c-971e-56437f65af63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:55.902993 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9158c8-be94-404c-971e-56437f65af63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:55.902993 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9158c8-be94-404c-971e-56437f65af63 admin admin] PATH_INFO: `/v3/projects/0788326e26de4c32a437d16bf49e1b83` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:55.905502 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9158c8-be94-404c-971e-56437f65af63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0788326e26de4c32a437d16bf49e1b83)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:55.909495 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9158c8-be94-404c-971e-56437f65af63 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:56.113054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0b9158c8-be94-404c-971e-56437f65af63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0788326e26de4c32a437d16bf49e1b83', 'request_id': 'req-0b9158c8-be94-404c-971e-56437f65af63'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:56.123640 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0b9158c8-be94-404c-971e-56437f65af63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0788326e26de4c32a437d16bf49e1b83', 'request_id': 'req-0b9158c8-be94-404c-971e-56437f65af63'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:56.199586 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0b9158c8-be94-404c-971e-56437f65af63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0788326e26de4c32a437d16bf49e1b83', 'request_id': 'req-0b9158c8-be94-404c-971e-56437f65af63'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:56.218036 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0b9158c8-be94-404c-971e-56437f65af63 admin admin] The token cache is being invalidate because project 0788326e26de4c32a437d16bf49e1b83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:54:56.218606 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0b9158c8-be94-404c-971e-56437f65af63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:56.219572 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0b9158c8-be94-404c-971e-56437f65af63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:56.222392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1298/2605] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:54:55 2022] DELETE /identity/v3/projects/0788326e26de4c32a437d16bf49e1b83 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:54:56.227507 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3955669-4447-4b3c-8291-cac5d3f32a9d service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:56.243713 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3955669-4447-4b3c-8291-cac5d3f32a9d service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:56.299700 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:56.329461 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098be929-7002-4b6d-b1c6-65ecb5888b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:56.330127 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098be929-7002-4b6d-b1c6-65ecb5888b9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:56.330431 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098be929-7002-4b6d-b1c6-65ecb5888b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:56.330709 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098be929-7002-4b6d-b1c6-65ecb5888b9d admin admin] PATH_INFO: `/v3/users/9d59d5496884437e9fbbec266c8367d2` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:56.332016 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098be929-7002-4b6d-b1c6-65ecb5888b9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d59d5496884437e9fbbec266c8367d2)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:56.334048 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098be929-7002-4b6d-b1c6-65ecb5888b9d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:56.656460 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-098be929-7002-4b6d-b1c6-65ecb5888b9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d59d5496884437e9fbbec266c8367d2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:56.736297 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-098be929-7002-4b6d-b1c6-65ecb5888b9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d59d5496884437e9fbbec266c8367d2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:56.737421 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-098be929-7002-4b6d-b1c6-65ecb5888b9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d59d5496884437e9fbbec266c8367d2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:56.737582 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-098be929-7002-4b6d-b1c6-65ecb5888b9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d59d5496884437e9fbbec266c8367d2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:56.745646 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-098be929-7002-4b6d-b1c6-65ecb5888b9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d59d5496884437e9fbbec266c8367d2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:56.765111 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1308/2606] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:54:56 2022] DELETE /identity/v3/users/9d59d5496884437e9fbbec266c8367d2 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:54:57.207207 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9158c8-be94-404c-971e-56437f65af63 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:57.208928 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-0b9158c8-be94-404c-971e-56437f65af63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:57.225381 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9158c8-be94-404c-971e-56437f65af63 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:57.285022 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027f671-9a8c-4c43-af5c-39858cf7e601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:57.285683 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027f671-9a8c-4c43-af5c-39858cf7e601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:57.286011 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027f671-9a8c-4c43-af5c-39858cf7e601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:57.286314 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027f671-9a8c-4c43-af5c-39858cf7e601 admin admin] PATH_INFO: `/v3/projects/e70a2e0837044eec9ba7cd9b66b1a0ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:57.287486 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027f671-9a8c-4c43-af5c-39858cf7e601 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e70a2e0837044eec9ba7cd9b66b1a0ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:57.289480 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027f671-9a8c-4c43-af5c-39858cf7e601 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:57.317565 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:57.441072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8027f671-9a8c-4c43-af5c-39858cf7e601 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e70a2e0837044eec9ba7cd9b66b1a0ba', 'request_id': 'req-8027f671-9a8c-4c43-af5c-39858cf7e601'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:57.452254 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8027f671-9a8c-4c43-af5c-39858cf7e601 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e70a2e0837044eec9ba7cd9b66b1a0ba', 'request_id': 'req-8027f671-9a8c-4c43-af5c-39858cf7e601'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:57.580910 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8027f671-9a8c-4c43-af5c-39858cf7e601 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e70a2e0837044eec9ba7cd9b66b1a0ba', 'request_id': 'req-8027f671-9a8c-4c43-af5c-39858cf7e601'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:57.594792 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8027f671-9a8c-4c43-af5c-39858cf7e601 admin admin] The token cache is being invalidate because project e70a2e0837044eec9ba7cd9b66b1a0ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:54:57.595107 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8027f671-9a8c-4c43-af5c-39858cf7e601 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:57.595809 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8027f671-9a8c-4c43-af5c-39858cf7e601 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:54:57.597384 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1299/2607] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:54:57 2022] DELETE /identity/v3/projects/e70a2e0837044eec9ba7cd9b66b1a0ba => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:54:57.602565 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b84532-74fa-46a9-b509-2a840c11b9a8 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:57.603162 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b84532-74fa-46a9-b509-2a840c11b9a8 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:57.603627 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b84532-74fa-46a9-b509-2a840c11b9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:57.623324 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-63b84532-74fa-46a9-b509-2a840c11b9a8 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:54:57.624569 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-63b84532-74fa-46a9-b509-2a840c11b9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:57.701800 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1309/2608] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:54:57.711232 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd4f23-8455-4252-946d-c5098c8b4a06 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:57.711995 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd4f23-8455-4252-946d-c5098c8b4a06 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:57.712144 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd4f23-8455-4252-946d-c5098c8b4a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:57.734413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-6dbd4f23-8455-4252-946d-c5098c8b4a06 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:54:57.735695 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6dbd4f23-8455-4252-946d-c5098c8b4a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:57.744105 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1300/2609] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:54:57.748537 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b84532-74fa-46a9-b509-2a840c11b9a8 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:57.759808 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b84532-74fa-46a9-b509-2a840c11b9a8 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:57.766332 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf2911-53f0-4cb8-bcb0-2a3ac1ac357d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:57.770601 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf2911-53f0-4cb8-bcb0-2a3ac1ac357d admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:57.770601 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf2911-53f0-4cb8-bcb0-2a3ac1ac357d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:57.770601 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf2911-53f0-4cb8-bcb0-2a3ac1ac357d admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:57.770601 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf2911-53f0-4cb8-bcb0-2a3ac1ac357d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:54:57.770601 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf2911-53f0-4cb8-bcb0-2a3ac1ac357d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:57.770601 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf2911-53f0-4cb8-bcb0-2a3ac1ac357d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:57.783462 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1310/2610] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:54:57.788119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd4f23-8455-4252-946d-c5098c8b4a06 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:57.803876 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd4f23-8455-4252-946d-c5098c8b4a06 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:57.805493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c483c4-db64-44ed-8797-bca9c54d7af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:57.806131 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c483c4-db64-44ed-8797-bca9c54d7af7 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:57.806407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c483c4-db64-44ed-8797-bca9c54d7af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:57.806675 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c483c4-db64-44ed-8797-bca9c54d7af7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:57.807950 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c483c4-db64-44ed-8797-bca9c54d7af7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:57.810489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c483c4-db64-44ed-8797-bca9c54d7af7 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:57.926951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1301/2611] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:54:57 2022] POST /identity/v3/projects => generated 367 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:54:57.931430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf2911-53f0-4cb8-bcb0-2a3ac1ac357d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:57.948137 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf2911-53f0-4cb8-bcb0-2a3ac1ac357d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:58.005300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:58.017504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c35bc4-4511-4c86-8f63-88b36ec2c8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:58.018580 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c35bc4-4511-4c86-8f63-88b36ec2c8ed admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:58.018580 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c35bc4-4511-4c86-8f63-88b36ec2c8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:58.018812 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c35bc4-4511-4c86-8f63-88b36ec2c8ed admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:58.019342 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c35bc4-4511-4c86-8f63-88b36ec2c8ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:58.021342 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c35bc4-4511-4c86-8f63-88b36ec2c8ed admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:58.175127 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1311/2612] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:54:57 2022] POST /identity/v3/users => generated 284 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:54:58.179494 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c483c4-db64-44ed-8797-bca9c54d7af7 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:58.190163 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c483c4-db64-44ed-8797-bca9c54d7af7 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:58.194804 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7081fd7-0c78-442b-9ed8-aa41d19738e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:58.195495 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7081fd7-0c78-442b-9ed8-aa41d19738e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:58.195823 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7081fd7-0c78-442b-9ed8-aa41d19738e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:58.196113 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7081fd7-0c78-442b-9ed8-aa41d19738e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:58.196813 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7081fd7-0c78-442b-9ed8-aa41d19738e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:58.198549 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7081fd7-0c78-442b-9ed8-aa41d19738e8 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:58.209722 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1302/2613] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:54:58.215121 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c35bc4-4511-4c86-8f63-88b36ec2c8ed admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:58.225772 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c35bc4-4511-4c86-8f63-88b36ec2c8ed admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:58.231404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cded027-9375-4272-b3c2-53b515a9cec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:58.235194 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cded027-9375-4272-b3c2-53b515a9cec2 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:58.235194 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cded027-9375-4272-b3c2-53b515a9cec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:58.235194 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cded027-9375-4272-b3c2-53b515a9cec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:58.235194 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cded027-9375-4272-b3c2-53b515a9cec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:58.235194 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cded027-9375-4272-b3c2-53b515a9cec2 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:58.246230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1312/2614] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:54:58.250718 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7081fd7-0c78-442b-9ed8-aa41d19738e8 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:58.262012 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7081fd7-0c78-442b-9ed8-aa41d19738e8 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:58.266783 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e2b0c-9e40-4e16-9b65-8171510bc11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:58.267372 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e2b0c-9e40-4e16-9b65-8171510bc11f admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:58.267670 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e2b0c-9e40-4e16-9b65-8171510bc11f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:58.270404 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e2b0c-9e40-4e16-9b65-8171510bc11f admin admin] PATH_INFO: `/v3/projects/19396c4a38ec4767aa7b603e530846a3/users/81d53b54ff85480b93ece8d63e2149c6/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:58.286495 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e2b0c-9e40-4e16-9b65-8171510bc11f admin admin] RBAC: Authorizing `identity:create_grant(project_id=19396c4a38ec4767aa7b603e530846a3, user_id=81d53b54ff85480b93ece8d63e2149c6, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:58.289730 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e2b0c-9e40-4e16-9b65-8171510bc11f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:58.397701 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1303/2615] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:54:58 2022] PUT /identity/v3/projects/19396c4a38ec4767aa7b603e530846a3/users/81d53b54ff85480b93ece8d63e2149c6/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:54:58.408795 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ca1de-7f97-4de0-ae95-2bc9ea6e9c73 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:58.409084 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ca1de-7f97-4de0-ae95-2bc9ea6e9c73 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:58.409363 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ca1de-7f97-4de0-ae95-2bc9ea6e9c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:58.444598 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-076ca1de-7f97-4de0-ae95-2bc9ea6e9c73 None None] MFA Rules not processed for user `81d53b54ff85480b93ece8d63e2149c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:54:58.444598 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-076ca1de-7f97-4de0-ae95-2bc9ea6e9c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:58.527991 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1313/2616] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:54:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:54:58.529270 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e2b0c-9e40-4e16-9b65-8171510bc11f admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:58.606299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e2b0c-9e40-4e16-9b65-8171510bc11f admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:58.612153 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600cf87-caec-44a7-a00a-d3d1923824af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:58.612830 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600cf87-caec-44a7-a00a-d3d1923824af admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:58.613111 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600cf87-caec-44a7-a00a-d3d1923824af admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:58.613389 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600cf87-caec-44a7-a00a-d3d1923824af admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:58.614056 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600cf87-caec-44a7-a00a-d3d1923824af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:58.616083 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600cf87-caec-44a7-a00a-d3d1923824af admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:58.721860 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1304/2617] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:54:58 2022] POST /identity/v3/projects => generated 367 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:54:58.726471 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ca1de-7f97-4de0-ae95-2bc9ea6e9c73 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:58.746603 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ca1de-7f97-4de0-ae95-2bc9ea6e9c73 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:58.821924 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8412bd-73b9-4908-a068-2f083e58745a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:58.822542 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8412bd-73b9-4908-a068-2f083e58745a admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:58.823411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8412bd-73b9-4908-a068-2f083e58745a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:58.823690 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8412bd-73b9-4908-a068-2f083e58745a admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:58.824542 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8412bd-73b9-4908-a068-2f083e58745a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:58.826421 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8412bd-73b9-4908-a068-2f083e58745a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:58.949257 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1314/2618] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:54:58 2022] POST /identity/v3/users => generated 290 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:54:58.953248 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600cf87-caec-44a7-a00a-d3d1923824af admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:58.964209 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600cf87-caec-44a7-a00a-d3d1923824af admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:58.969326 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e966561-4d1a-4c11-8489-46de3c6eaba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:58.969993 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e966561-4d1a-4c11-8489-46de3c6eaba9 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:58.970278 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e966561-4d1a-4c11-8489-46de3c6eaba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:58.970557 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e966561-4d1a-4c11-8489-46de3c6eaba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:58.971221 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e966561-4d1a-4c11-8489-46de3c6eaba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:58.972911 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e966561-4d1a-4c11-8489-46de3c6eaba9 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:58.991726 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1305/2619] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:54:58.996860 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8412bd-73b9-4908-a068-2f083e58745a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:59.009259 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8412bd-73b9-4908-a068-2f083e58745a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:59.015044 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e659595-c497-4a83-8e60-3d22a0c3c86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:59.015790 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e659595-c497-4a83-8e60-3d22a0c3c86e admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:59.016100 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e659595-c497-4a83-8e60-3d22a0c3c86e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:59.016365 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e659595-c497-4a83-8e60-3d22a0c3c86e admin admin] PATH_INFO: `/v3/projects/7458461544ef49bdbf7698c5adc7c48b/users/7cdfc3adf4554ed587c1c31a87a1ef2d/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:59.045759 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e659595-c497-4a83-8e60-3d22a0c3c86e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7458461544ef49bdbf7698c5adc7c48b, user_id=7cdfc3adf4554ed587c1c31a87a1ef2d, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:59.048696 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e659595-c497-4a83-8e60-3d22a0c3c86e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:59.156627 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1315/2620] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:54:58 2022] PUT /identity/v3/projects/7458461544ef49bdbf7698c5adc7c48b/users/7cdfc3adf4554ed587c1c31a87a1ef2d/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:54:59.158801 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e966561-4d1a-4c11-8489-46de3c6eaba9 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:59.170621 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e966561-4d1a-4c11-8489-46de3c6eaba9 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:59.194082 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:59.246855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2cda3-d06e-4ce7-821b-156220274372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:59.247654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2cda3-d06e-4ce7-821b-156220274372 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:59.247889 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2cda3-d06e-4ce7-821b-156220274372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:59.248171 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2cda3-d06e-4ce7-821b-156220274372 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:59.248828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2cda3-d06e-4ce7-821b-156220274372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:59.250462 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2cda3-d06e-4ce7-821b-156220274372 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:59.262399 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1306/2621] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:54:59.267488 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e659595-c497-4a83-8e60-3d22a0c3c86e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:59.280798 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e659595-c497-4a83-8e60-3d22a0c3c86e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:59.285779 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b0890-ba9d-4f9c-b22e-8c2ad3f16cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:59.286469 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b0890-ba9d-4f9c-b22e-8c2ad3f16cd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:59.286757 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b0890-ba9d-4f9c-b22e-8c2ad3f16cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:59.287018 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b0890-ba9d-4f9c-b22e-8c2ad3f16cd1 admin admin] PATH_INFO: `/v3/projects/7458461544ef49bdbf7698c5adc7c48b/users/7cdfc3adf4554ed587c1c31a87a1ef2d/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:59.289198 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b0890-ba9d-4f9c-b22e-8c2ad3f16cd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7458461544ef49bdbf7698c5adc7c48b, user_id=7cdfc3adf4554ed587c1c31a87a1ef2d, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:59.292753 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b0890-ba9d-4f9c-b22e-8c2ad3f16cd1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:59.306268 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1316/2622] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:54:59 2022] PUT /identity/v3/projects/7458461544ef49bdbf7698c5adc7c48b/users/7cdfc3adf4554ed587c1c31a87a1ef2d/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:54:59.318373 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a93dc-7eae-4146-86a4-acdca29da617 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:59.318669 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a93dc-7eae-4146-86a4-acdca29da617 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:59.318975 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a93dc-7eae-4146-86a4-acdca29da617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:59.355264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-113a93dc-7eae-4146-86a4-acdca29da617 None None] MFA Rules not processed for user `7cdfc3adf4554ed587c1c31a87a1ef2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:54:59.356768 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-113a93dc-7eae-4146-86a4-acdca29da617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:59.460447 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1307/2623] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:54:59 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:54:59.474170 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b0890-ba9d-4f9c-b22e-8c2ad3f16cd1 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:59.474170 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-429b0890-ba9d-4f9c-b22e-8c2ad3f16cd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:59.487565 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:59.561487 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b0890-ba9d-4f9c-b22e-8c2ad3f16cd1 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:59.567196 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19554fe9-be92-456f-b237-c21c3b6da90b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:59.568080 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19554fe9-be92-456f-b237-c21c3b6da90b service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:59.568594 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19554fe9-be92-456f-b237-c21c3b6da90b service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:59.568874 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19554fe9-be92-456f-b237-c21c3b6da90b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:59.579631 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19554fe9-be92-456f-b237-c21c3b6da90b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:59.581164 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19554fe9-be92-456f-b237-c21c3b6da90b service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:59.593112 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1317/2624] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:54:59 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:54:59.769342 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a93dc-7eae-4146-86a4-acdca29da617 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:54:59.774543 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-113a93dc-7eae-4146-86a4-acdca29da617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:54:59.783017 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a93dc-7eae-4146-86a4-acdca29da617 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:54:59.786751 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bdb6c2-1e85-4131-952e-7c2f2daa6a51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:54:59.787391 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdb6c2-1e85-4131-952e-7c2f2daa6a51 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:54:59.787676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdb6c2-1e85-4131-952e-7c2f2daa6a51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:54:59.787951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdb6c2-1e85-4131-952e-7c2f2daa6a51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:54:59.855583 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bdb6c2-1e85-4131-952e-7c2f2daa6a51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:54:59.857268 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bdb6c2-1e85-4131-952e-7c2f2daa6a51 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:54:59.868010 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1308/2625] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:54:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:55:03.886955 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19554fe9-be92-456f-b237-c21c3b6da90b service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:03.889224 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-19554fe9-be92-456f-b237-c21c3b6da90b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:04.084554 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19554fe9-be92-456f-b237-c21c3b6da90b service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:04.093226 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8cc773-96dc-4ed6-8e8d-80a2f1a62ce6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a48c49f7a9f44cef89dd024fecea422f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:04.094349 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cc773-96dc-4ed6-8e8d-80a2f1a62ce6 service placement] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:04.094349 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cc773-96dc-4ed6-8e8d-80a2f1a62ce6 service placement] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:04.094616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cc773-96dc-4ed6-8e8d-80a2f1a62ce6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:04.096651 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5a8cc773-96dc-4ed6-8e8d-80a2f1a62ce6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:04.116989 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8cc773-96dc-4ed6-8e8d-80a2f1a62ce6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:04.119952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8cc773-96dc-4ed6-8e8d-80a2f1a62ce6 service placement] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:04.134449 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1318/2626] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:55:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:55:05.608073 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bdb6c2-1e85-4131-952e-7c2f2daa6a51 service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:05.672828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:05.686494 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bdb6c2-1e85-4131-952e-7c2f2daa6a51 service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:05.696995 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36613fd-a6d5-4a0f-9b68-960d533ca16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:05.698230 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36613fd-a6d5-4a0f-9b68-960d533ca16e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:05.700906 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36613fd-a6d5-4a0f-9b68-960d533ca16e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:05.700906 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36613fd-a6d5-4a0f-9b68-960d533ca16e admin admin] PATH_INFO: `/v3/users/81d53b54ff85480b93ece8d63e2149c6` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:05.700906 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36613fd-a6d5-4a0f-9b68-960d533ca16e admin admin] RBAC: Authorizing `identity:delete_user(user_id=81d53b54ff85480b93ece8d63e2149c6)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:05.701910 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36613fd-a6d5-4a0f-9b68-960d533ca16e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:05.846559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f5833-4782-4808-8f8f-aa76b2025668 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:05.847701 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f5833-4782-4808-8f8f-aa76b2025668 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:05.847701 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f5833-4782-4808-8f8f-aa76b2025668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:05.873493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-123f5833-4782-4808-8f8f-aa76b2025668 None None] MFA Rules not processed for user `9f2b2835fdcd46e491e246799abd402b`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:55:05.874722 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-123f5833-4782-4808-8f8f-aa76b2025668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:05.929714 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1319/2627] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:55:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:55:05.950607 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a36613fd-a6d5-4a0f-9b68-960d533ca16e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81d53b54ff85480b93ece8d63e2149c6'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:05.951360 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a36613fd-a6d5-4a0f-9b68-960d533ca16e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81d53b54ff85480b93ece8d63e2149c6'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:05.961660 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a36613fd-a6d5-4a0f-9b68-960d533ca16e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81d53b54ff85480b93ece8d63e2149c6'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:05.962378 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a36613fd-a6d5-4a0f-9b68-960d533ca16e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81d53b54ff85480b93ece8d63e2149c6'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:06.039166 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a36613fd-a6d5-4a0f-9b68-960d533ca16e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81d53b54ff85480b93ece8d63e2149c6'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:06.065462 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1309/2628] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:55:05 2022] DELETE /identity/v3/users/81d53b54ff85480b93ece8d63e2149c6 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:55:06.070200 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b555d4-1ccb-4216-a6df-236edd1ac454 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:06.070484 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b555d4-1ccb-4216-a6df-236edd1ac454 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:06.070755 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b555d4-1ccb-4216-a6df-236edd1ac454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:06.094958 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f3b555d4-1ccb-4216-a6df-236edd1ac454 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:55:06.096117 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f3b555d4-1ccb-4216-a6df-236edd1ac454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:06.118542 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:06.166817 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1320/2629] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:55:06.178914 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36613fd-a6d5-4a0f-9b68-960d533ca16e admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:06.181247 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-a36613fd-a6d5-4a0f-9b68-960d533ca16e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:06.272878 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36613fd-a6d5-4a0f-9b68-960d533ca16e admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:06.276765 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be79e5-a0fb-4012-8fb6-ec0468a9aa01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:06.277460 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be79e5-a0fb-4012-8fb6-ec0468a9aa01 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:06.277886 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be79e5-a0fb-4012-8fb6-ec0468a9aa01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:06.278162 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be79e5-a0fb-4012-8fb6-ec0468a9aa01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:06.289065 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be79e5-a0fb-4012-8fb6-ec0468a9aa01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:06.290854 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be79e5-a0fb-4012-8fb6-ec0468a9aa01 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:06.303781 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1310/2630] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:55:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:55:06.788079 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b555d4-1ccb-4216-a6df-236edd1ac454 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:06.789782 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f3b555d4-1ccb-4216-a6df-236edd1ac454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:06.803583 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b555d4-1ccb-4216-a6df-236edd1ac454 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:06.808795 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd3b06-95f1-41e8-af13-f76d94d9d8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:06.814573 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd3b06-95f1-41e8-af13-f76d94d9d8da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:06.814573 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd3b06-95f1-41e8-af13-f76d94d9d8da admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:06.814573 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd3b06-95f1-41e8-af13-f76d94d9d8da admin admin] PATH_INFO: `/v3/projects/19396c4a38ec4767aa7b603e530846a3` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:06.814573 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd3b06-95f1-41e8-af13-f76d94d9d8da admin admin] RBAC: Authorizing `identity:delete_project(project_id=19396c4a38ec4767aa7b603e530846a3)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:06.814573 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd3b06-95f1-41e8-af13-f76d94d9d8da admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:06.959088 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-bdfd3b06-95f1-41e8-af13-f76d94d9d8da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19396c4a38ec4767aa7b603e530846a3', 'request_id': 'req-bdfd3b06-95f1-41e8-af13-f76d94d9d8da'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:06.973054 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-bdfd3b06-95f1-41e8-af13-f76d94d9d8da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19396c4a38ec4767aa7b603e530846a3', 'request_id': 'req-bdfd3b06-95f1-41e8-af13-f76d94d9d8da'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:07.039081 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-bdfd3b06-95f1-41e8-af13-f76d94d9d8da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19396c4a38ec4767aa7b603e530846a3', 'request_id': 'req-bdfd3b06-95f1-41e8-af13-f76d94d9d8da'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:07.051718 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-bdfd3b06-95f1-41e8-af13-f76d94d9d8da admin admin] The token cache is being invalidate because project 19396c4a38ec4767aa7b603e530846a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:55:07.052017 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-bdfd3b06-95f1-41e8-af13-f76d94d9d8da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:07.052733 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-bdfd3b06-95f1-41e8-af13-f76d94d9d8da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:07.054273 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1321/2631] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:55:06 2022] DELETE /identity/v3/projects/19396c4a38ec4767aa7b603e530846a3 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:55:07.059479 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be79e5-a0fb-4012-8fb6-ec0468a9aa01 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:07.069748 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be79e5-a0fb-4012-8fb6-ec0468a9aa01 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:07.130283 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85beebb3-8666-4d57-89a9-df025591a5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:07.130843 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85beebb3-8666-4d57-89a9-df025591a5cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:07.131128 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85beebb3-8666-4d57-89a9-df025591a5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:07.131440 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85beebb3-8666-4d57-89a9-df025591a5cd admin admin] PATH_INFO: `/v3/users/7cdfc3adf4554ed587c1c31a87a1ef2d` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:07.132576 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85beebb3-8666-4d57-89a9-df025591a5cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cdfc3adf4554ed587c1c31a87a1ef2d)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:07.134497 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85beebb3-8666-4d57-89a9-df025591a5cd admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:07.139892 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:07.464236 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-85beebb3-8666-4d57-89a9-df025591a5cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cdfc3adf4554ed587c1c31a87a1ef2d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:07.465166 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-85beebb3-8666-4d57-89a9-df025591a5cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cdfc3adf4554ed587c1c31a87a1ef2d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:07.472252 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-85beebb3-8666-4d57-89a9-df025591a5cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cdfc3adf4554ed587c1c31a87a1ef2d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:07.472921 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-85beebb3-8666-4d57-89a9-df025591a5cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cdfc3adf4554ed587c1c31a87a1ef2d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:07.559059 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-85beebb3-8666-4d57-89a9-df025591a5cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cdfc3adf4554ed587c1c31a87a1ef2d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:07.576491 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1311/2632] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:55:07 2022] DELETE /identity/v3/users/7cdfc3adf4554ed587c1c31a87a1ef2d => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:55:08.053419 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd3b06-95f1-41e8-af13-f76d94d9d8da admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:08.055947 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-bdfd3b06-95f1-41e8-af13-f76d94d9d8da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:08.071964 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd3b06-95f1-41e8-af13-f76d94d9d8da admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:08.140241 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd650235-0435-4d7f-aaad-1160dfa441ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:08.140875 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd650235-0435-4d7f-aaad-1160dfa441ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:08.141154 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd650235-0435-4d7f-aaad-1160dfa441ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:08.141430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd650235-0435-4d7f-aaad-1160dfa441ce admin admin] PATH_INFO: `/v3/projects/7458461544ef49bdbf7698c5adc7c48b` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:08.142549 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd650235-0435-4d7f-aaad-1160dfa441ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=7458461544ef49bdbf7698c5adc7c48b)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:08.144493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd650235-0435-4d7f-aaad-1160dfa441ce admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:08.293482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-bd650235-0435-4d7f-aaad-1160dfa441ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7458461544ef49bdbf7698c5adc7c48b', 'request_id': 'req-bd650235-0435-4d7f-aaad-1160dfa441ce'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:08.295582 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:08.299570 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-bd650235-0435-4d7f-aaad-1160dfa441ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7458461544ef49bdbf7698c5adc7c48b', 'request_id': 'req-bd650235-0435-4d7f-aaad-1160dfa441ce'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:08.387430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-bd650235-0435-4d7f-aaad-1160dfa441ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7458461544ef49bdbf7698c5adc7c48b', 'request_id': 'req-bd650235-0435-4d7f-aaad-1160dfa441ce'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:08.398831 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-bd650235-0435-4d7f-aaad-1160dfa441ce admin admin] The token cache is being invalidate because project 7458461544ef49bdbf7698c5adc7c48b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:55:08.399146 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-bd650235-0435-4d7f-aaad-1160dfa441ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:08.399851 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-bd650235-0435-4d7f-aaad-1160dfa441ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:08.401382 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1322/2633] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:55:08 2022] DELETE /identity/v3/projects/7458461544ef49bdbf7698c5adc7c48b => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:55:08.406511 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4128f11-560a-4217-9c2a-0bf0870014a8 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:08.406988 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4128f11-560a-4217-9c2a-0bf0870014a8 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:08.407084 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4128f11-560a-4217-9c2a-0bf0870014a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:08.427036 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-b4128f11-560a-4217-9c2a-0bf0870014a8 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:55:08.428351 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b4128f11-560a-4217-9c2a-0bf0870014a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:08.496885 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1312/2634] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:55:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:55:08.507198 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b48ec-1b2f-4db1-8ed4-4e8c1b38d2fa None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:08.507533 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b48ec-1b2f-4db1-8ed4-4e8c1b38d2fa None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:08.507828 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b48ec-1b2f-4db1-8ed4-4e8c1b38d2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:08.530016 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f60b48ec-1b2f-4db1-8ed4-4e8c1b38d2fa None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:55:08.531488 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f60b48ec-1b2f-4db1-8ed4-4e8c1b38d2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:08.540990 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1323/2635] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:55:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:55:08.545874 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4128f11-560a-4217-9c2a-0bf0870014a8 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:08.555648 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4128f11-560a-4217-9c2a-0bf0870014a8 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:08.561155 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7a760-2e72-4c92-bbdd-db07f0885ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:08.561803 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7a760-2e72-4c92-bbdd-db07f0885ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:08.562082 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7a760-2e72-4c92-bbdd-db07f0885ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:08.562407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7a760-2e72-4c92-bbdd-db07f0885ed3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:08.563235 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d7a760-2e72-4c92-bbdd-db07f0885ed3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:55:08.563566 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d7a760-2e72-4c92-bbdd-db07f0885ed3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:08.565170 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d7a760-2e72-4c92-bbdd-db07f0885ed3 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:08.579501 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1313/2636] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:55:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:55:08.583994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b48ec-1b2f-4db1-8ed4-4e8c1b38d2fa None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:08.594623 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b48ec-1b2f-4db1-8ed4-4e8c1b38d2fa None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:08.599789 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336141d-af50-40fa-b72d-261173a1c74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:08.600379 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336141d-af50-40fa-b72d-261173a1c74b admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:08.600663 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336141d-af50-40fa-b72d-261173a1c74b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:08.600930 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336141d-af50-40fa-b72d-261173a1c74b admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:08.601583 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336141d-af50-40fa-b72d-261173a1c74b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:08.603679 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336141d-af50-40fa-b72d-261173a1c74b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:08.745143 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1324/2637] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:55:08 2022] POST /identity/v3/projects => generated 401 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:55:08.750416 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7a760-2e72-4c92-bbdd-db07f0885ed3 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:08.761772 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7a760-2e72-4c92-bbdd-db07f0885ed3 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:08.823521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1434c22-76fe-445a-aaf7-323c42f829a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:08.824066 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1434c22-76fe-445a-aaf7-323c42f829a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:08.824364 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1434c22-76fe-445a-aaf7-323c42f829a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:08.824637 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1434c22-76fe-445a-aaf7-323c42f829a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:08.825289 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1434c22-76fe-445a-aaf7-323c42f829a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:08.827548 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1434c22-76fe-445a-aaf7-323c42f829a5 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:08.909069 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:08.914524 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1314/2638] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:55:08 2022] POST /identity/v3/users => generated 301 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:55:08.923989 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336141d-af50-40fa-b72d-261173a1c74b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:08.935393 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336141d-af50-40fa-b72d-261173a1c74b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:08.940779 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b4db5-381c-4ede-94ef-3227773e287c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:08.941431 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b4db5-381c-4ede-94ef-3227773e287c admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:08.941711 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b4db5-381c-4ede-94ef-3227773e287c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:08.941984 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b4db5-381c-4ede-94ef-3227773e287c admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:08.942665 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b4db5-381c-4ede-94ef-3227773e287c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:08.944513 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b4db5-381c-4ede-94ef-3227773e287c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:08.956553 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1325/2639] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:55:08.961420 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1434c22-76fe-445a-aaf7-323c42f829a5 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:08.971960 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1434c22-76fe-445a-aaf7-323c42f829a5 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:08.977839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3173016-8baf-465f-94ab-94c2ef29c481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:08.979043 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3173016-8baf-465f-94ab-94c2ef29c481 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:08.979432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3173016-8baf-465f-94ab-94c2ef29c481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:08.984928 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3173016-8baf-465f-94ab-94c2ef29c481 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:08.984928 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3173016-8baf-465f-94ab-94c2ef29c481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:08.984928 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3173016-8baf-465f-94ab-94c2ef29c481 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:08.993291 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1315/2640] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:55:08.997997 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b4db5-381c-4ede-94ef-3227773e287c admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:09.009346 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b4db5-381c-4ede-94ef-3227773e287c admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:09.014672 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9abee7-75d8-4a85-befd-be9da08f0641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:09.015368 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9abee7-75d8-4a85-befd-be9da08f0641 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:09.017953 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9abee7-75d8-4a85-befd-be9da08f0641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:09.017953 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9abee7-75d8-4a85-befd-be9da08f0641 admin admin] PATH_INFO: `/v3/projects/7a24c4acb8f445a1b74664afc10ab51c/users/070713db42354986b41956797f6a3fb5/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:09.031403 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9abee7-75d8-4a85-befd-be9da08f0641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a24c4acb8f445a1b74664afc10ab51c, user_id=070713db42354986b41956797f6a3fb5, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:09.034317 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9abee7-75d8-4a85-befd-be9da08f0641 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:09.118914 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1326/2641] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:55:08 2022] PUT /identity/v3/projects/7a24c4acb8f445a1b74664afc10ab51c/users/070713db42354986b41956797f6a3fb5/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:55:09.129315 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62cb4b-cf1c-4bd0-a3b5-6a4dec66978f None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:09.129608 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62cb4b-cf1c-4bd0-a3b5-6a4dec66978f None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:09.129915 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62cb4b-cf1c-4bd0-a3b5-6a4dec66978f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:09.169799 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-7a62cb4b-cf1c-4bd0-a3b5-6a4dec66978f None None] MFA Rules not processed for user `070713db42354986b41956797f6a3fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:55:09.174493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7a62cb4b-cf1c-4bd0-a3b5-6a4dec66978f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:09.264720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1316/2642] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:55:09 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:55:09.265780 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9abee7-75d8-4a85-befd-be9da08f0641 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:09.361289 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9abee7-75d8-4a85-befd-be9da08f0641 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:09.371571 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853dfaa3-cff1-455a-bf5a-a45cc830f2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:09.371962 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dfaa3-cff1-455a-bf5a-a45cc830f2fa admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:09.372472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dfaa3-cff1-455a-bf5a-a45cc830f2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:09.372940 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dfaa3-cff1-455a-bf5a-a45cc830f2fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:09.374232 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853dfaa3-cff1-455a-bf5a-a45cc830f2fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:09.378293 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853dfaa3-cff1-455a-bf5a-a45cc830f2fa admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:09.524215 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1327/2643] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:55:09 2022] POST /identity/v3/projects => generated 401 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:55:09.528940 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62cb4b-cf1c-4bd0-a3b5-6a4dec66978f None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:09.540310 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62cb4b-cf1c-4bd0-a3b5-6a4dec66978f None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:09.601042 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f291b-d4f4-43ff-990e-b4f06acfa660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:09.601593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f291b-d4f4-43ff-990e-b4f06acfa660 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:09.601878 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f291b-d4f4-43ff-990e-b4f06acfa660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:09.602157 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f291b-d4f4-43ff-990e-b4f06acfa660 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:09.602890 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f291b-d4f4-43ff-990e-b4f06acfa660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:09.605708 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f291b-d4f4-43ff-990e-b4f06acfa660 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:09.716152 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1317/2644] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:55:09 2022] POST /identity/v3/users => generated 307 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:55:09.721026 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853dfaa3-cff1-455a-bf5a-a45cc830f2fa admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:09.731893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853dfaa3-cff1-455a-bf5a-a45cc830f2fa admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:09.737151 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b207bd2-58e8-4f54-8d38-f1ba9567d693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:09.737771 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b207bd2-58e8-4f54-8d38-f1ba9567d693 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:09.738052 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b207bd2-58e8-4f54-8d38-f1ba9567d693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:09.738326 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b207bd2-58e8-4f54-8d38-f1ba9567d693 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:09.738982 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b207bd2-58e8-4f54-8d38-f1ba9567d693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:09.740645 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b207bd2-58e8-4f54-8d38-f1ba9567d693 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:09.755117 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1328/2645] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:55:09.760711 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f291b-d4f4-43ff-990e-b4f06acfa660 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:09.773488 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f291b-d4f4-43ff-990e-b4f06acfa660 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:09.779000 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b40ce-f403-43c3-85d3-2cb0076d0d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:09.780007 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b40ce-f403-43c3-85d3-2cb0076d0d6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:09.780180 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b40ce-f403-43c3-85d3-2cb0076d0d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:09.780353 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b40ce-f403-43c3-85d3-2cb0076d0d6e admin admin] PATH_INFO: `/v3/projects/82b3cce7194b42508df9db8209487aeb/users/c96a3c1b194c4e52b89da93acbe46973/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:09.798772 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b40ce-f403-43c3-85d3-2cb0076d0d6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=82b3cce7194b42508df9db8209487aeb, user_id=c96a3c1b194c4e52b89da93acbe46973, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:09.801908 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b40ce-f403-43c3-85d3-2cb0076d0d6e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:09.948642 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1318/2646] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:55:09 2022] PUT /identity/v3/projects/82b3cce7194b42508df9db8209487aeb/users/c96a3c1b194c4e52b89da93acbe46973/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:55:09.953073 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b207bd2-58e8-4f54-8d38-f1ba9567d693 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:09.965611 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b207bd2-58e8-4f54-8d38-f1ba9567d693 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:10.037113 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:10.048295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52baf057-9ee2-4040-9795-760e6ff77bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:10.048881 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52baf057-9ee2-4040-9795-760e6ff77bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:10.049156 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52baf057-9ee2-4040-9795-760e6ff77bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:10.049425 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52baf057-9ee2-4040-9795-760e6ff77bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:10.050072 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52baf057-9ee2-4040-9795-760e6ff77bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:10.051734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52baf057-9ee2-4040-9795-760e6ff77bc7 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:10.063476 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1329/2647] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:55:10.069490 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b40ce-f403-43c3-85d3-2cb0076d0d6e admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:10.081057 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b40ce-f403-43c3-85d3-2cb0076d0d6e admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:10.086085 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dc14e-2bd2-4944-a418-5d0ecc6a351d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:10.086751 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dc14e-2bd2-4944-a418-5d0ecc6a351d admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:10.087070 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dc14e-2bd2-4944-a418-5d0ecc6a351d admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:10.087403 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dc14e-2bd2-4944-a418-5d0ecc6a351d admin admin] PATH_INFO: `/v3/projects/82b3cce7194b42508df9db8209487aeb/users/c96a3c1b194c4e52b89da93acbe46973/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:10.089348 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8dc14e-2bd2-4944-a418-5d0ecc6a351d admin admin] RBAC: Authorizing `identity:create_grant(project_id=82b3cce7194b42508df9db8209487aeb, user_id=c96a3c1b194c4e52b89da93acbe46973, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:10.092359 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8dc14e-2bd2-4944-a418-5d0ecc6a351d admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:10.103340 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1319/2648] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:55:10 2022] PUT /identity/v3/projects/82b3cce7194b42508df9db8209487aeb/users/c96a3c1b194c4e52b89da93acbe46973/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:55:10.118553 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52189c12-e61e-47cb-b5a3-4316943737cc None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:10.118917 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52189c12-e61e-47cb-b5a3-4316943737cc None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:10.119823 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52189c12-e61e-47cb-b5a3-4316943737cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:10.150828 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-52189c12-e61e-47cb-b5a3-4316943737cc None None] MFA Rules not processed for user `c96a3c1b194c4e52b89da93acbe46973`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:55:10.152342 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-52189c12-e61e-47cb-b5a3-4316943737cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:10.252273 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1330/2649] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:55:10 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:55:10.265512 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dc14e-2bd2-4944-a418-5d0ecc6a351d admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:10.267368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1e8dc14e-2bd2-4944-a418-5d0ecc6a351d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:10.324350 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:10.360706 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dc14e-2bd2-4944-a418-5d0ecc6a351d admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:10.365387 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5e3dd-90b7-427c-9553-6d1f7ebff317 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:10.366037 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5e3dd-90b7-427c-9553-6d1f7ebff317 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:10.366443 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5e3dd-90b7-427c-9553-6d1f7ebff317 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:10.366722 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5e3dd-90b7-427c-9553-6d1f7ebff317 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:10.383665 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5e3dd-90b7-427c-9553-6d1f7ebff317 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:10.385364 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5e3dd-90b7-427c-9553-6d1f7ebff317 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:10.398100 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1320/2650] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:55:10 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:55:10.662745 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52189c12-e61e-47cb-b5a3-4316943737cc None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:10.680431 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52189c12-e61e-47cb-b5a3-4316943737cc None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:10.684374 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e5c81-6a9b-4fc9-a93e-2104dd3e2333 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:10.684998 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e5c81-6a9b-4fc9-a93e-2104dd3e2333 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:10.685276 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e5c81-6a9b-4fc9-a93e-2104dd3e2333 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:10.685622 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e5c81-6a9b-4fc9-a93e-2104dd3e2333 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:10.778539 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e5c81-6a9b-4fc9-a93e-2104dd3e2333 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:10.780193 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e5c81-6a9b-4fc9-a93e-2104dd3e2333 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:10.793421 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1331/2651] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:55:10 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:55:16.215894 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5e3dd-90b7-427c-9553-6d1f7ebff317 service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:16.291897 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5e3dd-90b7-427c-9553-6d1f7ebff317 service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:16.299623 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfac1af-f8b4-4947-b5ec-e7cf3b33b849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:16.300297 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfac1af-f8b4-4947-b5ec-e7cf3b33b849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:16.300583 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfac1af-f8b4-4947-b5ec-e7cf3b33b849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:16.300858 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfac1af-f8b4-4947-b5ec-e7cf3b33b849 admin admin] PATH_INFO: `/v3/users/070713db42354986b41956797f6a3fb5` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:16.302053 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfac1af-f8b4-4947-b5ec-e7cf3b33b849 admin admin] RBAC: Authorizing `identity:delete_user(user_id=070713db42354986b41956797f6a3fb5)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:16.304093 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfac1af-f8b4-4947-b5ec-e7cf3b33b849 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:16.596180 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ddfac1af-f8b4-4947-b5ec-e7cf3b33b849 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '070713db42354986b41956797f6a3fb5'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:16.596850 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ddfac1af-f8b4-4947-b5ec-e7cf3b33b849 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '070713db42354986b41956797f6a3fb5'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:16.604438 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ddfac1af-f8b4-4947-b5ec-e7cf3b33b849 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '070713db42354986b41956797f6a3fb5'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:16.605110 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ddfac1af-f8b4-4947-b5ec-e7cf3b33b849 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '070713db42354986b41956797f6a3fb5'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:16.757406 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ddfac1af-f8b4-4947-b5ec-e7cf3b33b849 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '070713db42354986b41956797f6a3fb5'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:16.777462 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1321/2652] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:55:16 2022] DELETE /identity/v3/users/070713db42354986b41956797f6a3fb5 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:55:16.785135 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5349a-1a92-40e2-be73-810706b29df6 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:16.785680 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5349a-1a92-40e2-be73-810706b29df6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:16.785680 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5349a-1a92-40e2-be73-810706b29df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:16.806811 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-84f5349a-1a92-40e2-be73-810706b29df6 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:55:16.807980 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-84f5349a-1a92-40e2-be73-810706b29df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:16.881013 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1332/2653] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:55:16.891068 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfac1af-f8b4-4947-b5ec-e7cf3b33b849 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:16.894964 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ddfac1af-f8b4-4947-b5ec-e7cf3b33b849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:16.957168 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfac1af-f8b4-4947-b5ec-e7cf3b33b849 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:16.960947 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8758c39-470a-44e4-88b2-10f94861767e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:16.961568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8758c39-470a-44e4-88b2-10f94861767e service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:16.961847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8758c39-470a-44e4-88b2-10f94861767e service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:16.962137 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8758c39-470a-44e4-88b2-10f94861767e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:16.972028 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:16.980199 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8758c39-470a-44e4-88b2-10f94861767e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:16.980199 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8758c39-470a-44e4-88b2-10f94861767e service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:16.986824 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1322/2654] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:55:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:55:17.589389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5349a-1a92-40e2-be73-810706b29df6 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:17.591403 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-84f5349a-1a92-40e2-be73-810706b29df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:17.605712 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5349a-1a92-40e2-be73-810706b29df6 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:17.617683 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043bb59-c1d7-4c4f-9c59-ca4fc77dac3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:17.618664 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043bb59-c1d7-4c4f-9c59-ca4fc77dac3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:17.620316 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043bb59-c1d7-4c4f-9c59-ca4fc77dac3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:17.621006 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043bb59-c1d7-4c4f-9c59-ca4fc77dac3f admin admin] PATH_INFO: `/v3/projects/7a24c4acb8f445a1b74664afc10ab51c` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:17.622192 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043bb59-c1d7-4c4f-9c59-ca4fc77dac3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a24c4acb8f445a1b74664afc10ab51c)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:17.624170 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043bb59-c1d7-4c4f-9c59-ca4fc77dac3f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:17.633596 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:17.761625 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5043bb59-c1d7-4c4f-9c59-ca4fc77dac3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a24c4acb8f445a1b74664afc10ab51c', 'request_id': 'req-5043bb59-c1d7-4c4f-9c59-ca4fc77dac3f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:17.767435 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5043bb59-c1d7-4c4f-9c59-ca4fc77dac3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a24c4acb8f445a1b74664afc10ab51c', 'request_id': 'req-5043bb59-c1d7-4c4f-9c59-ca4fc77dac3f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:17.863595 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5043bb59-c1d7-4c4f-9c59-ca4fc77dac3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a24c4acb8f445a1b74664afc10ab51c', 'request_id': 'req-5043bb59-c1d7-4c4f-9c59-ca4fc77dac3f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:17.880512 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5043bb59-c1d7-4c4f-9c59-ca4fc77dac3f admin admin] The token cache is being invalidate because project 7a24c4acb8f445a1b74664afc10ab51c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:55:17.880512 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5043bb59-c1d7-4c4f-9c59-ca4fc77dac3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:17.880512 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5043bb59-c1d7-4c4f-9c59-ca4fc77dac3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:17.880512 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1333/2655] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:55:17 2022] DELETE /identity/v3/projects/7a24c4acb8f445a1b74664afc10ab51c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:55:17.888319 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8758c39-470a-44e4-88b2-10f94861767e service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:17.898428 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8758c39-470a-44e4-88b2-10f94861767e service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:17.960883 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2eade8-250c-4b72-b1e0-5f9f5e0ac4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:17.961537 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2eade8-250c-4b72-b1e0-5f9f5e0ac4ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:17.961819 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2eade8-250c-4b72-b1e0-5f9f5e0ac4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:17.962091 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2eade8-250c-4b72-b1e0-5f9f5e0ac4ef admin admin] PATH_INFO: `/v3/users/c96a3c1b194c4e52b89da93acbe46973` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:17.963870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2eade8-250c-4b72-b1e0-5f9f5e0ac4ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=c96a3c1b194c4e52b89da93acbe46973)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:17.966091 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2eade8-250c-4b72-b1e0-5f9f5e0ac4ef admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:18.203195 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4a2eade8-250c-4b72-b1e0-5f9f5e0ac4ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c96a3c1b194c4e52b89da93acbe46973'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:18.203830 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4a2eade8-250c-4b72-b1e0-5f9f5e0ac4ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c96a3c1b194c4e52b89da93acbe46973'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:18.213883 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4a2eade8-250c-4b72-b1e0-5f9f5e0ac4ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c96a3c1b194c4e52b89da93acbe46973'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:18.215410 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4a2eade8-250c-4b72-b1e0-5f9f5e0ac4ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c96a3c1b194c4e52b89da93acbe46973'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:18.307813 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4a2eade8-250c-4b72-b1e0-5f9f5e0ac4ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c96a3c1b194c4e52b89da93acbe46973'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:18.327734 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1323/2656] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:55:17 2022] DELETE /identity/v3/users/c96a3c1b194c4e52b89da93acbe46973 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:55:18.789767 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043bb59-c1d7-4c4f-9c59-ca4fc77dac3f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:18.792082 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5043bb59-c1d7-4c4f-9c59-ca4fc77dac3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:18.812977 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043bb59-c1d7-4c4f-9c59-ca4fc77dac3f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:18.883167 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72e6ce-0959-40de-aca4-7b825ce4b3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:18.883930 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72e6ce-0959-40de-aca4-7b825ce4b3a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:18.884112 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72e6ce-0959-40de-aca4-7b825ce4b3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:18.884389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72e6ce-0959-40de-aca4-7b825ce4b3a1 admin admin] PATH_INFO: `/v3/projects/82b3cce7194b42508df9db8209487aeb` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:18.885585 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72e6ce-0959-40de-aca4-7b825ce4b3a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82b3cce7194b42508df9db8209487aeb)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:18.887537 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72e6ce-0959-40de-aca4-7b825ce4b3a1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:19.015986 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1f72e6ce-0959-40de-aca4-7b825ce4b3a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82b3cce7194b42508df9db8209487aeb', 'request_id': 'req-1f72e6ce-0959-40de-aca4-7b825ce4b3a1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:19.022393 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1f72e6ce-0959-40de-aca4-7b825ce4b3a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82b3cce7194b42508df9db8209487aeb', 'request_id': 'req-1f72e6ce-0959-40de-aca4-7b825ce4b3a1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:19.118845 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1f72e6ce-0959-40de-aca4-7b825ce4b3a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82b3cce7194b42508df9db8209487aeb', 'request_id': 'req-1f72e6ce-0959-40de-aca4-7b825ce4b3a1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:19.131013 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1f72e6ce-0959-40de-aca4-7b825ce4b3a1 admin admin] The token cache is being invalidate because project 82b3cce7194b42508df9db8209487aeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:55:19.131334 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1f72e6ce-0959-40de-aca4-7b825ce4b3a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:19.132339 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1f72e6ce-0959-40de-aca4-7b825ce4b3a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:19.134174 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1334/2657] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:55:18 2022] DELETE /identity/v3/projects/82b3cce7194b42508df9db8209487aeb => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:55:19.140109 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6bb74-6ef2-4c1c-b77a-1d119bf611d7 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:19.140643 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6bb74-6ef2-4c1c-b77a-1d119bf611d7 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:19.140643 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6bb74-6ef2-4c1c-b77a-1d119bf611d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:19.162881 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-b8a6bb74-6ef2-4c1c-b77a-1d119bf611d7 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:55:19.164120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b8a6bb74-6ef2-4c1c-b77a-1d119bf611d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:19.234508 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1324/2658] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:55:19.242563 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb1b99-8987-4556-bf1e-95b2f24d9f0d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:19.242855 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb1b99-8987-4556-bf1e-95b2f24d9f0d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:19.243136 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb1b99-8987-4556-bf1e-95b2f24d9f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:19.265738 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-6abb1b99-8987-4556-bf1e-95b2f24d9f0d None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:55:19.267020 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6abb1b99-8987-4556-bf1e-95b2f24d9f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:19.276483 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1335/2659] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:55:19.280984 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6bb74-6ef2-4c1c-b77a-1d119bf611d7 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:19.290928 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6bb74-6ef2-4c1c-b77a-1d119bf611d7 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:19.296428 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec7f13-f139-46e6-82e0-2776ecc5eea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:19.297049 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec7f13-f139-46e6-82e0-2776ecc5eea6 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:19.297476 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec7f13-f139-46e6-82e0-2776ecc5eea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:19.297595 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec7f13-f139-46e6-82e0-2776ecc5eea6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:19.298264 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec7f13-f139-46e6-82e0-2776ecc5eea6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:55:19.298574 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec7f13-f139-46e6-82e0-2776ecc5eea6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:19.300291 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec7f13-f139-46e6-82e0-2776ecc5eea6 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:19.312640 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1325/2660] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:55:19.317155 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb1b99-8987-4556-bf1e-95b2f24d9f0d None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:19.327158 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb1b99-8987-4556-bf1e-95b2f24d9f0d None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:19.332082 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad6d13-4117-4ea6-9efe-72ad2aa7a480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:19.332682 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad6d13-4117-4ea6-9efe-72ad2aa7a480 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:19.332963 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad6d13-4117-4ea6-9efe-72ad2aa7a480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:19.333234 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad6d13-4117-4ea6-9efe-72ad2aa7a480 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:19.333872 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad6d13-4117-4ea6-9efe-72ad2aa7a480 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:19.335903 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad6d13-4117-4ea6-9efe-72ad2aa7a480 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:19.355633 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:19.470362 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1336/2661] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:55:19 2022] POST /identity/v3/projects => generated 367 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:55:19.474866 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec7f13-f139-46e6-82e0-2776ecc5eea6 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:19.482676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:19.489104 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec7f13-f139-46e6-82e0-2776ecc5eea6 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:19.556512 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156af660-2a16-4946-be68-b2b30c02f026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:19.557150 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156af660-2a16-4946-be68-b2b30c02f026 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:19.557436 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156af660-2a16-4946-be68-b2b30c02f026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:19.557833 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156af660-2a16-4946-be68-b2b30c02f026 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:19.558369 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156af660-2a16-4946-be68-b2b30c02f026 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:19.560361 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156af660-2a16-4946-be68-b2b30c02f026 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:19.706487 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1326/2662] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:55:19 2022] POST /identity/v3/users => generated 284 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:55:19.712439 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad6d13-4117-4ea6-9efe-72ad2aa7a480 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:19.724116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad6d13-4117-4ea6-9efe-72ad2aa7a480 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:19.729937 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27c700-d8c9-41f1-abb0-5679273e0ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:19.730612 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27c700-d8c9-41f1-abb0-5679273e0ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:19.730943 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27c700-d8c9-41f1-abb0-5679273e0ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:19.731295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27c700-d8c9-41f1-abb0-5679273e0ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:19.732001 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27c700-d8c9-41f1-abb0-5679273e0ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:19.733923 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27c700-d8c9-41f1-abb0-5679273e0ce5 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:19.745347 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1337/2663] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:55:19.749583 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156af660-2a16-4946-be68-b2b30c02f026 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:19.763443 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156af660-2a16-4946-be68-b2b30c02f026 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:19.768372 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfbb68-a31b-49c4-860a-3990eea2a7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:19.768986 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfbb68-a31b-49c4-860a-3990eea2a7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:19.769269 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfbb68-a31b-49c4-860a-3990eea2a7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:19.769545 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfbb68-a31b-49c4-860a-3990eea2a7e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:19.770187 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfbb68-a31b-49c4-860a-3990eea2a7e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:19.771865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfbb68-a31b-49c4-860a-3990eea2a7e4 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:19.789361 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1327/2664] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:55:19.793703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27c700-d8c9-41f1-abb0-5679273e0ce5 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:19.804125 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27c700-d8c9-41f1-abb0-5679273e0ce5 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:19.809572 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85184b36-5263-447b-b15e-1774206b9df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:19.810228 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85184b36-5263-447b-b15e-1774206b9df3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:19.810511 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85184b36-5263-447b-b15e-1774206b9df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:19.810793 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85184b36-5263-447b-b15e-1774206b9df3 admin admin] PATH_INFO: `/v3/projects/d33bc76be30846cb93d755fce644137b/users/324f38a5fa9948fbbd1fb414e64d6b8c/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:19.828320 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85184b36-5263-447b-b15e-1774206b9df3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d33bc76be30846cb93d755fce644137b, user_id=324f38a5fa9948fbbd1fb414e64d6b8c, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:19.831030 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85184b36-5263-447b-b15e-1774206b9df3 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:19.896526 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1338/2665] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:55:19 2022] PUT /identity/v3/projects/d33bc76be30846cb93d755fce644137b/users/324f38a5fa9948fbbd1fb414e64d6b8c/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:55:19.908114 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645785fe-f32f-4018-82ba-67fdd69f2b02 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:19.908114 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645785fe-f32f-4018-82ba-67fdd69f2b02 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:19.908114 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645785fe-f32f-4018-82ba-67fdd69f2b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:19.940246 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-645785fe-f32f-4018-82ba-67fdd69f2b02 None None] MFA Rules not processed for user `324f38a5fa9948fbbd1fb414e64d6b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:55:19.941481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-645785fe-f32f-4018-82ba-67fdd69f2b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:20.018063 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1328/2666] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:55:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:55:20.022771 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85184b36-5263-447b-b15e-1774206b9df3 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:20.106646 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85184b36-5263-447b-b15e-1774206b9df3 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:20.122976 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c3738-f467-4823-8c6f-aefa1f09db88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:20.123699 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c3738-f467-4823-8c6f-aefa1f09db88 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:20.123980 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c3738-f467-4823-8c6f-aefa1f09db88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:20.124258 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c3738-f467-4823-8c6f-aefa1f09db88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:20.124926 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c3738-f467-4823-8c6f-aefa1f09db88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:20.126946 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c3738-f467-4823-8c6f-aefa1f09db88 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:20.272342 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1339/2667] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:55:20 2022] POST /identity/v3/projects => generated 367 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:55:20.274007 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645785fe-f32f-4018-82ba-67fdd69f2b02 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:20.287237 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645785fe-f32f-4018-82ba-67fdd69f2b02 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:20.350922 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0e38a-88fa-4496-a10c-0b4998e936dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:20.351567 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0e38a-88fa-4496-a10c-0b4998e936dc admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:20.351852 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0e38a-88fa-4496-a10c-0b4998e936dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:20.352120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0e38a-88fa-4496-a10c-0b4998e936dc admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:20.352760 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0e38a-88fa-4496-a10c-0b4998e936dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:20.355744 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0e38a-88fa-4496-a10c-0b4998e936dc admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:20.467676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:20.473824 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1329/2668] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:55:20 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:55:20.477874 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c3738-f467-4823-8c6f-aefa1f09db88 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:20.490003 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c3738-f467-4823-8c6f-aefa1f09db88 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:20.495061 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e6bc0-3145-4f3f-819f-fb2d5953dc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:20.495713 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e6bc0-3145-4f3f-819f-fb2d5953dc6a admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:20.496145 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e6bc0-3145-4f3f-819f-fb2d5953dc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:20.496428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e6bc0-3145-4f3f-819f-fb2d5953dc6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:20.497088 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e6bc0-3145-4f3f-819f-fb2d5953dc6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:20.498736 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e6bc0-3145-4f3f-819f-fb2d5953dc6a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:20.510704 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1340/2669] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:55:20.514871 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0e38a-88fa-4496-a10c-0b4998e936dc admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:20.526248 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0e38a-88fa-4496-a10c-0b4998e936dc admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:20.530984 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f9db4-296c-4958-bbc5-b984320dcf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:20.531765 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f9db4-296c-4958-bbc5-b984320dcf3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:20.531988 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f9db4-296c-4958-bbc5-b984320dcf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:20.532266 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f9db4-296c-4958-bbc5-b984320dcf3f admin admin] PATH_INFO: `/v3/projects/bf99518d183b4c6d91d78b1adfd62d8c/users/779cb0c3d0444ec3a70c53d0daf56a46/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:20.550204 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f9db4-296c-4958-bbc5-b984320dcf3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf99518d183b4c6d91d78b1adfd62d8c, user_id=779cb0c3d0444ec3a70c53d0daf56a46, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:20.552858 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f9db4-296c-4958-bbc5-b984320dcf3f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:20.652559 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1330/2670] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:55:20 2022] PUT /identity/v3/projects/bf99518d183b4c6d91d78b1adfd62d8c/users/779cb0c3d0444ec3a70c53d0daf56a46/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:55:20.655582 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e6bc0-3145-4f3f-819f-fb2d5953dc6a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:20.667205 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e6bc0-3145-4f3f-819f-fb2d5953dc6a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:20.743945 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf8abc-a061-4f21-b0ec-96e20d4c8aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:20.744753 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf8abc-a061-4f21-b0ec-96e20d4c8aff admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:20.745186 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf8abc-a061-4f21-b0ec-96e20d4c8aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:20.745464 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf8abc-a061-4f21-b0ec-96e20d4c8aff admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:20.746115 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badf8abc-a061-4f21-b0ec-96e20d4c8aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:20.748345 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badf8abc-a061-4f21-b0ec-96e20d4c8aff admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:20.759519 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1341/2671] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:55:20.764370 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f9db4-296c-4958-bbc5-b984320dcf3f admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:20.774929 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f9db4-296c-4958-bbc5-b984320dcf3f admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:20.780315 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ac1c2-c37c-4eb8-be0f-bcf473544d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:20.780906 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ac1c2-c37c-4eb8-be0f-bcf473544d57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:20.781182 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ac1c2-c37c-4eb8-be0f-bcf473544d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:20.781456 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ac1c2-c37c-4eb8-be0f-bcf473544d57 admin admin] PATH_INFO: `/v3/projects/bf99518d183b4c6d91d78b1adfd62d8c/users/779cb0c3d0444ec3a70c53d0daf56a46/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:20.783529 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ac1c2-c37c-4eb8-be0f-bcf473544d57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf99518d183b4c6d91d78b1adfd62d8c, user_id=779cb0c3d0444ec3a70c53d0daf56a46, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:20.786263 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ac1c2-c37c-4eb8-be0f-bcf473544d57 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:20.800431 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1331/2672] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:55:20 2022] PUT /identity/v3/projects/bf99518d183b4c6d91d78b1adfd62d8c/users/779cb0c3d0444ec3a70c53d0daf56a46/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:55:20.876061 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2dcc58-bbaa-461f-b729-4fe218a1e08d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:20.876514 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2dcc58-bbaa-461f-b729-4fe218a1e08d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:20.876961 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2dcc58-bbaa-461f-b729-4fe218a1e08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:20.921213 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2d2dcc58-bbaa-461f-b729-4fe218a1e08d None None] MFA Rules not processed for user `779cb0c3d0444ec3a70c53d0daf56a46`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:55:20.922580 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2d2dcc58-bbaa-461f-b729-4fe218a1e08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:20.948338 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:21.012221 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1342/2673] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:55:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:55:21.024963 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ac1c2-c37c-4eb8-be0f-bcf473544d57 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:21.028252 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f11ac1c2-c37c-4eb8-be0f-bcf473544d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:21.096088 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ac1c2-c37c-4eb8-be0f-bcf473544d57 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:21.099857 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7d7d1-9b6e-418b-b91a-0f3500d9da34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:21.100467 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7d7d1-9b6e-418b-b91a-0f3500d9da34 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:21.100746 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7d7d1-9b6e-418b-b91a-0f3500d9da34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:21.101017 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7d7d1-9b6e-418b-b91a-0f3500d9da34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:21.110732 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d7d7d1-9b6e-418b-b91a-0f3500d9da34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:21.112238 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d7d7d1-9b6e-418b-b91a-0f3500d9da34 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:21.123354 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1332/2674] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:55:21 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:55:21.420625 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2dcc58-bbaa-461f-b729-4fe218a1e08d None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:21.431039 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2dcc58-bbaa-461f-b729-4fe218a1e08d None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:21.435882 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229f268-c674-4c34-ac6c-062f6fee14ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:21.437071 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229f268-c674-4c34-ac6c-062f6fee14ae service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:21.437071 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229f268-c674-4c34-ac6c-062f6fee14ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:21.437286 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229f268-c674-4c34-ac6c-062f6fee14ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:21.507599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229f268-c674-4c34-ac6c-062f6fee14ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:21.509058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229f268-c674-4c34-ac6c-062f6fee14ae service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:21.518151 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1343/2675] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:55:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:55:28.396884 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7d7d1-9b6e-418b-b91a-0f3500d9da34 service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:28.459122 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7d7d1-9b6e-418b-b91a-0f3500d9da34 service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:28.464361 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7157c-249d-4e9d-905e-9fbffe09a8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:28.464988 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7157c-249d-4e9d-905e-9fbffe09a8cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:28.465568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7157c-249d-4e9d-905e-9fbffe09a8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:28.465845 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7157c-249d-4e9d-905e-9fbffe09a8cc admin admin] PATH_INFO: `/v3/users/324f38a5fa9948fbbd1fb414e64d6b8c` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:28.466979 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7157c-249d-4e9d-905e-9fbffe09a8cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=324f38a5fa9948fbbd1fb414e64d6b8c)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:28.468933 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7157c-249d-4e9d-905e-9fbffe09a8cc admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:28.686898 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d1f7157c-249d-4e9d-905e-9fbffe09a8cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '324f38a5fa9948fbbd1fb414e64d6b8c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:28.687575 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d1f7157c-249d-4e9d-905e-9fbffe09a8cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '324f38a5fa9948fbbd1fb414e64d6b8c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:28.696844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d1f7157c-249d-4e9d-905e-9fbffe09a8cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '324f38a5fa9948fbbd1fb414e64d6b8c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:28.699574 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d1f7157c-249d-4e9d-905e-9fbffe09a8cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '324f38a5fa9948fbbd1fb414e64d6b8c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:28.792484 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d1f7157c-249d-4e9d-905e-9fbffe09a8cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '324f38a5fa9948fbbd1fb414e64d6b8c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:28.797782 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:28.811625 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1333/2676] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:55:28 2022] DELETE /identity/v3/users/324f38a5fa9948fbbd1fb414e64d6b8c => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:55:28.816110 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd0fd4-11de-42ac-94a0-b9cccc955e43 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:28.816606 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd0fd4-11de-42ac-94a0-b9cccc955e43 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:28.816713 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd0fd4-11de-42ac-94a0-b9cccc955e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:28.835929 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2cbd0fd4-11de-42ac-94a0-b9cccc955e43 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:55:28.837150 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2cbd0fd4-11de-42ac-94a0-b9cccc955e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:28.898891 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1344/2677] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:55:28.908758 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7157c-249d-4e9d-905e-9fbffe09a8cc admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:28.910197 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d1f7157c-249d-4e9d-905e-9fbffe09a8cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:28.971654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7157c-249d-4e9d-905e-9fbffe09a8cc admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:28.975648 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54140ac9-efe8-42c4-ade8-ef9f4894f851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:28.977558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54140ac9-efe8-42c4-ade8-ef9f4894f851 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:28.977558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54140ac9-efe8-42c4-ade8-ef9f4894f851 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:28.977558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54140ac9-efe8-42c4-ade8-ef9f4894f851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:28.986910 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54140ac9-efe8-42c4-ade8-ef9f4894f851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:28.988388 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54140ac9-efe8-42c4-ade8-ef9f4894f851 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:28.999593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1334/2678] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:55:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:55:29.411305 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd0fd4-11de-42ac-94a0-b9cccc955e43 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:29.412758 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2cbd0fd4-11de-42ac-94a0-b9cccc955e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:29.424984 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd0fd4-11de-42ac-94a0-b9cccc955e43 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:29.429878 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c5e67-3c67-4d2e-af14-5e28f88ce1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:29.430569 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c5e67-3c67-4d2e-af14-5e28f88ce1b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:29.431470 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c5e67-3c67-4d2e-af14-5e28f88ce1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:29.431470 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c5e67-3c67-4d2e-af14-5e28f88ce1b2 admin admin] PATH_INFO: `/v3/projects/d33bc76be30846cb93d755fce644137b` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:29.432290 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c5e67-3c67-4d2e-af14-5e28f88ce1b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d33bc76be30846cb93d755fce644137b)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:29.434328 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c5e67-3c67-4d2e-af14-5e28f88ce1b2 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:29.555593 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d22c5e67-3c67-4d2e-af14-5e28f88ce1b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd33bc76be30846cb93d755fce644137b', 'request_id': 'req-d22c5e67-3c67-4d2e-af14-5e28f88ce1b2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:29.556885 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:29.562340 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d22c5e67-3c67-4d2e-af14-5e28f88ce1b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd33bc76be30846cb93d755fce644137b', 'request_id': 'req-d22c5e67-3c67-4d2e-af14-5e28f88ce1b2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:29.660928 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d22c5e67-3c67-4d2e-af14-5e28f88ce1b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd33bc76be30846cb93d755fce644137b', 'request_id': 'req-d22c5e67-3c67-4d2e-af14-5e28f88ce1b2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:29.673192 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d22c5e67-3c67-4d2e-af14-5e28f88ce1b2 admin admin] The token cache is being invalidate because project d33bc76be30846cb93d755fce644137b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:55:29.673492 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d22c5e67-3c67-4d2e-af14-5e28f88ce1b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:29.674157 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d22c5e67-3c67-4d2e-af14-5e28f88ce1b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:29.675683 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1345/2679] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:55:29 2022] DELETE /identity/v3/projects/d33bc76be30846cb93d755fce644137b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:55:29.679837 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54140ac9-efe8-42c4-ade8-ef9f4894f851 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:29.689506 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54140ac9-efe8-42c4-ade8-ef9f4894f851 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:29.747832 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcab5e-f600-40a9-97d6-cf9790cfd0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:29.748460 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcab5e-f600-40a9-97d6-cf9790cfd0ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:29.748738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcab5e-f600-40a9-97d6-cf9790cfd0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:29.749012 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcab5e-f600-40a9-97d6-cf9790cfd0ab admin admin] PATH_INFO: `/v3/users/779cb0c3d0444ec3a70c53d0daf56a46` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:29.750156 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bcab5e-f600-40a9-97d6-cf9790cfd0ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=779cb0c3d0444ec3a70c53d0daf56a46)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:29.752237 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bcab5e-f600-40a9-97d6-cf9790cfd0ab admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:29.955207 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c7bcab5e-f600-40a9-97d6-cf9790cfd0ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '779cb0c3d0444ec3a70c53d0daf56a46'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:29.955912 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c7bcab5e-f600-40a9-97d6-cf9790cfd0ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '779cb0c3d0444ec3a70c53d0daf56a46'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:29.963085 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c7bcab5e-f600-40a9-97d6-cf9790cfd0ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '779cb0c3d0444ec3a70c53d0daf56a46'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:29.963758 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c7bcab5e-f600-40a9-97d6-cf9790cfd0ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '779cb0c3d0444ec3a70c53d0daf56a46'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:30.023050 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c5e67-3c67-4d2e-af14-5e28f88ce1b2 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:30.024495 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d22c5e67-3c67-4d2e-af14-5e28f88ce1b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:30.037361 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c5e67-3c67-4d2e-af14-5e28f88ce1b2 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:30.041908 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63149c6f-86c1-4be5-abb1-4b567cdd4eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:30.042549 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63149c6f-86c1-4be5-abb1-4b567cdd4eea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:30.042831 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63149c6f-86c1-4be5-abb1-4b567cdd4eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:30.043106 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63149c6f-86c1-4be5-abb1-4b567cdd4eea admin admin] PATH_INFO: `/v3/users/860de976faec4582b6a6a8153d6d4f3f` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:30.044276 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63149c6f-86c1-4be5-abb1-4b567cdd4eea admin admin] RBAC: Authorizing `identity:delete_user(user_id=860de976faec4582b6a6a8153d6d4f3f)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:30.046199 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63149c6f-86c1-4be5-abb1-4b567cdd4eea admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:30.112623 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c7bcab5e-f600-40a9-97d6-cf9790cfd0ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '779cb0c3d0444ec3a70c53d0daf56a46'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:30.131410 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1335/2680] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:55:29 2022] DELETE /identity/v3/users/779cb0c3d0444ec3a70c53d0daf56a46 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:55:30.220384 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-63149c6f-86c1-4be5-abb1-4b567cdd4eea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '860de976faec4582b6a6a8153d6d4f3f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:30.330034 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-63149c6f-86c1-4be5-abb1-4b567cdd4eea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '860de976faec4582b6a6a8153d6d4f3f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:30.330598 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-63149c6f-86c1-4be5-abb1-4b567cdd4eea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '860de976faec4582b6a6a8153d6d4f3f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:30.331208 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-63149c6f-86c1-4be5-abb1-4b567cdd4eea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '860de976faec4582b6a6a8153d6d4f3f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:30.338884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-63149c6f-86c1-4be5-abb1-4b567cdd4eea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '860de976faec4582b6a6a8153d6d4f3f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:30.356727 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1346/2681] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:55:30 2022] DELETE /identity/v3/users/860de976faec4582b6a6a8153d6d4f3f => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:55:30.361692 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf373d3-2789-42c1-8d66-4a64b7eefc54 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:30.361983 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf373d3-2789-42c1-8d66-4a64b7eefc54 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:30.362295 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf373d3-2789-42c1-8d66-4a64b7eefc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:30.376173 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:30.382344 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-ccf373d3-2789-42c1-8d66-4a64b7eefc54 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:55:30.383604 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ccf373d3-2789-42c1-8d66-4a64b7eefc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:30.448620 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1336/2682] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:55:30.458734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63149c6f-86c1-4be5-abb1-4b567cdd4eea admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:30.460300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-63149c6f-86c1-4be5-abb1-4b567cdd4eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:30.522500 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63149c6f-86c1-4be5-abb1-4b567cdd4eea admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:30.526146 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f95ca-c82c-4fed-9c41-a01b14808620 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:30.526747 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f95ca-c82c-4fed-9c41-a01b14808620 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:30.527021 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f95ca-c82c-4fed-9c41-a01b14808620 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:30.527319 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f95ca-c82c-4fed-9c41-a01b14808620 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:30.537349 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f95ca-c82c-4fed-9c41-a01b14808620 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:30.546044 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f95ca-c82c-4fed-9c41-a01b14808620 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:30.549256 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1347/2683] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:55:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:55:30.646007 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf373d3-2789-42c1-8d66-4a64b7eefc54 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:30.647514 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ccf373d3-2789-42c1-8d66-4a64b7eefc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:30.660404 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf373d3-2789-42c1-8d66-4a64b7eefc54 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:30.665565 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba17681-7fc2-482a-af48-94f6ca378a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:30.666627 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba17681-7fc2-482a-af48-94f6ca378a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:30.667118 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba17681-7fc2-482a-af48-94f6ca378a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:30.667700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba17681-7fc2-482a-af48-94f6ca378a7b admin admin] PATH_INFO: `/v3/projects/bf99518d183b4c6d91d78b1adfd62d8c` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:30.669241 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba17681-7fc2-482a-af48-94f6ca378a7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf99518d183b4c6d91d78b1adfd62d8c)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:30.672019 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba17681-7fc2-482a-af48-94f6ca378a7b admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:30.804989 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-6ba17681-7fc2-482a-af48-94f6ca378a7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf99518d183b4c6d91d78b1adfd62d8c', 'request_id': 'req-6ba17681-7fc2-482a-af48-94f6ca378a7b'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:30.810526 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-6ba17681-7fc2-482a-af48-94f6ca378a7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf99518d183b4c6d91d78b1adfd62d8c', 'request_id': 'req-6ba17681-7fc2-482a-af48-94f6ca378a7b'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:30.924248 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-6ba17681-7fc2-482a-af48-94f6ca378a7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf99518d183b4c6d91d78b1adfd62d8c', 'request_id': 'req-6ba17681-7fc2-482a-af48-94f6ca378a7b'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:30.939399 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-6ba17681-7fc2-482a-af48-94f6ca378a7b admin admin] The token cache is being invalidate because project bf99518d183b4c6d91d78b1adfd62d8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:55:30.939698 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-6ba17681-7fc2-482a-af48-94f6ca378a7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:30.940378 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-6ba17681-7fc2-482a-af48-94f6ca378a7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:30.941901 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1337/2684] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:55:30 2022] DELETE /identity/v3/projects/bf99518d183b4c6d91d78b1adfd62d8c => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:55:30.947496 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31fa54-2446-4321-85f4-5615ba550525 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:30.947904 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31fa54-2446-4321-85f4-5615ba550525 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:30.948243 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31fa54-2446-4321-85f4-5615ba550525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:30.969169 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-4a31fa54-2446-4321-85f4-5615ba550525 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:55:30.970384 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4a31fa54-2446-4321-85f4-5615ba550525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:31.036913 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:31.049454 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1348/2685] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:55:31.057725 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540ece6-850e-4222-af57-cddc5a82ece9 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:31.058051 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540ece6-850e-4222-af57-cddc5a82ece9 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:31.058383 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540ece6-850e-4222-af57-cddc5a82ece9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:31.079622 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-7540ece6-850e-4222-af57-cddc5a82ece9 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:55:31.080854 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7540ece6-850e-4222-af57-cddc5a82ece9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:31.088994 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1338/2686] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:55:31.093779 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31fa54-2446-4321-85f4-5615ba550525 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:31.105318 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31fa54-2446-4321-85f4-5615ba550525 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:31.109386 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540ece6-850e-4222-af57-cddc5a82ece9 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:31.112153 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7540ece6-850e-4222-af57-cddc5a82ece9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:31.113943 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6c395-b5f6-44ea-a5ab-07940d9ac2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:31.114954 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6c395-b5f6-44ea-a5ab-07940d9ac2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:31.115475 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6c395-b5f6-44ea-a5ab-07940d9ac2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:31.116015 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6c395-b5f6-44ea-a5ab-07940d9ac2c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:31.117354 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6c395-b5f6-44ea-a5ab-07940d9ac2c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:55:31.117847 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6c395-b5f6-44ea-a5ab-07940d9ac2c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:31.119845 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6c395-b5f6-44ea-a5ab-07940d9ac2c4 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:31.134102 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540ece6-850e-4222-af57-cddc5a82ece9 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:31.139505 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1349/2687] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:55:31.142466 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6c395-b5f6-44ea-a5ab-07940d9ac2c4 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:31.142611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7053f9-ebfa-4222-8014-f6a15f7a37b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:31.144082 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7053f9-ebfa-4222-8014-f6a15f7a37b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:31.144554 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7053f9-ebfa-4222-8014-f6a15f7a37b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:31.145109 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7053f9-ebfa-4222-8014-f6a15f7a37b7 admin admin] PATH_INFO: `/v3/projects/32bf320247584c40b18400a439217921` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:31.147399 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7053f9-ebfa-4222-8014-f6a15f7a37b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32bf320247584c40b18400a439217921)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:31.149815 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7053f9-ebfa-4222-8014-f6a15f7a37b7 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:31.154189 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6c395-b5f6-44ea-a5ab-07940d9ac2c4 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:31.160243 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b000f38-72b8-479f-8a7b-f4f6d768c08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:31.160865 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b000f38-72b8-479f-8a7b-f4f6d768c08b admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:31.161199 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b000f38-72b8-479f-8a7b-f4f6d768c08b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:31.161533 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b000f38-72b8-479f-8a7b-f4f6d768c08b admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:31.162122 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b000f38-72b8-479f-8a7b-f4f6d768c08b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:31.164334 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b000f38-72b8-479f-8a7b-f4f6d768c08b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:31.274934 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-fd7053f9-ebfa-4222-8014-f6a15f7a37b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32bf320247584c40b18400a439217921', 'request_id': 'req-fd7053f9-ebfa-4222-8014-f6a15f7a37b7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:31.282273 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-fd7053f9-ebfa-4222-8014-f6a15f7a37b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32bf320247584c40b18400a439217921', 'request_id': 'req-fd7053f9-ebfa-4222-8014-f6a15f7a37b7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:31.286710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1350/2688] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:55:31 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:55:31.291143 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b000f38-72b8-479f-8a7b-f4f6d768c08b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:31.355310 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b000f38-72b8-479f-8a7b-f4f6d768c08b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:31.360944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c70c9-e208-4ab2-afaa-3116182a7319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:31.361565 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c70c9-e208-4ab2-afaa-3116182a7319 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:31.361842 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c70c9-e208-4ab2-afaa-3116182a7319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:31.362111 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c70c9-e208-4ab2-afaa-3116182a7319 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:31.362792 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c70c9-e208-4ab2-afaa-3116182a7319 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:31.364874 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c70c9-e208-4ab2-afaa-3116182a7319 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:31.398952 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-fd7053f9-ebfa-4222-8014-f6a15f7a37b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32bf320247584c40b18400a439217921', 'request_id': 'req-fd7053f9-ebfa-4222-8014-f6a15f7a37b7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:31.412905 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-fd7053f9-ebfa-4222-8014-f6a15f7a37b7 admin admin] The token cache is being invalidate because project 32bf320247584c40b18400a439217921 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:55:31.413198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-fd7053f9-ebfa-4222-8014-f6a15f7a37b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:31.413889 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-fd7053f9-ebfa-4222-8014-f6a15f7a37b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:31.415433 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1339/2689] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:55:31 2022] DELETE /identity/v3/projects/32bf320247584c40b18400a439217921 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:55:31.421143 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1230706-1f71-4d27-a760-8adc7a590759 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:31.421431 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1230706-1f71-4d27-a760-8adc7a590759 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:31.421703 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1230706-1f71-4d27-a760-8adc7a590759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:31.437057 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:31.442939 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-e1230706-1f71-4d27-a760-8adc7a590759 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:55:31.444215 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e1230706-1f71-4d27-a760-8adc7a590759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:31.452670 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1340/2690] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:55:31.460633 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f0d08-804d-49ac-8207-1b4548d47347 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:31.460847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f0d08-804d-49ac-8207-1b4548d47347 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:31.466445 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f0d08-804d-49ac-8207-1b4548d47347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:31.483429 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-e41f0d08-804d-49ac-8207-1b4548d47347 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:55:31.484674 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e41f0d08-804d-49ac-8207-1b4548d47347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:31.494922 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1351/2691] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:55:31 2022] POST /identity/v3/users => generated 291 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:55:31.495166 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1341/2692] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:55:31.496230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c70c9-e208-4ab2-afaa-3116182a7319 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:31.497516 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f0d08-804d-49ac-8207-1b4548d47347 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:31.498104 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1f5c70c9-e208-4ab2-afaa-3116182a7319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:31.507568 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f0d08-804d-49ac-8207-1b4548d47347 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:31.510587 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c70c9-e208-4ab2-afaa-3116182a7319 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:31.512581 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d98ba-380a-41a2-b882-6de93687e46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:31.513218 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d98ba-380a-41a2-b882-6de93687e46d admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:31.513477 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d98ba-380a-41a2-b882-6de93687e46d admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:31.513747 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d98ba-380a-41a2-b882-6de93687e46d admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:31.514436 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d98ba-380a-41a2-b882-6de93687e46d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:55:31.514739 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d98ba-380a-41a2-b882-6de93687e46d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:31.515675 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe89d5-46db-4981-a337-334fa2d18e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:31.516303 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe89d5-46db-4981-a337-334fa2d18e4d admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:31.516433 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d98ba-380a-41a2-b882-6de93687e46d admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:31.516571 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe89d5-46db-4981-a337-334fa2d18e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:31.516845 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe89d5-46db-4981-a337-334fa2d18e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:31.517500 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe89d5-46db-4981-a337-334fa2d18e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:31.519112 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe89d5-46db-4981-a337-334fa2d18e4d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:31.529319 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1342/2693] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:55:31.531491 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1352/2694] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:55:31.535557 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d98ba-380a-41a2-b882-6de93687e46d admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:31.540942 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe89d5-46db-4981-a337-334fa2d18e4d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:31.546996 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe89d5-46db-4981-a337-334fa2d18e4d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:31.547593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d98ba-380a-41a2-b882-6de93687e46d admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:31.551932 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cb1cc-877d-4a56-a8dd-e1e4e3e2dab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:31.552266 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42310af7-b994-4098-a3ce-b2c920b877b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:31.552544 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cb1cc-877d-4a56-a8dd-e1e4e3e2dab0 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:31.552843 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42310af7-b994-4098-a3ce-b2c920b877b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:31.552990 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cb1cc-877d-4a56-a8dd-e1e4e3e2dab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:31.553120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42310af7-b994-4098-a3ce-b2c920b877b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:31.553276 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cb1cc-877d-4a56-a8dd-e1e4e3e2dab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:31.553386 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42310af7-b994-4098-a3ce-b2c920b877b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:31.553931 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cb1cc-877d-4a56-a8dd-e1e4e3e2dab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:31.554054 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42310af7-b994-4098-a3ce-b2c920b877b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:31.555582 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cb1cc-877d-4a56-a8dd-e1e4e3e2dab0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:31.555995 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42310af7-b994-4098-a3ce-b2c920b877b2 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:31.567367 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1353/2695] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:55:31.575361 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cb1cc-877d-4a56-a8dd-e1e4e3e2dab0 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:31.581723 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cb1cc-877d-4a56-a8dd-e1e4e3e2dab0 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:31.586762 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5848b-6e4c-4a9f-9cb0-06a3c5107513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:31.587463 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5848b-6e4c-4a9f-9cb0-06a3c5107513 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:31.587746 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5848b-6e4c-4a9f-9cb0-06a3c5107513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:31.588021 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5848b-6e4c-4a9f-9cb0-06a3c5107513 admin admin] PATH_INFO: `/v3/projects/99c59e27ab544117bbbfaba5013abf93/users/2bf07bf55ef54354bfa0168a0ce0e151/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:31.606145 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e5848b-6e4c-4a9f-9cb0-06a3c5107513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99c59e27ab544117bbbfaba5013abf93, user_id=2bf07bf55ef54354bfa0168a0ce0e151, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:31.611118 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e5848b-6e4c-4a9f-9cb0-06a3c5107513 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:31.709251 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1343/2696] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:55:31 2022] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:55:31.713362 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42310af7-b994-4098-a3ce-b2c920b877b2 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:31.771165 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1354/2697] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:55:31 2022] PUT /identity/v3/projects/99c59e27ab544117bbbfaba5013abf93/users/2bf07bf55ef54354bfa0168a0ce0e151/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:55:31.781493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42310af7-b994-4098-a3ce-b2c920b877b2 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:31.783799 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1723d-a8d9-4d25-9b65-0c1b6abc72e4 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:31.784274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1723d-a8d9-4d25-9b65-0c1b6abc72e4 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:31.784506 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1723d-a8d9-4d25-9b65-0c1b6abc72e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:31.813435 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-4bc1723d-a8d9-4d25-9b65-0c1b6abc72e4 None None] MFA Rules not processed for user `2bf07bf55ef54354bfa0168a0ce0e151`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:55:31.814785 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4bc1723d-a8d9-4d25-9b65-0c1b6abc72e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:31.847321 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1ca5a-c7e0-40c8-aa66-fa3a430a64a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:31.859612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1ca5a-c7e0-40c8-aa66-fa3a430a64a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:31.859612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1ca5a-c7e0-40c8-aa66-fa3a430a64a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:31.859612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1ca5a-c7e0-40c8-aa66-fa3a430a64a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:31.859612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1ca5a-c7e0-40c8-aa66-fa3a430a64a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:31.859612 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1ca5a-c7e0-40c8-aa66-fa3a430a64a7 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:31.866370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:31.883344 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1355/2698] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:55:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:55:31.887601 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1723d-a8d9-4d25-9b65-0c1b6abc72e4 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:31.898581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1723d-a8d9-4d25-9b65-0c1b6abc72e4 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:31.903334 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59e8c1-9a8a-4d74-9631-8bc46f541bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:31.903925 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59e8c1-9a8a-4d74-9631-8bc46f541bb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:31.904209 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59e8c1-9a8a-4d74-9631-8bc46f541bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:31.904511 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59e8c1-9a8a-4d74-9631-8bc46f541bb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:31.905845 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b59e8c1-9a8a-4d74-9631-8bc46f541bb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:31.907822 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b59e8c1-9a8a-4d74-9631-8bc46f541bb2 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:32.038584 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1344/2699] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:55:31 2022] POST /identity/v3/users => generated 292 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:55:32.042657 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1ca5a-c7e0-40c8-aa66-fa3a430a64a7 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:32.052950 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1ca5a-c7e0-40c8-aa66-fa3a430a64a7 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:32.058005 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079a73b-c7f4-4d02-a259-1e4f4f181ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:32.058597 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079a73b-c7f4-4d02-a259-1e4f4f181ecb admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:32.058881 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079a73b-c7f4-4d02-a259-1e4f4f181ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:32.059161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079a73b-c7f4-4d02-a259-1e4f4f181ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:32.059934 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079a73b-c7f4-4d02-a259-1e4f4f181ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:32.061517 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079a73b-c7f4-4d02-a259-1e4f4f181ecb admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:32.071529 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1345/2700] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:55:32.075263 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079a73b-c7f4-4d02-a259-1e4f4f181ecb admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:32.087379 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1356/2701] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:55:31 2022] POST /identity/v3/projects => generated 379 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:55:32.088847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079a73b-c7f4-4d02-a259-1e4f4f181ecb admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:32.091926 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59e8c1-9a8a-4d74-9631-8bc46f541bb2 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:32.144554 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd50349-1b2d-4597-8404-4727d2d17435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:32.145449 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd50349-1b2d-4597-8404-4727d2d17435 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:32.145731 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd50349-1b2d-4597-8404-4727d2d17435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:32.146007 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd50349-1b2d-4597-8404-4727d2d17435 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:32.146651 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd50349-1b2d-4597-8404-4727d2d17435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:32.148380 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd50349-1b2d-4597-8404-4727d2d17435 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:32.155915 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59e8c1-9a8a-4d74-9631-8bc46f541bb2 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:32.158951 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1346/2702] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:55:32.162958 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd50349-1b2d-4597-8404-4727d2d17435 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:32.164193 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ac2c3-1bfb-4481-9e89-08c6868e7f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:32.164792 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ac2c3-1bfb-4481-9e89-08c6868e7f2e admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:32.165075 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ac2c3-1bfb-4481-9e89-08c6868e7f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:32.165350 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ac2c3-1bfb-4481-9e89-08c6868e7f2e admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:32.165998 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ac2c3-1bfb-4481-9e89-08c6868e7f2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:32.168074 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ac2c3-1bfb-4481-9e89-08c6868e7f2e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:32.172763 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd50349-1b2d-4597-8404-4727d2d17435 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:32.177644 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15508dc-fe06-473d-9609-48eb478340a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:32.178302 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15508dc-fe06-473d-9609-48eb478340a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:32.178587 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15508dc-fe06-473d-9609-48eb478340a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:32.178863 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15508dc-fe06-473d-9609-48eb478340a8 admin admin] PATH_INFO: `/v3/projects/a2fa9e135d2743b191acfb1616c3b3f0/users/a689ca2ce6a34716973ceb56826a4676/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:32.193704 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15508dc-fe06-473d-9609-48eb478340a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2fa9e135d2743b191acfb1616c3b3f0, user_id=a689ca2ce6a34716973ceb56826a4676, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:32.196407 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15508dc-fe06-473d-9609-48eb478340a8 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:32.249346 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1357/2703] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:55:32 2022] POST /identity/v3/users => generated 296 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:55:32.253462 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ac2c3-1bfb-4481-9e89-08c6868e7f2e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:32.263416 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ac2c3-1bfb-4481-9e89-08c6868e7f2e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:32.268799 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:32.269036 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47277330-0306-4eba-a24f-ced04ae79bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:32.269775 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47277330-0306-4eba-a24f-ced04ae79bdf admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:32.269945 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47277330-0306-4eba-a24f-ced04ae79bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:32.270222 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47277330-0306-4eba-a24f-ced04ae79bdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:32.270876 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47277330-0306-4eba-a24f-ced04ae79bdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:32.272576 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47277330-0306-4eba-a24f-ced04ae79bdf admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:32.274910 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1347/2704] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:55:32 2022] PUT /identity/v3/projects/a2fa9e135d2743b191acfb1616c3b3f0/users/a689ca2ce6a34716973ceb56826a4676/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:55:32.279591 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd0bab-a201-4014-a6ed-15c278c555f0 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:32.279876 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd0bab-a201-4014-a6ed-15c278c555f0 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:32.280165 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd0bab-a201-4014-a6ed-15c278c555f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:32.283482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1358/2705] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:55:32.287404 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47277330-0306-4eba-a24f-ced04ae79bdf admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:32.297763 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47277330-0306-4eba-a24f-ced04ae79bdf admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:32.303224 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-0afd0bab-a201-4014-a6ed-15c278c555f0 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:55:32.306427 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-0afd0bab-a201-4014-a6ed-15c278c555f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:32.361014 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9ec77-98d1-4c85-a4d5-38eebf4776ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:32.361720 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9ec77-98d1-4c85-a4d5-38eebf4776ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:32.362067 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9ec77-98d1-4c85-a4d5-38eebf4776ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:32.362271 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9ec77-98d1-4c85-a4d5-38eebf4776ea admin admin] PATH_INFO: `/v3/projects/0295bcd9ed794642a91e593d5285f5fe/users/01456d8587304149b6fcfd71d4f98076/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:32.375482 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1348/2706] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:55:32.382685 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9ec77-98d1-4c85-a4d5-38eebf4776ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=0295bcd9ed794642a91e593d5285f5fe, user_id=01456d8587304149b6fcfd71d4f98076, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:32.385616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9ec77-98d1-4c85-a4d5-38eebf4776ea admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:32.385919 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd0bab-a201-4014-a6ed-15c278c555f0 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:32.387412 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-0afd0bab-a201-4014-a6ed-15c278c555f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:32.445814 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1359/2707] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:55:32 2022] PUT /identity/v3/projects/0295bcd9ed794642a91e593d5285f5fe/users/01456d8587304149b6fcfd71d4f98076/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:55:32.452127 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9ec77-98d1-4c85-a4d5-38eebf4776ea admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:32.452324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd0bab-a201-4014-a6ed-15c278c555f0 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:32.490061 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:32.505268 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035525f3-d776-4192-ab01-a43fdae2f22d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:32.505880 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035525f3-d776-4192-ab01-a43fdae2f22d service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:32.506152 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035525f3-d776-4192-ab01-a43fdae2f22d service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:32.506427 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035525f3-d776-4192-ab01-a43fdae2f22d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:32.523278 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9ec77-98d1-4c85-a4d5-38eebf4776ea admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:32.529871 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36688dc3-db9f-4df1-a526-5c2a71b8ec3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:32.530518 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36688dc3-db9f-4df1-a526-5c2a71b8ec3d admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:32.530782 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36688dc3-db9f-4df1-a526-5c2a71b8ec3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:32.531052 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36688dc3-db9f-4df1-a526-5c2a71b8ec3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:32.531743 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36688dc3-db9f-4df1-a526-5c2a71b8ec3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:32.533349 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36688dc3-db9f-4df1-a526-5c2a71b8ec3d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:32.544050 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1360/2708] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:55:32.545144 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:32.548446 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36688dc3-db9f-4df1-a526-5c2a71b8ec3d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:32.558464 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36688dc3-db9f-4df1-a526-5c2a71b8ec3d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:32.563795 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2f748-fb77-46af-8cd1-86137655f7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:32.564462 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2f748-fb77-46af-8cd1-86137655f7f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:32.564744 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2f748-fb77-46af-8cd1-86137655f7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:32.565020 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2f748-fb77-46af-8cd1-86137655f7f5 admin admin] PATH_INFO: `/v3/projects/0295bcd9ed794642a91e593d5285f5fe/users/01456d8587304149b6fcfd71d4f98076/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:32.566991 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2f748-fb77-46af-8cd1-86137655f7f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0295bcd9ed794642a91e593d5285f5fe, user_id=01456d8587304149b6fcfd71d4f98076, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:32.569714 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2f748-fb77-46af-8cd1-86137655f7f5 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:32.582109 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1361/2709] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:55:32 2022] PUT /identity/v3/projects/0295bcd9ed794642a91e593d5285f5fe/users/01456d8587304149b6fcfd71d4f98076/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:55:32.586129 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035525f3-d776-4192-ab01-a43fdae2f22d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:32.587711 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035525f3-d776-4192-ab01-a43fdae2f22d service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:32.593759 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb742c-3952-4f10-9974-0b3b3a1dc52d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:32.595065 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb742c-3952-4f10-9974-0b3b3a1dc52d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:32.595172 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb742c-3952-4f10-9974-0b3b3a1dc52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:32.598701 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1349/2710] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:55:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:55:32.626357 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-47fb742c-3952-4f10-9974-0b3b3a1dc52d None None] MFA Rules not processed for user `01456d8587304149b6fcfd71d4f98076`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:55:32.627657 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-47fb742c-3952-4f10-9974-0b3b3a1dc52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:32.704529 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1362/2711] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:55:32 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:55:32.717916 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035525f3-d776-4192-ab01-a43fdae2f22d service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:32.719494 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-035525f3-d776-4192-ab01-a43fdae2f22d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:32.783062 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035525f3-d776-4192-ab01-a43fdae2f22d service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:32.844303 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454918b-be46-4c8b-abd1-d2db20a21279 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:32.845057 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454918b-be46-4c8b-abd1-d2db20a21279 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:32.845336 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454918b-be46-4c8b-abd1-d2db20a21279 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:32.845613 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454918b-be46-4c8b-abd1-d2db20a21279 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:32.856392 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e454918b-be46-4c8b-abd1-d2db20a21279 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:32.858549 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e454918b-be46-4c8b-abd1-d2db20a21279 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:32.869503 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1350/2712] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:55:32 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:55:33.510679 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb742c-3952-4f10-9974-0b3b3a1dc52d None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:33.574563 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb742c-3952-4f10-9974-0b3b3a1dc52d None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:33.579670 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d69c45-1074-4512-ab59-9c714ac4b315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:33.580306 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d69c45-1074-4512-ab59-9c714ac4b315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:33.580586 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d69c45-1074-4512-ab59-9c714ac4b315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:33.580862 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d69c45-1074-4512-ab59-9c714ac4b315 admin admin] PATH_INFO: `/v3/users/2bf07bf55ef54354bfa0168a0ce0e151` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:33.581985 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d69c45-1074-4512-ab59-9c714ac4b315 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bf07bf55ef54354bfa0168a0ce0e151)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:33.583950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d69c45-1074-4512-ab59-9c714ac4b315 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:33.812978 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:33.818702 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e8d69c45-1074-4512-ab59-9c714ac4b315 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bf07bf55ef54354bfa0168a0ce0e151'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:33.867172 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e8d69c45-1074-4512-ab59-9c714ac4b315 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bf07bf55ef54354bfa0168a0ce0e151'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:33.867966 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e8d69c45-1074-4512-ab59-9c714ac4b315 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bf07bf55ef54354bfa0168a0ce0e151'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:33.868650 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e8d69c45-1074-4512-ab59-9c714ac4b315 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bf07bf55ef54354bfa0168a0ce0e151'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:33.876584 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e8d69c45-1074-4512-ab59-9c714ac4b315 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bf07bf55ef54354bfa0168a0ce0e151'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:33.895073 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1363/2713] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:55:33 2022] DELETE /identity/v3/users/2bf07bf55ef54354bfa0168a0ce0e151 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:55:33.900297 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2694d-a029-4d2c-81f7-a3fadd355670 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:33.900961 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2694d-a029-4d2c-81f7-a3fadd355670 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:33.901459 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2694d-a029-4d2c-81f7-a3fadd355670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:33.933025 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-8be2694d-a029-4d2c-81f7-a3fadd355670 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:55:33.934378 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-8be2694d-a029-4d2c-81f7-a3fadd355670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:34.001683 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1351/2714] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:55:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:55:34.011811 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d69c45-1074-4512-ab59-9c714ac4b315 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:34.013331 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e8d69c45-1074-4512-ab59-9c714ac4b315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:34.087978 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d69c45-1074-4512-ab59-9c714ac4b315 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:34.092904 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac2026-2806-4490-a203-75cd98316bc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:34.093578 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac2026-2806-4490-a203-75cd98316bc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:34.094074 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac2026-2806-4490-a203-75cd98316bc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:34.094463 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac2026-2806-4490-a203-75cd98316bc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:34.105285 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac2026-2806-4490-a203-75cd98316bc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:34.106753 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac2026-2806-4490-a203-75cd98316bc2 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:34.117493 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1364/2715] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:55:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:55:34.842403 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2694d-a029-4d2c-81f7-a3fadd355670 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:34.844789 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-8be2694d-a029-4d2c-81f7-a3fadd355670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:34.870883 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2694d-a029-4d2c-81f7-a3fadd355670 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:34.881810 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ca4b6-b8a9-4cf4-bb92-54a67020463f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:34.882972 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ca4b6-b8a9-4cf4-bb92-54a67020463f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:34.883446 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ca4b6-b8a9-4cf4-bb92-54a67020463f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:34.883892 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ca4b6-b8a9-4cf4-bb92-54a67020463f admin admin] PATH_INFO: `/v3/projects/99c59e27ab544117bbbfaba5013abf93` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:34.885849 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ca4b6-b8a9-4cf4-bb92-54a67020463f admin admin] RBAC: Authorizing `identity:delete_project(project_id=99c59e27ab544117bbbfaba5013abf93)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:34.890888 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ca4b6-b8a9-4cf4-bb92-54a67020463f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:34.932597 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:35.052671 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-db5ca4b6-b8a9-4cf4-bb92-54a67020463f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99c59e27ab544117bbbfaba5013abf93', 'request_id': 'req-db5ca4b6-b8a9-4cf4-bb92-54a67020463f'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:35.060459 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-db5ca4b6-b8a9-4cf4-bb92-54a67020463f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99c59e27ab544117bbbfaba5013abf93', 'request_id': 'req-db5ca4b6-b8a9-4cf4-bb92-54a67020463f'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:35.131754 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-db5ca4b6-b8a9-4cf4-bb92-54a67020463f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99c59e27ab544117bbbfaba5013abf93', 'request_id': 'req-db5ca4b6-b8a9-4cf4-bb92-54a67020463f'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:35.145369 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-db5ca4b6-b8a9-4cf4-bb92-54a67020463f admin admin] The token cache is being invalidate because project 99c59e27ab544117bbbfaba5013abf93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:55:35.145673 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-db5ca4b6-b8a9-4cf4-bb92-54a67020463f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:35.146371 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-db5ca4b6-b8a9-4cf4-bb92-54a67020463f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:35.148184 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1352/2716] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:55:34 2022] DELETE /identity/v3/projects/99c59e27ab544117bbbfaba5013abf93 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:55:35.152320 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac2026-2806-4490-a203-75cd98316bc2 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:35.163765 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac2026-2806-4490-a203-75cd98316bc2 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:35.240540 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb9076-1bdd-4f04-9cbe-3fef86eaf430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:35.241315 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb9076-1bdd-4f04-9cbe-3fef86eaf430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:35.241681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb9076-1bdd-4f04-9cbe-3fef86eaf430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:35.242005 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb9076-1bdd-4f04-9cbe-3fef86eaf430 admin admin] PATH_INFO: `/v3/users/01456d8587304149b6fcfd71d4f98076` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:35.250714 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb9076-1bdd-4f04-9cbe-3fef86eaf430 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01456d8587304149b6fcfd71d4f98076)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:35.250714 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb9076-1bdd-4f04-9cbe-3fef86eaf430 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:35.419618 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-eecb9076-1bdd-4f04-9cbe-3fef86eaf430 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01456d8587304149b6fcfd71d4f98076'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:35.488578 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-eecb9076-1bdd-4f04-9cbe-3fef86eaf430 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01456d8587304149b6fcfd71d4f98076'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:35.489200 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-eecb9076-1bdd-4f04-9cbe-3fef86eaf430 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01456d8587304149b6fcfd71d4f98076'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:35.490041 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-eecb9076-1bdd-4f04-9cbe-3fef86eaf430 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01456d8587304149b6fcfd71d4f98076'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:35.497788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-eecb9076-1bdd-4f04-9cbe-3fef86eaf430 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01456d8587304149b6fcfd71d4f98076'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:35.499059 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:35.518435 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1365/2717] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:55:35 2022] DELETE /identity/v3/users/01456d8587304149b6fcfd71d4f98076 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:55:36.065014 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ca4b6-b8a9-4cf4-bb92-54a67020463f admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:36.068696 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-db5ca4b6-b8a9-4cf4-bb92-54a67020463f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:36.083888 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ca4b6-b8a9-4cf4-bb92-54a67020463f admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:36.163433 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c692ca-ea60-42d0-a5df-9fb0de7a14d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:36.164276 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c692ca-ea60-42d0-a5df-9fb0de7a14d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:36.164532 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c692ca-ea60-42d0-a5df-9fb0de7a14d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:36.164971 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c692ca-ea60-42d0-a5df-9fb0de7a14d0 admin admin] PATH_INFO: `/v3/projects/0295bcd9ed794642a91e593d5285f5fe` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:36.166192 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c692ca-ea60-42d0-a5df-9fb0de7a14d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0295bcd9ed794642a91e593d5285f5fe)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:36.168340 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c692ca-ea60-42d0-a5df-9fb0de7a14d0 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:36.408694 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-76c692ca-ea60-42d0-a5df-9fb0de7a14d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0295bcd9ed794642a91e593d5285f5fe', 'request_id': 'req-76c692ca-ea60-42d0-a5df-9fb0de7a14d0'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:36.426193 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-76c692ca-ea60-42d0-a5df-9fb0de7a14d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0295bcd9ed794642a91e593d5285f5fe', 'request_id': 'req-76c692ca-ea60-42d0-a5df-9fb0de7a14d0'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:36.489654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-76c692ca-ea60-42d0-a5df-9fb0de7a14d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0295bcd9ed794642a91e593d5285f5fe', 'request_id': 'req-76c692ca-ea60-42d0-a5df-9fb0de7a14d0'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:36.514145 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-76c692ca-ea60-42d0-a5df-9fb0de7a14d0 admin admin] The token cache is being invalidate because project 0295bcd9ed794642a91e593d5285f5fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:55:36.514679 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-76c692ca-ea60-42d0-a5df-9fb0de7a14d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:36.516273 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-76c692ca-ea60-42d0-a5df-9fb0de7a14d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:36.518936 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1353/2718] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:55:36 2022] DELETE /identity/v3/projects/0295bcd9ed794642a91e593d5285f5fe => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:55:36.526538 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd605f0-1395-4ecb-a697-306f3afd466a None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:36.527120 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd605f0-1395-4ecb-a697-306f3afd466a None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:36.527602 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd605f0-1395-4ecb-a697-306f3afd466a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:36.558459 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-dfd605f0-1395-4ecb-a697-306f3afd466a None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:55:36.559907 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-dfd605f0-1395-4ecb-a697-306f3afd466a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:36.663306 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1366/2719] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:55:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:55:36.675762 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef49ad5-2dc3-4380-a987-9fbf3966d69c None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:36.676204 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef49ad5-2dc3-4380-a987-9fbf3966d69c None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:36.676946 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef49ad5-2dc3-4380-a987-9fbf3966d69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:36.699779 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-eef49ad5-2dc3-4380-a987-9fbf3966d69c None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:55:36.701665 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-eef49ad5-2dc3-4380-a987-9fbf3966d69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:36.713206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1354/2720] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:55:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:55:36.719029 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd605f0-1395-4ecb-a697-306f3afd466a None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:36.730098 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd605f0-1395-4ecb-a697-306f3afd466a None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:36.735899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0cb66-4f66-4048-9321-878636971669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:36.736624 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0cb66-4f66-4048-9321-878636971669 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:36.736911 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0cb66-4f66-4048-9321-878636971669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:36.737188 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0cb66-4f66-4048-9321-878636971669 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:36.737972 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0cb66-4f66-4048-9321-878636971669 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:55:36.738305 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0cb66-4f66-4048-9321-878636971669 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:36.740012 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0cb66-4f66-4048-9321-878636971669 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:36.754119 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1367/2721] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:55:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:55:36.758778 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef49ad5-2dc3-4380-a987-9fbf3966d69c None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:36.768719 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef49ad5-2dc3-4380-a987-9fbf3966d69c None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:36.774899 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf30a5-7804-4a62-affa-3da4152dfbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:36.780536 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf30a5-7804-4a62-affa-3da4152dfbce admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:36.780536 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf30a5-7804-4a62-affa-3da4152dfbce admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:36.780536 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf30a5-7804-4a62-affa-3da4152dfbce admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:36.780536 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf30a5-7804-4a62-affa-3da4152dfbce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:36.780536 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf30a5-7804-4a62-affa-3da4152dfbce admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:36.885227 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1355/2722] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:55:36 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:55:36.887102 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0cb66-4f66-4048-9321-878636971669 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:36.910932 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0cb66-4f66-4048-9321-878636971669 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:37.014064 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60bbb8a-4191-4392-bc23-d67a01cab9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:37.014996 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bbb8a-4191-4392-bc23-d67a01cab9a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:37.015338 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bbb8a-4191-4392-bc23-d67a01cab9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:37.015614 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bbb8a-4191-4392-bc23-d67a01cab9a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:37.016273 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60bbb8a-4191-4392-bc23-d67a01cab9a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:37.018341 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60bbb8a-4191-4392-bc23-d67a01cab9a6 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:37.129138 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1368/2723] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:55:36 2022] POST /identity/v3/users => generated 287 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:55:37.135195 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf30a5-7804-4a62-affa-3da4152dfbce admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:37.154258 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf30a5-7804-4a62-affa-3da4152dfbce admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:37.164854 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e99b59-3194-491d-9927-f5319d30d90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:37.165996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e99b59-3194-491d-9927-f5319d30d90d admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:37.166509 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e99b59-3194-491d-9927-f5319d30d90d admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:37.167303 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e99b59-3194-491d-9927-f5319d30d90d admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:37.168563 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e99b59-3194-491d-9927-f5319d30d90d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:37.172217 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e99b59-3194-491d-9927-f5319d30d90d admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:37.176977 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:37.200291 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1356/2724] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:55:37.203363 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60bbb8a-4191-4392-bc23-d67a01cab9a6 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:37.218315 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60bbb8a-4191-4392-bc23-d67a01cab9a6 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:37.224182 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f23e49-5ae8-48c3-8030-4ba90118eec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:37.225220 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f23e49-5ae8-48c3-8030-4ba90118eec6 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:37.225349 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f23e49-5ae8-48c3-8030-4ba90118eec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:37.225559 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f23e49-5ae8-48c3-8030-4ba90118eec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:37.226290 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f23e49-5ae8-48c3-8030-4ba90118eec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:37.228080 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f23e49-5ae8-48c3-8030-4ba90118eec6 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:37.252438 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1369/2725] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:55:37.258204 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e99b59-3194-491d-9927-f5319d30d90d admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:37.274493 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e99b59-3194-491d-9927-f5319d30d90d admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:37.283589 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079711b5-2765-492e-9b16-93a6d2f447cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:37.284839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079711b5-2765-492e-9b16-93a6d2f447cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:37.285266 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079711b5-2765-492e-9b16-93a6d2f447cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:37.285749 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079711b5-2765-492e-9b16-93a6d2f447cc admin admin] PATH_INFO: `/v3/projects/4278e3867d52423b80571191c778e35d/users/67774aa45e744292945d4298cb3e7abd/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:37.307449 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079711b5-2765-492e-9b16-93a6d2f447cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4278e3867d52423b80571191c778e35d, user_id=67774aa45e744292945d4298cb3e7abd, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:37.311890 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079711b5-2765-492e-9b16-93a6d2f447cc admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:37.445873 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1357/2726] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:55:37 2022] PUT /identity/v3/projects/4278e3867d52423b80571191c778e35d/users/67774aa45e744292945d4298cb3e7abd/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:55:37.467575 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a4a1a-d67e-4938-af1d-957caa4d51ed None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:37.468060 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a4a1a-d67e-4938-af1d-957caa4d51ed None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:37.468673 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a4a1a-d67e-4938-af1d-957caa4d51ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:37.520651 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-6e3a4a1a-d67e-4938-af1d-957caa4d51ed None None] MFA Rules not processed for user `67774aa45e744292945d4298cb3e7abd`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:55:37.529476 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6e3a4a1a-d67e-4938-af1d-957caa4d51ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:37.588608 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:37.653060 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1370/2727] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:55:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:55:37.667504 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079711b5-2765-492e-9b16-93a6d2f447cc admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:37.671892 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-079711b5-2765-492e-9b16-93a6d2f447cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:37.776296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079711b5-2765-492e-9b16-93a6d2f447cc admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:37.783557 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0fcfb-3fc9-40db-b585-42b0e6dccafb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:37.784427 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0fcfb-3fc9-40db-b585-42b0e6dccafb service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:37.784744 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0fcfb-3fc9-40db-b585-42b0e6dccafb service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:37.785157 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0fcfb-3fc9-40db-b585-42b0e6dccafb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:37.800757 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0fcfb-3fc9-40db-b585-42b0e6dccafb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:37.802537 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0fcfb-3fc9-40db-b585-42b0e6dccafb service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:37.819656 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1358/2728] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:55:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:55:37.851604 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a4a1a-d67e-4938-af1d-957caa4d51ed None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:37.945510 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a4a1a-d67e-4938-af1d-957caa4d51ed None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:37.953448 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d2b7f-f7df-4f6a-a1c7-175db8483082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:37.955220 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d2b7f-f7df-4f6a-a1c7-175db8483082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:37.955872 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d2b7f-f7df-4f6a-a1c7-175db8483082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:37.956073 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d2b7f-f7df-4f6a-a1c7-175db8483082 admin admin] PATH_INFO: `/v3/users/67774aa45e744292945d4298cb3e7abd` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:37.960086 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d2b7f-f7df-4f6a-a1c7-175db8483082 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67774aa45e744292945d4298cb3e7abd)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:37.962061 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d2b7f-f7df-4f6a-a1c7-175db8483082 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:38.169348 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fb7d2b7f-f7df-4f6a-a1c7-175db8483082 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67774aa45e744292945d4298cb3e7abd'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:38.307817 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fb7d2b7f-f7df-4f6a-a1c7-175db8483082 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67774aa45e744292945d4298cb3e7abd'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:38.308927 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fb7d2b7f-f7df-4f6a-a1c7-175db8483082 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67774aa45e744292945d4298cb3e7abd'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:38.309509 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fb7d2b7f-f7df-4f6a-a1c7-175db8483082 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67774aa45e744292945d4298cb3e7abd'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:38.323971 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fb7d2b7f-f7df-4f6a-a1c7-175db8483082 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67774aa45e744292945d4298cb3e7abd'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:38.350420 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1371/2729] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:55:37 2022] DELETE /identity/v3/users/67774aa45e744292945d4298cb3e7abd => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:55:38.355234 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384252fd-62f6-4921-b44a-7a68b29e5fc0 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:38.355819 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384252fd-62f6-4921-b44a-7a68b29e5fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:38.355929 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384252fd-62f6-4921-b44a-7a68b29e5fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:38.391698 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-384252fd-62f6-4921-b44a-7a68b29e5fc0 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:55:38.395984 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-384252fd-62f6-4921-b44a-7a68b29e5fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:38.490816 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1359/2730] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:55:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:55:38.502935 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d2b7f-f7df-4f6a-a1c7-175db8483082 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:38.505131 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-fb7d2b7f-f7df-4f6a-a1c7-175db8483082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:38.593121 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d2b7f-f7df-4f6a-a1c7-175db8483082 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:38.599438 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c18310-65ba-437b-a745-41f1eff67aef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:38.600082 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c18310-65ba-437b-a745-41f1eff67aef service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:38.600430 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c18310-65ba-437b-a745-41f1eff67aef service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:38.600773 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c18310-65ba-437b-a745-41f1eff67aef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:38.613131 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c18310-65ba-437b-a745-41f1eff67aef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:38.614372 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c18310-65ba-437b-a745-41f1eff67aef service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:38.619340 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:38.637243 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1372/2731] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:55:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:55:38.964572 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bc1c1-f4ef-4e5b-ae97-630e948f028e None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:38.964859 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bc1c1-f4ef-4e5b-ae97-630e948f028e None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:38.965142 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bc1c1-f4ef-4e5b-ae97-630e948f028e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:39.005900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-5b9bc1c1-f4ef-4e5b-ae97-630e948f028e None None] MFA Rules not processed for user `a689ca2ce6a34716973ceb56826a4676`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:55:39.007478 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5b9bc1c1-f4ef-4e5b-ae97-630e948f028e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:39.111074 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1360/2732] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:55:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:55:39.112819 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c18310-65ba-437b-a745-41f1eff67aef service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:39.114517 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-05c18310-65ba-437b-a745-41f1eff67aef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:39.129548 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c18310-65ba-437b-a745-41f1eff67aef service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:39.136170 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9817a2-51f1-4093-9c6b-3881be1020d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:39.137393 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9817a2-51f1-4093-9c6b-3881be1020d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:39.137677 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9817a2-51f1-4093-9c6b-3881be1020d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:39.137953 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9817a2-51f1-4093-9c6b-3881be1020d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:39.138670 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9817a2-51f1-4093-9c6b-3881be1020d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:39.142046 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9817a2-51f1-4093-9c6b-3881be1020d3 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:39.206245 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bc1c1-f4ef-4e5b-ae97-630e948f028e None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:39.209274 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5b9bc1c1-f4ef-4e5b-ae97-630e948f028e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:39.217789 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:39.222450 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bc1c1-f4ef-4e5b-ae97-630e948f028e None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:39.227846 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb266a2-5b3d-4531-b9b6-6882401ed25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:39.228459 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb266a2-5b3d-4531-b9b6-6882401ed25c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:39.228734 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb266a2-5b3d-4531-b9b6-6882401ed25c admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:39.229006 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb266a2-5b3d-4531-b9b6-6882401ed25c admin admin] PATH_INFO: `/v3/projects/4278e3867d52423b80571191c778e35d` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:39.230521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb266a2-5b3d-4531-b9b6-6882401ed25c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4278e3867d52423b80571191c778e35d)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:39.232431 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb266a2-5b3d-4531-b9b6-6882401ed25c admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:39.237209 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1373/2733] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:55:39 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:55:39.240959 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9817a2-51f1-4093-9c6b-3881be1020d3 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:39.322888 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9817a2-51f1-4093-9c6b-3881be1020d3 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:39.328821 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8b7db-11e2-4d4d-999d-f10b737ed9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:39.329614 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8b7db-11e2-4d4d-999d-f10b737ed9ca admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:39.329904 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8b7db-11e2-4d4d-999d-f10b737ed9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:39.330183 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8b7db-11e2-4d4d-999d-f10b737ed9ca admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:39.330841 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8b7db-11e2-4d4d-999d-f10b737ed9ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:39.332876 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8b7db-11e2-4d4d-999d-f10b737ed9ca admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:39.410096 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ecb266a2-5b3d-4531-b9b6-6882401ed25c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4278e3867d52423b80571191c778e35d', 'request_id': 'req-ecb266a2-5b3d-4531-b9b6-6882401ed25c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:39.416947 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ecb266a2-5b3d-4531-b9b6-6882401ed25c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4278e3867d52423b80571191c778e35d', 'request_id': 'req-ecb266a2-5b3d-4531-b9b6-6882401ed25c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:39.455914 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1374/2734] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:55:39 2022] POST /identity/v3/users => generated 299 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:55:39.459993 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8b7db-11e2-4d4d-999d-f10b737ed9ca admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:39.471172 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8b7db-11e2-4d4d-999d-f10b737ed9ca admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:39.478114 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ecb266a2-5b3d-4531-b9b6-6882401ed25c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4278e3867d52423b80571191c778e35d', 'request_id': 'req-ecb266a2-5b3d-4531-b9b6-6882401ed25c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:39.491440 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ecb266a2-5b3d-4531-b9b6-6882401ed25c admin admin] The token cache is being invalidate because project 4278e3867d52423b80571191c778e35d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:55:39.491871 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ecb266a2-5b3d-4531-b9b6-6882401ed25c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:39.492654 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ecb266a2-5b3d-4531-b9b6-6882401ed25c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:55:39.496211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1361/2735] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:55:39 2022] DELETE /identity/v3/projects/4278e3867d52423b80571191c778e35d => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:55:39.502569 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d53fc-d659-4d66-b974-ae0e3e7195da None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:39.502969 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d53fc-d659-4d66-b974-ae0e3e7195da None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:39.503469 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d53fc-d659-4d66-b974-ae0e3e7195da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:39.523927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-085d53fc-d659-4d66-b974-ae0e3e7195da None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:55:39.525172 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-085d53fc-d659-4d66-b974-ae0e3e7195da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:39.538102 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d69a8a-864a-4bb2-a2e4-79f6d34e5aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:39.538734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d69a8a-864a-4bb2-a2e4-79f6d34e5aec admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:39.539019 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d69a8a-864a-4bb2-a2e4-79f6d34e5aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:39.539736 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d69a8a-864a-4bb2-a2e4-79f6d34e5aec admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:39.539994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d69a8a-864a-4bb2-a2e4-79f6d34e5aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:39.541633 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d69a8a-864a-4bb2-a2e4-79f6d34e5aec admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:39.554714 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1375/2736] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:55:39.559385 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d69a8a-864a-4bb2-a2e4-79f6d34e5aec admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:39.562181 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e7d69a8a-864a-4bb2-a2e4-79f6d34e5aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:39.577542 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d69a8a-864a-4bb2-a2e4-79f6d34e5aec admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:39.582979 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc40c91-6a06-4316-887f-f56e4e343e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:39.583749 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc40c91-6a06-4316-887f-f56e4e343e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:39.584021 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc40c91-6a06-4316-887f-f56e4e343e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:39.584488 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc40c91-6a06-4316-887f-f56e4e343e12 admin admin] PATH_INFO: `/v3/projects/383e8cd4fc6541818bfa0615c288c07e/users/1a73109fe8fe4443adad6cefa097314a/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:39.610444 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1362/2737] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:55:39.618717 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9f135-98b7-42d4-ac2f-d4632f3ee37b None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:39.619036 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9f135-98b7-42d4-ac2f-d4632f3ee37b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:39.619293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9f135-98b7-42d4-ac2f-d4632f3ee37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:39.624223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc40c91-6a06-4316-887f-f56e4e343e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=383e8cd4fc6541818bfa0615c288c07e, user_id=1a73109fe8fe4443adad6cefa097314a, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:39.626973 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc40c91-6a06-4316-887f-f56e4e343e12 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:39.643615 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-c5d9f135-98b7-42d4-ac2f-d4632f3ee37b None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:55:39.644996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c5d9f135-98b7-42d4-ac2f-d4632f3ee37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:39.654591 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1363/2738] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:55:39.659720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9f135-98b7-42d4-ac2f-d4632f3ee37b None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:39.669327 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9f135-98b7-42d4-ac2f-d4632f3ee37b None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:39.674586 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17294cb-e3cd-48a7-9c2c-63143702a615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:39.675207 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17294cb-e3cd-48a7-9c2c-63143702a615 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:39.675524 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17294cb-e3cd-48a7-9c2c-63143702a615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:39.675796 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17294cb-e3cd-48a7-9c2c-63143702a615 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:39.676462 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17294cb-e3cd-48a7-9c2c-63143702a615 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:55:39.676762 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17294cb-e3cd-48a7-9c2c-63143702a615 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:39.678368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17294cb-e3cd-48a7-9c2c-63143702a615 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:39.692228 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1364/2739] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:55:39.697005 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17294cb-e3cd-48a7-9c2c-63143702a615 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:39.707716 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17294cb-e3cd-48a7-9c2c-63143702a615 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:39.712945 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581220c-9b92-4852-9de8-b009a92c192c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:39.719555 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581220c-9b92-4852-9de8-b009a92c192c admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:39.719555 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581220c-9b92-4852-9de8-b009a92c192c admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:39.719555 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581220c-9b92-4852-9de8-b009a92c192c admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:39.719555 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581220c-9b92-4852-9de8-b009a92c192c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:39.719555 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581220c-9b92-4852-9de8-b009a92c192c admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:39.747712 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1376/2740] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:55:39 2022] PUT /identity/v3/projects/383e8cd4fc6541818bfa0615c288c07e/users/1a73109fe8fe4443adad6cefa097314a/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:55:39.752525 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc40c91-6a06-4316-887f-f56e4e343e12 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:39.794586 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:39.819218 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc40c91-6a06-4316-887f-f56e4e343e12 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:39.823174 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1365/2741] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:55:39 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:55:39.827861 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd64ae-cecc-4896-b9f0-4661680052e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:39.828372 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581220c-9b92-4852-9de8-b009a92c192c admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:39.828539 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd64ae-cecc-4896-b9f0-4661680052e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:39.828861 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd64ae-cecc-4896-b9f0-4661680052e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:39.829182 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd64ae-cecc-4896-b9f0-4661680052e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:39.829846 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd64ae-cecc-4896-b9f0-4661680052e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:39.831595 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd64ae-cecc-4896-b9f0-4661680052e2 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:39.850300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1377/2742] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:55:39.851401 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd64ae-cecc-4896-b9f0-4661680052e2 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:39.862575 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd64ae-cecc-4896-b9f0-4661680052e2 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:39.897330 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:39.913405 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581220c-9b92-4852-9de8-b009a92c192c admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:39.925876 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08879b5-efe9-4c1f-a4ee-49a2e0ccbec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:39.926924 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08879b5-efe9-4c1f-a4ee-49a2e0ccbec6 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:39.927524 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08879b5-efe9-4c1f-a4ee-49a2e0ccbec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:39.927987 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08879b5-efe9-4c1f-a4ee-49a2e0ccbec6 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:39.929205 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08879b5-efe9-4c1f-a4ee-49a2e0ccbec6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:39.931100 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64268ed-7b53-408e-a798-e1aa6d6bbca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:39.931876 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64268ed-7b53-408e-a798-e1aa6d6bbca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:39.932231 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64268ed-7b53-408e-a798-e1aa6d6bbca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:39.932577 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64268ed-7b53-408e-a798-e1aa6d6bbca9 admin admin] PATH_INFO: `/v3/projects/383e8cd4fc6541818bfa0615c288c07e/users/1a73109fe8fe4443adad6cefa097314a/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:39.933124 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08879b5-efe9-4c1f-a4ee-49a2e0ccbec6 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:39.934833 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64268ed-7b53-408e-a798-e1aa6d6bbca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=383e8cd4fc6541818bfa0615c288c07e, user_id=1a73109fe8fe4443adad6cefa097314a, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:39.938713 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64268ed-7b53-408e-a798-e1aa6d6bbca9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:39.950669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1378/2743] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:55:39 2022] PUT /identity/v3/projects/383e8cd4fc6541818bfa0615c288c07e/users/1a73109fe8fe4443adad6cefa097314a/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:55:40.068854 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1366/2744] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:55:39 2022] POST /identity/v3/users => generated 287 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:55:40.070357 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64268ed-7b53-408e-a798-e1aa6d6bbca9 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:40.147555 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64268ed-7b53-408e-a798-e1aa6d6bbca9 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:40.158455 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e44f14-da5a-4d9f-9f67-bff4902fb78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:40.159097 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e44f14-da5a-4d9f-9f67-bff4902fb78c admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:40.159413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e44f14-da5a-4d9f-9f67-bff4902fb78c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:40.160256 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e44f14-da5a-4d9f-9f67-bff4902fb78c admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:40.161121 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e44f14-da5a-4d9f-9f67-bff4902fb78c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:40.164826 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e44f14-da5a-4d9f-9f67-bff4902fb78c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:40.176940 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1379/2745] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:55:40.184293 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08879b5-efe9-4c1f-a4ee-49a2e0ccbec6 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:40.196766 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08879b5-efe9-4c1f-a4ee-49a2e0ccbec6 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:40.202593 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fadf822-7104-4c9f-9e8d-9b6b01054993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:40.203230 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadf822-7104-4c9f-9e8d-9b6b01054993 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:40.203599 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadf822-7104-4c9f-9e8d-9b6b01054993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:40.203876 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadf822-7104-4c9f-9e8d-9b6b01054993 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:40.204531 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fadf822-7104-4c9f-9e8d-9b6b01054993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:40.206162 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fadf822-7104-4c9f-9e8d-9b6b01054993 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:40.218424 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1367/2746] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:55:40.222721 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e44f14-da5a-4d9f-9f67-bff4902fb78c admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:40.232941 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e44f14-da5a-4d9f-9f67-bff4902fb78c admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:40.239295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c359f-b439-4258-a3f8-627d5b76e9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:40.240016 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c359f-b439-4258-a3f8-627d5b76e9c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:40.240277 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c359f-b439-4258-a3f8-627d5b76e9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:40.240554 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c359f-b439-4258-a3f8-627d5b76e9c8 admin admin] PATH_INFO: `/v3/projects/f039992e08ee42eda9beb11022c4a31f/users/ac4cfc2c25c64bf08fed585fac4a94b7/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:40.256630 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c359f-b439-4258-a3f8-627d5b76e9c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f039992e08ee42eda9beb11022c4a31f, user_id=ac4cfc2c25c64bf08fed585fac4a94b7, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:40.259387 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c359f-b439-4258-a3f8-627d5b76e9c8 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:40.372673 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1380/2747] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:55:40 2022] PUT /identity/v3/projects/f039992e08ee42eda9beb11022c4a31f/users/ac4cfc2c25c64bf08fed585fac4a94b7/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:55:40.378300 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7f3b7-c9b0-4fe7-8307-e5fbd8d52963 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:40.378300 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7f3b7-c9b0-4fe7-8307-e5fbd8d52963 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:40.378661 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7f3b7-c9b0-4fe7-8307-e5fbd8d52963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:40.399957 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-dfc7f3b7-c9b0-4fe7-8307-e5fbd8d52963 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:55:40.401534 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-dfc7f3b7-c9b0-4fe7-8307-e5fbd8d52963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:40.474844 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1368/2748] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:55:40.485226 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c359f-b439-4258-a3f8-627d5b76e9c8 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:40.487690 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8b3c359f-b439-4258-a3f8-627d5b76e9c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:40.539588 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:40.556705 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c359f-b439-4258-a3f8-627d5b76e9c8 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:40.561144 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a1a87-982e-46db-99cf-488c64e8e548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:40.561821 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a1a87-982e-46db-99cf-488c64e8e548 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:40.562170 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a1a87-982e-46db-99cf-488c64e8e548 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:40.562509 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a1a87-982e-46db-99cf-488c64e8e548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:40.572238 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a1a87-982e-46db-99cf-488c64e8e548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:40.574049 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a1a87-982e-46db-99cf-488c64e8e548 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:40.587594 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1381/2749] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:55:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:55:48.257269 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38fb32-69e0-4091-8867-c3810983dd40 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:48.257269 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38fb32-69e0-4091-8867-c3810983dd40 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:48.257269 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38fb32-69e0-4091-8867-c3810983dd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:48.294451 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-0d38fb32-69e0-4091-8867-c3810983dd40 None None] MFA Rules not processed for user `1a73109fe8fe4443adad6cefa097314a`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:55:48.295787 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-0d38fb32-69e0-4091-8867-c3810983dd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:48.420666 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1369/2750] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:55:48 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:55:48.438303 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a1a87-982e-46db-99cf-488c64e8e548 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:48.440768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f79a1a87-982e-46db-99cf-488c64e8e548 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:48.546858 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a1a87-982e-46db-99cf-488c64e8e548 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:48.551539 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314989be-f22c-4252-ae81-6eacd86baaa7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7690af0cd266458f9cdd799c98ff5bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:48.552424 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314989be-f22c-4252-ae81-6eacd86baaa7 service glance] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:48.552879 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314989be-f22c-4252-ae81-6eacd86baaa7 service glance] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:48.553343 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314989be-f22c-4252-ae81-6eacd86baaa7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:48.556582 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-314989be-f22c-4252-ae81-6eacd86baaa7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:48.679912 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314989be-f22c-4252-ae81-6eacd86baaa7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:48.682160 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314989be-f22c-4252-ae81-6eacd86baaa7 service glance] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:48.698153 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1382/2751] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:55:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:55:49.154805 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597483af-0a74-467b-9e39-67d9023ecce7 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:49.155284 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597483af-0a74-467b-9e39-67d9023ecce7 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:49.155780 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597483af-0a74-467b-9e39-67d9023ecce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:49.261344 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-597483af-0a74-467b-9e39-67d9023ecce7 None None] MFA Rules not processed for user `84fcccb19a5e43ac9da5d7ca501563e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:55:49.264872 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-597483af-0a74-467b-9e39-67d9023ecce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:49.269554 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6fa91-3124-463a-b492-b0470f54f5bc None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:49.270265 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6fa91-3124-463a-b492-b0470f54f5bc None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:49.270779 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6fa91-3124-463a-b492-b0470f54f5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:49.359109 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-92b6fa91-3124-463a-b492-b0470f54f5bc None None] MFA Rules not processed for user `ac4cfc2c25c64bf08fed585fac4a94b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:55:49.361412 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-92b6fa91-3124-463a-b492-b0470f54f5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:49.373944 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:49.440132 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1370/2752] 10.222.0.26 () {58 vars in 1009 bytes} [Sun Sep 11 08:55:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:55:49.502888 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1383/2753] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:55:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:55:49.509071 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597483af-0a74-467b-9e39-67d9023ecce7 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:49.522253 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597483af-0a74-467b-9e39-67d9023ecce7 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:49.528107 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a1649-afd6-41c8-b814-98e7a78f5a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:49.528750 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a1649-afd6-41c8-b814-98e7a78f5a6d admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:49.529736 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a1649-afd6-41c8-b814-98e7a78f5a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:49.532291 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a1649-afd6-41c8-b814-98e7a78f5a6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:49.532291 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a1649-afd6-41c8-b814-98e7a78f5a6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:49.533001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a1649-afd6-41c8-b814-98e7a78f5a6d admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:49.627501 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6fa91-3124-463a-b492-b0470f54f5bc None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:49.629228 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-92b6fa91-3124-463a-b492-b0470f54f5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:55:49.655155 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1371/2754] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:55:49 2022] POST /identity/v3/projects => generated 371 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:55:49.661347 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a1649-afd6-41c8-b814-98e7a78f5a6d admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:49.689302 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:49.782491 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6fa91-3124-463a-b492-b0470f54f5bc None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:49.791815 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a1649-afd6-41c8-b814-98e7a78f5a6d admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:49.798579 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0ec4d-0f25-48df-97e9-c81ff28da4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:49.799973 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0ec4d-0f25-48df-97e9-c81ff28da4e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:49.800458 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0ec4d-0f25-48df-97e9-c81ff28da4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:49.800942 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0ec4d-0f25-48df-97e9-c81ff28da4e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:49.801851 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0ec4d-0f25-48df-97e9-c81ff28da4e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:49.804359 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0ec4d-0f25-48df-97e9-c81ff28da4e4 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:49.870282 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218deb39-6830-4b4c-8478-e40706c24d7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a4f25df9724d34afdd6a41e719546a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:49.870282 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218deb39-6830-4b4c-8478-e40706c24d7b service swift] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:49.870282 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218deb39-6830-4b4c-8478-e40706c24d7b service swift] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:49.870282 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218deb39-6830-4b4c-8478-e40706c24d7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:49.915378 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1372/2755] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:55:49 2022] POST /identity/v3/users => generated 292 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:55:49.919851 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0ec4d-0f25-48df-97e9-c81ff28da4e4 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:49.935003 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0ec4d-0f25-48df-97e9-c81ff28da4e4 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:49.945487 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4edb5-46e9-4ea9-a658-6e6e7d2fa4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:49.946440 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4edb5-46e9-4ea9-a658-6e6e7d2fa4bf admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:49.946727 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4edb5-46e9-4ea9-a658-6e6e7d2fa4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:49.947005 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4edb5-46e9-4ea9-a658-6e6e7d2fa4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:49.947818 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4edb5-46e9-4ea9-a658-6e6e7d2fa4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:49.949702 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4edb5-46e9-4ea9-a658-6e6e7d2fa4bf admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:49.964001 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1373/2756] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:55:49.969235 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4edb5-46e9-4ea9-a658-6e6e7d2fa4bf admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:49.971839 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218deb39-6830-4b4c-8478-e40706c24d7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:49.973691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218deb39-6830-4b4c-8478-e40706c24d7b service swift] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:49.981334 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4edb5-46e9-4ea9-a658-6e6e7d2fa4bf admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:49.983732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1384/2757] 10.222.0.26 () {60 vars in 1384 bytes} [Sun Sep 11 08:55:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 11 08:55:49.989918 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd10d4-ac43-4d70-b3da-d6ea929c1d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:49.990626 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd10d4-ac43-4d70-b3da-d6ea929c1d3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:49.990997 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd10d4-ac43-4d70-b3da-d6ea929c1d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:49.991341 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd10d4-ac43-4d70-b3da-d6ea929c1d3f admin admin] PATH_INFO: `/v3/projects/c4fec252f004429aa94111b57e8253bd/users/ea41d6a276a44cfe9d113d6ee9cf91e8/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:50.011818 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd10d4-ac43-4d70-b3da-d6ea929c1d3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4fec252f004429aa94111b57e8253bd, user_id=ea41d6a276a44cfe9d113d6ee9cf91e8, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:50.016187 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd10d4-ac43-4d70-b3da-d6ea929c1d3f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:50.125193 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1374/2758] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:55:49 2022] PUT /identity/v3/projects/c4fec252f004429aa94111b57e8253bd/users/ea41d6a276a44cfe9d113d6ee9cf91e8/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:55:50.126159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218deb39-6830-4b4c-8478-e40706c24d7b service swift] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:50.143147 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218deb39-6830-4b4c-8478-e40706c24d7b service swift] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:50.243582 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2af99-8d72-422d-a316-c20d97cdbbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:50.244815 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2af99-8d72-422d-a316-c20d97cdbbbe admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:50.245453 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2af99-8d72-422d-a316-c20d97cdbbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:50.246020 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2af99-8d72-422d-a316-c20d97cdbbbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:50.247415 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2af99-8d72-422d-a316-c20d97cdbbbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:50.251399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2af99-8d72-422d-a316-c20d97cdbbbe admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:50.278234 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd10d4-ac43-4d70-b3da-d6ea929c1d3f admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:55:50.284754 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1385/2759] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:55:50.293253 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd10d4-ac43-4d70-b3da-d6ea929c1d3f admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:55:50.300730 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa2e70-8085-4579-a605-baf4ec179bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:55:50.301667 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa2e70-8085-4579-a605-baf4ec179bc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:55:50.302092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa2e70-8085-4579-a605-baf4ec179bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:55:50.302445 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa2e70-8085-4579-a605-baf4ec179bc8 admin admin] PATH_INFO: `/v3/projects/c4fec252f004429aa94111b57e8253bd/users/ea41d6a276a44cfe9d113d6ee9cf91e8/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:55:50.305094 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa2e70-8085-4579-a605-baf4ec179bc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4fec252f004429aa94111b57e8253bd, user_id=ea41d6a276a44cfe9d113d6ee9cf91e8, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:55:50.315051 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa2e70-8085-4579-a605-baf4ec179bc8 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:55:50.339151 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1375/2760] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:55:50 2022] PUT /identity/v3/projects/c4fec252f004429aa94111b57e8253bd/users/ea41d6a276a44cfe9d113d6ee9cf91e8/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:56:00.261995 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:56:00.333096 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=67,keystone:INSERT=6 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:56:01.410241 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1216b3-0229-4528-b01f-70970eddcea6 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:56:01.410241 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1216b3-0229-4528-b01f-70970eddcea6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:56:01.410241 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1216b3-0229-4528-b01f-70970eddcea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:56:01.439431 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2d1216b3-0229-4528-b01f-70970eddcea6 None None] MFA Rules not processed for user `ea41d6a276a44cfe9d113d6ee9cf91e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:56:01.440729 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2d1216b3-0229-4528-b01f-70970eddcea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:56:01.584669 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1386/2761] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:56:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:56:01.593932 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa2e70-8085-4579-a605-baf4ec179bc8 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:56:01.596735 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d3aa2e70-8085-4579-a605-baf4ec179bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:56:01.815627 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa2e70-8085-4579-a605-baf4ec179bc8 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:56:01.832963 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edc6d3-a189-4d04-962f-43a3967e833d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:56:01.834012 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edc6d3-a189-4d04-962f-43a3967e833d service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:56:01.834488 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edc6d3-a189-4d04-962f-43a3967e833d service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:56:01.840737 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edc6d3-a189-4d04-962f-43a3967e833d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:56:01.978497 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edc6d3-a189-4d04-962f-43a3967e833d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:56:01.980452 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edc6d3-a189-4d04-962f-43a3967e833d service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:56:01.998149 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1376/2762] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:56:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:56:06.453446 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6673a3-b507-47d7-b063-5c1ce32c1529 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:56:06.454178 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6673a3-b507-47d7-b063-5c1ce32c1529 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:56:06.454492 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6673a3-b507-47d7-b063-5c1ce32c1529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:56:06.500841 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-bc6673a3-b507-47d7-b063-5c1ce32c1529 None None] MFA Rules not processed for user `ac4cfc2c25c64bf08fed585fac4a94b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:56:06.502894 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-bc6673a3-b507-47d7-b063-5c1ce32c1529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:56:06.531678 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1387/2763] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:56:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:56:08.400776 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ea7a9-6cfb-4a7c-b05f-b21d55c53a04 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:56:08.408169 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ea7a9-6cfb-4a7c-b05f-b21d55c53a04 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:56:08.408169 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ea7a9-6cfb-4a7c-b05f-b21d55c53a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:56:08.442819 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-8e9ea7a9-6cfb-4a7c-b05f-b21d55c53a04 None None] MFA Rules not processed for user `a689ca2ce6a34716973ceb56826a4676`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:56:08.444527 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-8e9ea7a9-6cfb-4a7c-b05f-b21d55c53a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:56:08.522170 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1377/2764] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:56:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:56:12.524535 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226431cc-c57b-4bfb-8461-736c58e881c3 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:56:12.525594 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226431cc-c57b-4bfb-8461-736c58e881c3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:56:12.526226 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226431cc-c57b-4bfb-8461-736c58e881c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:56:12.561200 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-226431cc-c57b-4bfb-8461-736c58e881c3 None None] MFA Rules not processed for user `9f2b2835fdcd46e491e246799abd402b`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:56:12.563414 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-226431cc-c57b-4bfb-8461-736c58e881c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:56:12.646380 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1388/2765] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:56:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:56:12.985140 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bdef2-5a77-41ed-8e61-f84a05466daf None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:56:12.985822 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bdef2-5a77-41ed-8e61-f84a05466daf None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:56:12.985822 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bdef2-5a77-41ed-8e61-f84a05466daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:56:13.011373 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-e86bdef2-5a77-41ed-8e61-f84a05466daf None None] MFA Rules not processed for user `84fcccb19a5e43ac9da5d7ca501563e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:56:13.012857 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e86bdef2-5a77-41ed-8e61-f84a05466daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:56:13.038154 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:56:13.104900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1378/2766] 10.222.0.26 () {58 vars in 1009 bytes} [Sun Sep 11 08:56:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:56:13.123854 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226431cc-c57b-4bfb-8461-736c58e881c3 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:56:13.240078 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226431cc-c57b-4bfb-8461-736c58e881c3 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:56:13.250444 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193907bc-b75f-4f51-a6a3-8070f117a7d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a4f25df9724d34afdd6a41e719546a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:56:13.251069 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193907bc-b75f-4f51-a6a3-8070f117a7d8 service swift] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:56:13.251377 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193907bc-b75f-4f51-a6a3-8070f117a7d8 service swift] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:56:13.251712 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193907bc-b75f-4f51-a6a3-8070f117a7d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:56:13.265832 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193907bc-b75f-4f51-a6a3-8070f117a7d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:56:13.267544 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193907bc-b75f-4f51-a6a3-8070f117a7d8 service swift] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:56:13.277792 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1389/2767] 10.222.0.26 () {60 vars in 1384 bytes} [Sun Sep 11 08:56:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 11 08:56:23.092355 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=15 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:56:23.274250 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=94 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:56:36.996323 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86bdef2-5a77-41ed-8e61-f84a05466daf None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:56:37.052586 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86bdef2-5a77-41ed-8e61-f84a05466daf None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:56:37.056120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e20e8a-d8b8-46f0-8ada-42fb5051c376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:56:37.056765 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e20e8a-d8b8-46f0-8ada-42fb5051c376 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:56:37.057048 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e20e8a-d8b8-46f0-8ada-42fb5051c376 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:56:37.057322 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e20e8a-d8b8-46f0-8ada-42fb5051c376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:56:37.127063 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e20e8a-d8b8-46f0-8ada-42fb5051c376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:56:37.128558 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e20e8a-d8b8-46f0-8ada-42fb5051c376 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:56:37.139433 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1379/2768] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:56:36 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:56:41.658279 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193907bc-b75f-4f51-a6a3-8070f117a7d8 service swift] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:56:41.669313 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193907bc-b75f-4f51-a6a3-8070f117a7d8 service swift] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:56:41.677572 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7d0b3-be6a-45ff-86d5-527859d8397a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:56:41.678205 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7d0b3-be6a-45ff-86d5-527859d8397a service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:56:41.678485 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7d0b3-be6a-45ff-86d5-527859d8397a service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:56:41.678761 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7d0b3-be6a-45ff-86d5-527859d8397a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:56:41.694924 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7d0b3-be6a-45ff-86d5-527859d8397a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:56:41.696528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7d0b3-be6a-45ff-86d5-527859d8397a service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:56:41.707633 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1390/2769] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:56:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:56:47.134832 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=50 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:56:51.702449 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=6 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:57:07.564186 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e20e8a-d8b8-46f0-8ada-42fb5051c376 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:07.572969 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e20e8a-d8b8-46f0-8ada-42fb5051c376 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:07.580402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491da91-affc-476c-b563-02380f9edb2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:07.580402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491da91-affc-476c-b563-02380f9edb2d service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:07.580402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491da91-affc-476c-b563-02380f9edb2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:07.580402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491da91-affc-476c-b563-02380f9edb2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:07.580831 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d491da91-affc-476c-b563-02380f9edb2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:57:07.595794 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491da91-affc-476c-b563-02380f9edb2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:07.597237 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491da91-affc-476c-b563-02380f9edb2d service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:07.608903 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1380/2770] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:57:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:57:08.845239 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7d0b3-be6a-45ff-86d5-527859d8397a service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:08.854223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7d0b3-be6a-45ff-86d5-527859d8397a service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:08.857963 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128d7d0-130a-4e47-8436-9023b94911cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:08.859204 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128d7d0-130a-4e47-8436-9023b94911cf service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:08.859499 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128d7d0-130a-4e47-8436-9023b94911cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:08.859769 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128d7d0-130a-4e47-8436-9023b94911cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:08.861528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5128d7d0-130a-4e47-8436-9023b94911cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:57:08.875454 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128d7d0-130a-4e47-8436-9023b94911cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:08.876884 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128d7d0-130a-4e47-8436-9023b94911cf service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:08.888029 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1391/2771] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:57:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:57:17.603688 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=6 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:57:18.882963 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=6 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:57:34.575188 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491da91-affc-476c-b563-02380f9edb2d service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:34.577077 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d491da91-affc-476c-b563-02380f9edb2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:57:34.589176 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491da91-affc-476c-b563-02380f9edb2d service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:34.594020 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0540c9-368a-4f00-bab7-31f55cc0c6ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:34.594641 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0540c9-368a-4f00-bab7-31f55cc0c6ec service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:34.594926 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0540c9-368a-4f00-bab7-31f55cc0c6ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:34.595447 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0540c9-368a-4f00-bab7-31f55cc0c6ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:34.597244 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-da0540c9-368a-4f00-bab7-31f55cc0c6ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:57:34.678267 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0540c9-368a-4f00-bab7-31f55cc0c6ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:34.679885 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0540c9-368a-4f00-bab7-31f55cc0c6ec service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:34.694398 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1381/2772] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:57:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:57:36.748293 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128d7d0-130a-4e47-8436-9023b94911cf service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:36.750588 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5128d7d0-130a-4e47-8436-9023b94911cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:57:36.826957 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128d7d0-130a-4e47-8436-9023b94911cf service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:36.832250 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc67fb-0e15-4ab5-8a14-8088e64cb5d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a48c49f7a9f44cef89dd024fecea422f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:36.832864 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc67fb-0e15-4ab5-8a14-8088e64cb5d5 service placement] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:36.833147 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc67fb-0e15-4ab5-8a14-8088e64cb5d5 service placement] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:36.833421 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc67fb-0e15-4ab5-8a14-8088e64cb5d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:36.835372 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-13dc67fb-0e15-4ab5-8a14-8088e64cb5d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:57:36.848246 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc67fb-0e15-4ab5-8a14-8088e64cb5d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:36.849877 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc67fb-0e15-4ab5-8a14-8088e64cb5d5 service placement] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:36.861471 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1392/2773] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:57:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:57:36.900927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0540c9-368a-4f00-bab7-31f55cc0c6ec service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:36.900927 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-da0540c9-368a-4f00-bab7-31f55cc0c6ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:57:36.909327 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0540c9-368a-4f00-bab7-31f55cc0c6ec service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:36.914677 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c7fef-e5c4-4d3d-8243-ff065c3d64b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:36.915489 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c7fef-e5c4-4d3d-8243-ff065c3d64b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:36.915772 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c7fef-e5c4-4d3d-8243-ff065c3d64b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:36.916047 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c7fef-e5c4-4d3d-8243-ff065c3d64b8 admin admin] PATH_INFO: `/v3/users/9f2b2835fdcd46e491e246799abd402b` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:36.917227 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c7fef-e5c4-4d3d-8243-ff065c3d64b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f2b2835fdcd46e491e246799abd402b)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:36.919184 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c7fef-e5c4-4d3d-8243-ff065c3d64b8 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:37.120417 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1a1c7fef-e5c4-4d3d-8243-ff065c3d64b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f2b2835fdcd46e491e246799abd402b'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:37.121135 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1a1c7fef-e5c4-4d3d-8243-ff065c3d64b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f2b2835fdcd46e491e246799abd402b'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:37.129431 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1a1c7fef-e5c4-4d3d-8243-ff065c3d64b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f2b2835fdcd46e491e246799abd402b'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:37.130907 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1a1c7fef-e5c4-4d3d-8243-ff065c3d64b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f2b2835fdcd46e491e246799abd402b'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:37.189814 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1a1c7fef-e5c4-4d3d-8243-ff065c3d64b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f2b2835fdcd46e491e246799abd402b'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:37.212414 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1382/2774] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:57:36 2022] DELETE /identity/v3/users/9f2b2835fdcd46e491e246799abd402b => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:57:37.454933 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc67fb-0e15-4ab5-8a14-8088e64cb5d5 service placement] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:37.472198 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc67fb-0e15-4ab5-8a14-8088e64cb5d5 service placement] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:37.538244 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e553710-d59f-48bc-aa90-423525b05e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:37.538881 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e553710-d59f-48bc-aa90-423525b05e55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:37.539158 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e553710-d59f-48bc-aa90-423525b05e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:37.539475 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e553710-d59f-48bc-aa90-423525b05e55 admin admin] PATH_INFO: `/v3/projects/57206fa8b5c046aa931a1adacf29a511` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:37.540760 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e553710-d59f-48bc-aa90-423525b05e55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57206fa8b5c046aa931a1adacf29a511)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:37.542809 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e553710-d59f-48bc-aa90-423525b05e55 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:37.643090 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4e553710-d59f-48bc-aa90-423525b05e55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57206fa8b5c046aa931a1adacf29a511', 'request_id': 'req-4e553710-d59f-48bc-aa90-423525b05e55'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:37.649030 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4e553710-d59f-48bc-aa90-423525b05e55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57206fa8b5c046aa931a1adacf29a511', 'request_id': 'req-4e553710-d59f-48bc-aa90-423525b05e55'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:37.698877 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4e553710-d59f-48bc-aa90-423525b05e55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57206fa8b5c046aa931a1adacf29a511', 'request_id': 'req-4e553710-d59f-48bc-aa90-423525b05e55'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:37.711491 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4e553710-d59f-48bc-aa90-423525b05e55 admin admin] The token cache is being invalidate because project 57206fa8b5c046aa931a1adacf29a511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:57:37.716657 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4e553710-d59f-48bc-aa90-423525b05e55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:37.716657 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4e553710-d59f-48bc-aa90-423525b05e55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:37.716657 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1393/2775] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:57:37 2022] DELETE /identity/v3/projects/57206fa8b5c046aa931a1adacf29a511 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:57:37.719771 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8039e-e110-487f-b54e-fe15f8229460 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:37.720060 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8039e-e110-487f-b54e-fe15f8229460 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:37.720336 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8039e-e110-487f-b54e-fe15f8229460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:37.740905 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-e6b8039e-e110-487f-b54e-fe15f8229460 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:57:37.742120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e6b8039e-e110-487f-b54e-fe15f8229460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:57:37.802846 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1383/2776] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:57:37.810940 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc67bd-c450-46a2-8092-141d4d95a88f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:37.811502 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc67bd-c450-46a2-8092-141d4d95a88f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:37.811502 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc67bd-c450-46a2-8092-141d4d95a88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:37.831212 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-8dbc67bd-c450-46a2-8092-141d4d95a88f None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:57:37.832471 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8dbc67bd-c450-46a2-8092-141d4d95a88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:57:37.840601 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1394/2777] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:57:37.850584 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8039e-e110-487f-b54e-fe15f8229460 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:37.863009 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8039e-e110-487f-b54e-fe15f8229460 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:37.867760 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ac56a-61b0-4ab2-9661-b1a71dae299e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:37.868405 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ac56a-61b0-4ab2-9661-b1a71dae299e admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:37.868686 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ac56a-61b0-4ab2-9661-b1a71dae299e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:37.868956 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ac56a-61b0-4ab2-9661-b1a71dae299e admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:37.869653 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ac56a-61b0-4ab2-9661-b1a71dae299e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:57:37.869952 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ac56a-61b0-4ab2-9661-b1a71dae299e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:37.871552 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ac56a-61b0-4ab2-9661-b1a71dae299e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:37.873268 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:57:37.884101 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1384/2778] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:57:37.888913 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc67bd-c450-46a2-8092-141d4d95a88f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:37.898498 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc67bd-c450-46a2-8092-141d4d95a88f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:37.903397 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571540ab-9c68-48ce-98ef-7a4a94b43725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:37.904009 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571540ab-9c68-48ce-98ef-7a4a94b43725 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:37.904292 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571540ab-9c68-48ce-98ef-7a4a94b43725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:37.904630 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571540ab-9c68-48ce-98ef-7a4a94b43725 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:37.905755 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571540ab-9c68-48ce-98ef-7a4a94b43725 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:37.907798 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571540ab-9c68-48ce-98ef-7a4a94b43725 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:37.919554 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:57:38.008330 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1395/2779] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:57:37 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:57:38.012624 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ac56a-61b0-4ab2-9661-b1a71dae299e admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:38.023002 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ac56a-61b0-4ab2-9661-b1a71dae299e admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:38.081944 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb6f4d-2e81-4c8b-9ab6-5416c30df610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:38.082570 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb6f4d-2e81-4c8b-9ab6-5416c30df610 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:38.082855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb6f4d-2e81-4c8b-9ab6-5416c30df610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:38.083132 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb6f4d-2e81-4c8b-9ab6-5416c30df610 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:38.083805 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb6f4d-2e81-4c8b-9ab6-5416c30df610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:38.085805 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb6f4d-2e81-4c8b-9ab6-5416c30df610 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:38.197024 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1385/2780] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:57:38 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:57:38.201259 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571540ab-9c68-48ce-98ef-7a4a94b43725 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:38.212328 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571540ab-9c68-48ce-98ef-7a4a94b43725 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:38.217631 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e906794-39c7-4af3-aebc-39dc0980d4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:38.218891 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e906794-39c7-4af3-aebc-39dc0980d4eb admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:38.219197 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e906794-39c7-4af3-aebc-39dc0980d4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:38.219571 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e906794-39c7-4af3-aebc-39dc0980d4eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:38.220258 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e906794-39c7-4af3-aebc-39dc0980d4eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:38.221874 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e906794-39c7-4af3-aebc-39dc0980d4eb admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:38.232572 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1396/2781] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:57:38.236874 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb6f4d-2e81-4c8b-9ab6-5416c30df610 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:38.247693 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb6f4d-2e81-4c8b-9ab6-5416c30df610 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:38.252432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7601f-72b0-40d6-bd68-77eb2760d2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:38.253053 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7601f-72b0-40d6-bd68-77eb2760d2ce admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:38.253338 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7601f-72b0-40d6-bd68-77eb2760d2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:38.253616 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7601f-72b0-40d6-bd68-77eb2760d2ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:38.254265 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7601f-72b0-40d6-bd68-77eb2760d2ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:38.255926 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7601f-72b0-40d6-bd68-77eb2760d2ce admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:38.268299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1386/2782] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:57:38.272574 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e906794-39c7-4af3-aebc-39dc0980d4eb admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:38.283864 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e906794-39c7-4af3-aebc-39dc0980d4eb admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:38.289447 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77682814-b935-43fc-9c2b-dc5cf589a0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:38.290358 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77682814-b935-43fc-9c2b-dc5cf589a0e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:38.290859 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77682814-b935-43fc-9c2b-dc5cf589a0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:38.291140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77682814-b935-43fc-9c2b-dc5cf589a0e7 admin admin] PATH_INFO: `/v3/projects/43d92862a47743fe86f1d34edf3cab67/users/006842bb07ea4acca8c5cd372b11c792/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:38.307122 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77682814-b935-43fc-9c2b-dc5cf589a0e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43d92862a47743fe86f1d34edf3cab67, user_id=006842bb07ea4acca8c5cd372b11c792, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:38.309999 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77682814-b935-43fc-9c2b-dc5cf589a0e7 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:38.397155 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1397/2783] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:57:38 2022] PUT /identity/v3/projects/43d92862a47743fe86f1d34edf3cab67/users/006842bb07ea4acca8c5cd372b11c792/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:57:38.409298 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03d07b-02c7-42b1-95ae-85ee859cf0d4 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:38.409584 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03d07b-02c7-42b1-95ae-85ee859cf0d4 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:38.409859 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03d07b-02c7-42b1-95ae-85ee859cf0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:38.440059 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-9b03d07b-02c7-42b1-95ae-85ee859cf0d4 None None] MFA Rules not processed for user `006842bb07ea4acca8c5cd372b11c792`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:57:38.441526 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9b03d07b-02c7-42b1-95ae-85ee859cf0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:57:38.519087 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1387/2784] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:57:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:57:38.531304 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77682814-b935-43fc-9c2b-dc5cf589a0e7 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:38.533452 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-77682814-b935-43fc-9c2b-dc5cf589a0e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:57:38.621181 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77682814-b935-43fc-9c2b-dc5cf589a0e7 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:38.629191 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49666075-cd56-49a9-96c6-6f1aea1b7a3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:38.629870 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49666075-cd56-49a9-96c6-6f1aea1b7a3f service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:38.630197 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49666075-cd56-49a9-96c6-6f1aea1b7a3f service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:38.630589 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49666075-cd56-49a9-96c6-6f1aea1b7a3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:38.640256 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49666075-cd56-49a9-96c6-6f1aea1b7a3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:38.641876 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49666075-cd56-49a9-96c6-6f1aea1b7a3f service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:38.651697 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1398/2785] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:57:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:57:44.708412 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03d07b-02c7-42b1-95ae-85ee859cf0d4 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:44.769749 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03d07b-02c7-42b1-95ae-85ee859cf0d4 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:44.774507 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533cccf8-9b67-470a-9f75-61987322ac53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:44.775170 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cccf8-9b67-470a-9f75-61987322ac53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:44.775488 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cccf8-9b67-470a-9f75-61987322ac53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:44.775767 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cccf8-9b67-470a-9f75-61987322ac53 admin admin] PATH_INFO: `/v3/users/006842bb07ea4acca8c5cd372b11c792` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:44.776972 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533cccf8-9b67-470a-9f75-61987322ac53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=006842bb07ea4acca8c5cd372b11c792)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:44.778931 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533cccf8-9b67-470a-9f75-61987322ac53 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:44.782143 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:57:44.969065 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-533cccf8-9b67-470a-9f75-61987322ac53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '006842bb07ea4acca8c5cd372b11c792'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:44.969729 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-533cccf8-9b67-470a-9f75-61987322ac53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '006842bb07ea4acca8c5cd372b11c792'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:44.976795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-533cccf8-9b67-470a-9f75-61987322ac53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '006842bb07ea4acca8c5cd372b11c792'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:44.977423 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-533cccf8-9b67-470a-9f75-61987322ac53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '006842bb07ea4acca8c5cd372b11c792'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:45.046892 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-533cccf8-9b67-470a-9f75-61987322ac53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '006842bb07ea4acca8c5cd372b11c792'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:45.065461 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1388/2786] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:57:44 2022] DELETE /identity/v3/users/006842bb07ea4acca8c5cd372b11c792 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:57:45.069955 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0aa7c0-6a49-44be-b2e2-386f5424bb44 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:45.070461 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0aa7c0-6a49-44be-b2e2-386f5424bb44 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:45.070572 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0aa7c0-6a49-44be-b2e2-386f5424bb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:45.090049 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-7a0aa7c0-6a49-44be-b2e2-386f5424bb44 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:57:45.091549 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7a0aa7c0-6a49-44be-b2e2-386f5424bb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:57:45.149261 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1399/2787] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:57:45.158993 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533cccf8-9b67-470a-9f75-61987322ac53 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:45.160490 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-533cccf8-9b67-470a-9f75-61987322ac53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:57:45.216855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533cccf8-9b67-470a-9f75-61987322ac53 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:45.221139 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db6ddc-85fe-4b2b-9bcf-21830f13c6e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:45.221679 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db6ddc-85fe-4b2b-9bcf-21830f13c6e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:45.221964 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db6ddc-85fe-4b2b-9bcf-21830f13c6e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:45.222249 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db6ddc-85fe-4b2b-9bcf-21830f13c6e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:45.231343 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db6ddc-85fe-4b2b-9bcf-21830f13c6e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:45.232776 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db6ddc-85fe-4b2b-9bcf-21830f13c6e4 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:45.243390 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1389/2788] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:57:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:57:45.654377 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0aa7c0-6a49-44be-b2e2-386f5424bb44 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:45.656548 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7a0aa7c0-6a49-44be-b2e2-386f5424bb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:57:45.668227 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0aa7c0-6a49-44be-b2e2-386f5424bb44 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:45.675353 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8fd5d-b267-47d6-bc37-0313daff65a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:45.676003 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8fd5d-b267-47d6-bc37-0313daff65a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:45.676279 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8fd5d-b267-47d6-bc37-0313daff65a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:45.676557 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8fd5d-b267-47d6-bc37-0313daff65a4 admin admin] PATH_INFO: `/v3/projects/43d92862a47743fe86f1d34edf3cab67` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:45.677768 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8fd5d-b267-47d6-bc37-0313daff65a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43d92862a47743fe86f1d34edf3cab67)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:45.679633 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8fd5d-b267-47d6-bc37-0313daff65a4 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:45.793402 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:57:45.804987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-43f8fd5d-b267-47d6-bc37-0313daff65a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43d92862a47743fe86f1d34edf3cab67', 'request_id': 'req-43f8fd5d-b267-47d6-bc37-0313daff65a4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:45.812095 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-43f8fd5d-b267-47d6-bc37-0313daff65a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43d92862a47743fe86f1d34edf3cab67', 'request_id': 'req-43f8fd5d-b267-47d6-bc37-0313daff65a4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:45.898199 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-43f8fd5d-b267-47d6-bc37-0313daff65a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43d92862a47743fe86f1d34edf3cab67', 'request_id': 'req-43f8fd5d-b267-47d6-bc37-0313daff65a4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:45.910984 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-43f8fd5d-b267-47d6-bc37-0313daff65a4 admin admin] The token cache is being invalidate because project 43d92862a47743fe86f1d34edf3cab67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:57:45.911315 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-43f8fd5d-b267-47d6-bc37-0313daff65a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:45.912066 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-43f8fd5d-b267-47d6-bc37-0313daff65a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:45.913551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1400/2789] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:57:45 2022] DELETE /identity/v3/projects/43d92862a47743fe86f1d34edf3cab67 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:57:45.918497 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58853bdd-0656-4b6a-a640-85d29d84c4e8 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:45.919022 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58853bdd-0656-4b6a-a640-85d29d84c4e8 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:45.919022 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58853bdd-0656-4b6a-a640-85d29d84c4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:45.938519 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-58853bdd-0656-4b6a-a640-85d29d84c4e8 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:57:45.939739 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-58853bdd-0656-4b6a-a640-85d29d84c4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:57:46.002770 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1390/2790] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:57:46.010631 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e2c99-e0db-4806-9938-2a2e7ae1e4b8 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:46.010915 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e2c99-e0db-4806-9938-2a2e7ae1e4b8 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:46.011190 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e2c99-e0db-4806-9938-2a2e7ae1e4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:46.031618 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-df1e2c99-e0db-4806-9938-2a2e7ae1e4b8 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:57:46.032881 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-df1e2c99-e0db-4806-9938-2a2e7ae1e4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:57:46.040993 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1401/2791] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:57:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:57:46.045418 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58853bdd-0656-4b6a-a640-85d29d84c4e8 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:46.055641 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58853bdd-0656-4b6a-a640-85d29d84c4e8 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:46.060755 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a084ad9-5e08-4dd8-a316-a329ccb2cd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:46.061365 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a084ad9-5e08-4dd8-a316-a329ccb2cd22 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:46.061650 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a084ad9-5e08-4dd8-a316-a329ccb2cd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:46.061924 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a084ad9-5e08-4dd8-a316-a329ccb2cd22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:46.063077 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a084ad9-5e08-4dd8-a316-a329ccb2cd22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:57:46.063426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a084ad9-5e08-4dd8-a316-a329ccb2cd22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:46.065033 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a084ad9-5e08-4dd8-a316-a329ccb2cd22 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:46.076683 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1391/2792] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:57:46.081659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e2c99-e0db-4806-9938-2a2e7ae1e4b8 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:46.090983 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e2c99-e0db-4806-9938-2a2e7ae1e4b8 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:46.096105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7bcfa-b5db-42c3-94c4-3ca797bdccbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:46.096693 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7bcfa-b5db-42c3-94c4-3ca797bdccbd admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:46.096974 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7bcfa-b5db-42c3-94c4-3ca797bdccbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:46.097344 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7bcfa-b5db-42c3-94c4-3ca797bdccbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:46.098000 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7bcfa-b5db-42c3-94c4-3ca797bdccbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:46.099958 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7bcfa-b5db-42c3-94c4-3ca797bdccbd admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:46.185647 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1402/2793] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:57:46 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:57:46.190542 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a084ad9-5e08-4dd8-a316-a329ccb2cd22 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:46.200838 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a084ad9-5e08-4dd8-a316-a329ccb2cd22 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:46.209251 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:57:46.258444 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4199d34-4a24-4f29-897f-f2d08adbb037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:46.259077 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4199d34-4a24-4f29-897f-f2d08adbb037 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:46.259450 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4199d34-4a24-4f29-897f-f2d08adbb037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:46.259728 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4199d34-4a24-4f29-897f-f2d08adbb037 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:46.260349 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4199d34-4a24-4f29-897f-f2d08adbb037 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:46.262315 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4199d34-4a24-4f29-897f-f2d08adbb037 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:46.321388 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1392/2794] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:57:46 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:57:46.325565 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7bcfa-b5db-42c3-94c4-3ca797bdccbd admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:46.336392 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7bcfa-b5db-42c3-94c4-3ca797bdccbd admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:46.344068 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56def9a-0f74-473d-9e4b-37557ffdd810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:46.344068 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56def9a-0f74-473d-9e4b-37557ffdd810 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:46.344068 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56def9a-0f74-473d-9e4b-37557ffdd810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:46.344068 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56def9a-0f74-473d-9e4b-37557ffdd810 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:46.344461 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56def9a-0f74-473d-9e4b-37557ffdd810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:46.344703 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56def9a-0f74-473d-9e4b-37557ffdd810 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:46.354806 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1403/2795] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:57:46.358818 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4199d34-4a24-4f29-897f-f2d08adbb037 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:46.369268 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4199d34-4a24-4f29-897f-f2d08adbb037 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:46.373936 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c33237-d6e8-49e5-9222-9208c72b44ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:46.374586 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c33237-d6e8-49e5-9222-9208c72b44ff admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:46.375435 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c33237-d6e8-49e5-9222-9208c72b44ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:46.375717 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c33237-d6e8-49e5-9222-9208c72b44ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:46.376357 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c33237-d6e8-49e5-9222-9208c72b44ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:46.377967 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c33237-d6e8-49e5-9222-9208c72b44ff admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:46.388492 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1393/2796] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:57:46.393007 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56def9a-0f74-473d-9e4b-37557ffdd810 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:46.403077 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56def9a-0f74-473d-9e4b-37557ffdd810 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:46.407765 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfe8f9-6d73-4a90-a2da-fe7c80a75603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:46.408435 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfe8f9-6d73-4a90-a2da-fe7c80a75603 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:46.408719 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfe8f9-6d73-4a90-a2da-fe7c80a75603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:46.408997 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfe8f9-6d73-4a90-a2da-fe7c80a75603 admin admin] PATH_INFO: `/v3/projects/28470bd2eaf14c5c9454723f5d7ba903/users/972ab1b40b1f4cf788566b3066655686/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:46.423999 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfe8f9-6d73-4a90-a2da-fe7c80a75603 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28470bd2eaf14c5c9454723f5d7ba903, user_id=972ab1b40b1f4cf788566b3066655686, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:46.426756 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfe8f9-6d73-4a90-a2da-fe7c80a75603 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:46.494001 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1404/2797] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:57:46 2022] PUT /identity/v3/projects/28470bd2eaf14c5c9454723f5d7ba903/users/972ab1b40b1f4cf788566b3066655686/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:57:46.505565 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5d8b3-30b2-4ec6-9178-65d1c481c8c6 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:46.505861 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5d8b3-30b2-4ec6-9178-65d1c481c8c6 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:46.506135 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5d8b3-30b2-4ec6-9178-65d1c481c8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:46.534953 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-02a5d8b3-30b2-4ec6-9178-65d1c481c8c6 None None] MFA Rules not processed for user `972ab1b40b1f4cf788566b3066655686`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:57:46.536266 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-02a5d8b3-30b2-4ec6-9178-65d1c481c8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:57:46.600496 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1394/2798] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:57:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:57:46.605140 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfe8f9-6d73-4a90-a2da-fe7c80a75603 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:46.664962 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfe8f9-6d73-4a90-a2da-fe7c80a75603 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:46.669752 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2136f33-68de-470b-8754-34f62319b77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:46.670362 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2136f33-68de-470b-8754-34f62319b77e admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:46.670645 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2136f33-68de-470b-8754-34f62319b77e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:46.670924 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2136f33-68de-470b-8754-34f62319b77e admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:46.672105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2136f33-68de-470b-8754-34f62319b77e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:46.674027 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2136f33-68de-470b-8754-34f62319b77e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:46.780375 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1405/2799] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:57:46 2022] POST /identity/v3/projects => generated 381 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:57:46.785585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5d8b3-30b2-4ec6-9178-65d1c481c8c6 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:46.799700 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5d8b3-30b2-4ec6-9178-65d1c481c8c6 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:46.864193 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e6c34-be04-468a-ad1b-2c80c58fdb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:46.864723 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e6c34-be04-468a-ad1b-2c80c58fdb61 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:46.865007 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e6c34-be04-468a-ad1b-2c80c58fdb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:46.865284 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e6c34-be04-468a-ad1b-2c80c58fdb61 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:46.865933 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e6c34-be04-468a-ad1b-2c80c58fdb61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:46.868061 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e6c34-be04-468a-ad1b-2c80c58fdb61 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:46.995740 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1395/2800] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:57:46 2022] POST /identity/v3/users => generated 297 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:57:47.000139 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2136f33-68de-470b-8754-34f62319b77e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:47.011489 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2136f33-68de-470b-8754-34f62319b77e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:47.016161 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0010ea3-0810-447b-85e3-854ab2dc11df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:47.016788 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0010ea3-0810-447b-85e3-854ab2dc11df admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:47.017066 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0010ea3-0810-447b-85e3-854ab2dc11df admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:47.017337 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0010ea3-0810-447b-85e3-854ab2dc11df admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:47.017971 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0010ea3-0810-447b-85e3-854ab2dc11df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:47.019665 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0010ea3-0810-447b-85e3-854ab2dc11df admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:47.030180 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1406/2801] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:57:47.035040 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e6c34-be04-468a-ad1b-2c80c58fdb61 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:47.045419 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e6c34-be04-468a-ad1b-2c80c58fdb61 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:47.050806 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a499973-eb2d-4ebd-bbbf-74743aa72394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:47.055464 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a499973-eb2d-4ebd-bbbf-74743aa72394 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:47.055464 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a499973-eb2d-4ebd-bbbf-74743aa72394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:47.055464 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a499973-eb2d-4ebd-bbbf-74743aa72394 admin admin] PATH_INFO: `/v3/projects/38e79be6593a42008efe3d5199ae0af9/users/369be94e02704efbb282c39337c1364d/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:47.055464 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:57:47.066815 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a499973-eb2d-4ebd-bbbf-74743aa72394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38e79be6593a42008efe3d5199ae0af9, user_id=369be94e02704efbb282c39337c1364d, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:47.069716 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a499973-eb2d-4ebd-bbbf-74743aa72394 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:47.138506 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1396/2802] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:57:47 2022] PUT /identity/v3/projects/38e79be6593a42008efe3d5199ae0af9/users/369be94e02704efbb282c39337c1364d/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:57:47.143520 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0010ea3-0810-447b-85e3-854ab2dc11df admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:47.153851 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0010ea3-0810-447b-85e3-854ab2dc11df admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:47.186464 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:57:47.211428 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782b40a-5266-474a-9b24-86d5c55d97c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:47.212047 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782b40a-5266-474a-9b24-86d5c55d97c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:47.212328 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782b40a-5266-474a-9b24-86d5c55d97c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:47.212598 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782b40a-5266-474a-9b24-86d5c55d97c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:47.213249 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782b40a-5266-474a-9b24-86d5c55d97c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:47.214850 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782b40a-5266-474a-9b24-86d5c55d97c4 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:47.226105 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1407/2803] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:57:47.230286 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a499973-eb2d-4ebd-bbbf-74743aa72394 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:47.240490 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a499973-eb2d-4ebd-bbbf-74743aa72394 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:47.245083 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da708eb3-837f-4507-8a43-d2dbb47bfdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:47.245751 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da708eb3-837f-4507-8a43-d2dbb47bfdeb admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:47.246048 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da708eb3-837f-4507-8a43-d2dbb47bfdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:47.246303 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da708eb3-837f-4507-8a43-d2dbb47bfdeb admin admin] PATH_INFO: `/v3/projects/38e79be6593a42008efe3d5199ae0af9/users/369be94e02704efbb282c39337c1364d/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:47.248524 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da708eb3-837f-4507-8a43-d2dbb47bfdeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=38e79be6593a42008efe3d5199ae0af9, user_id=369be94e02704efbb282c39337c1364d, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:47.250995 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da708eb3-837f-4507-8a43-d2dbb47bfdeb admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:47.261356 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1397/2804] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:57:47 2022] PUT /identity/v3/projects/38e79be6593a42008efe3d5199ae0af9/users/369be94e02704efbb282c39337c1364d/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:57:47.273449 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abda6a1-f3de-4652-8b35-89d91a3b198f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:47.273782 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abda6a1-f3de-4652-8b35-89d91a3b198f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:47.274075 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abda6a1-f3de-4652-8b35-89d91a3b198f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:47.302284 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-1abda6a1-f3de-4652-8b35-89d91a3b198f None None] MFA Rules not processed for user `369be94e02704efbb282c39337c1364d`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:57:47.303567 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1abda6a1-f3de-4652-8b35-89d91a3b198f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:57:47.373550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1408/2805] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:57:47 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:57:47.385028 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da708eb3-837f-4507-8a43-d2dbb47bfdeb admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:47.386895 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-da708eb3-837f-4507-8a43-d2dbb47bfdeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:57:47.445688 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da708eb3-837f-4507-8a43-d2dbb47bfdeb admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:47.449388 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ba129-a1c2-4280-9fbd-e354ceb60f25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:47.450156 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ba129-a1c2-4280-9fbd-e354ceb60f25 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:47.450434 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ba129-a1c2-4280-9fbd-e354ceb60f25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:47.450709 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ba129-a1c2-4280-9fbd-e354ceb60f25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:47.460402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ba129-a1c2-4280-9fbd-e354ceb60f25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:47.461880 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ba129-a1c2-4280-9fbd-e354ceb60f25 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:47.472947 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1398/2806] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:57:47 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:57:47.576783 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abda6a1-f3de-4652-8b35-89d91a3b198f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:47.587040 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abda6a1-f3de-4652-8b35-89d91a3b198f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:47.590648 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f9884-2591-477f-b284-5d8d73bd0a73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:47.591553 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f9884-2591-477f-b284-5d8d73bd0a73 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:47.591836 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f9884-2591-477f-b284-5d8d73bd0a73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:47.592112 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f9884-2591-477f-b284-5d8d73bd0a73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:47.652853 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f9884-2591-477f-b284-5d8d73bd0a73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:47.654237 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f9884-2591-477f-b284-5d8d73bd0a73 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:47.663118 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1409/2807] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:57:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:57:51.113828 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ba129-a1c2-4280-9fbd-e354ceb60f25 service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:51.173942 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ba129-a1c2-4280-9fbd-e354ceb60f25 service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:51.178442 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a2bc9-3d7a-42bd-a393-a69eb392c2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:51.179072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a2bc9-3d7a-42bd-a393-a69eb392c2e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:51.179383 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a2bc9-3d7a-42bd-a393-a69eb392c2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:51.179661 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a2bc9-3d7a-42bd-a393-a69eb392c2e7 admin admin] PATH_INFO: `/v3/users/972ab1b40b1f4cf788566b3066655686` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:51.180778 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a2bc9-3d7a-42bd-a393-a69eb392c2e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=972ab1b40b1f4cf788566b3066655686)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:51.182703 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a2bc9-3d7a-42bd-a393-a69eb392c2e7 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:51.340249 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-286a2bc9-3d7a-42bd-a393-a69eb392c2e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '972ab1b40b1f4cf788566b3066655686'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:51.340912 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-286a2bc9-3d7a-42bd-a393-a69eb392c2e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '972ab1b40b1f4cf788566b3066655686'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:51.348701 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-286a2bc9-3d7a-42bd-a393-a69eb392c2e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '972ab1b40b1f4cf788566b3066655686'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:51.349266 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-286a2bc9-3d7a-42bd-a393-a69eb392c2e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '972ab1b40b1f4cf788566b3066655686'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:51.418211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-286a2bc9-3d7a-42bd-a393-a69eb392c2e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '972ab1b40b1f4cf788566b3066655686'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:51.429481 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:57:51.437136 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1399/2808] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:57:51 2022] DELETE /identity/v3/users/972ab1b40b1f4cf788566b3066655686 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:57:51.441957 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbd8ae-3599-4bd0-946e-695e3dc2ce8f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:51.442464 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbd8ae-3599-4bd0-946e-695e3dc2ce8f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:51.442574 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbd8ae-3599-4bd0-946e-695e3dc2ce8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:51.462691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-88dbd8ae-3599-4bd0-946e-695e3dc2ce8f None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:57:51.463927 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-88dbd8ae-3599-4bd0-946e-695e3dc2ce8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:57:51.514540 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:57:51.526513 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1410/2809] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:57:51.537030 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a2bc9-3d7a-42bd-a393-a69eb392c2e7 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:51.538486 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-286a2bc9-3d7a-42bd-a393-a69eb392c2e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:57:51.596093 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a2bc9-3d7a-42bd-a393-a69eb392c2e7 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:51.599815 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7fbc3-e890-4e25-bfdf-a8a2c4f08332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:51.600364 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7fbc3-e890-4e25-bfdf-a8a2c4f08332 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:51.600646 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7fbc3-e890-4e25-bfdf-a8a2c4f08332 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:51.600983 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7fbc3-e890-4e25-bfdf-a8a2c4f08332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:51.610273 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7fbc3-e890-4e25-bfdf-a8a2c4f08332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:51.611805 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7fbc3-e890-4e25-bfdf-a8a2c4f08332 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:51.621712 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1400/2810] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:57:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:57:52.082949 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dbd8ae-3599-4bd0-946e-695e3dc2ce8f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:52.084476 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-88dbd8ae-3599-4bd0-946e-695e3dc2ce8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:57:52.097754 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dbd8ae-3599-4bd0-946e-695e3dc2ce8f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:52.102706 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45700bee-352c-420a-8a89-cb5fc07f1460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:52.103379 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45700bee-352c-420a-8a89-cb5fc07f1460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:52.103663 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45700bee-352c-420a-8a89-cb5fc07f1460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:52.103940 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45700bee-352c-420a-8a89-cb5fc07f1460 admin admin] PATH_INFO: `/v3/projects/28470bd2eaf14c5c9454723f5d7ba903` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:52.105084 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45700bee-352c-420a-8a89-cb5fc07f1460 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28470bd2eaf14c5c9454723f5d7ba903)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:52.107030 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45700bee-352c-420a-8a89-cb5fc07f1460 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:52.196110 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-45700bee-352c-420a-8a89-cb5fc07f1460 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28470bd2eaf14c5c9454723f5d7ba903', 'request_id': 'req-45700bee-352c-420a-8a89-cb5fc07f1460'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:52.201689 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-45700bee-352c-420a-8a89-cb5fc07f1460 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28470bd2eaf14c5c9454723f5d7ba903', 'request_id': 'req-45700bee-352c-420a-8a89-cb5fc07f1460'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:52.270047 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-45700bee-352c-420a-8a89-cb5fc07f1460 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28470bd2eaf14c5c9454723f5d7ba903', 'request_id': 'req-45700bee-352c-420a-8a89-cb5fc07f1460'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:52.281661 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-45700bee-352c-420a-8a89-cb5fc07f1460 admin admin] The token cache is being invalidate because project 28470bd2eaf14c5c9454723f5d7ba903 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:57:52.281956 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-45700bee-352c-420a-8a89-cb5fc07f1460 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:52.282632 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-45700bee-352c-420a-8a89-cb5fc07f1460 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:52.284158 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1411/2811] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:57:52 2022] DELETE /identity/v3/projects/28470bd2eaf14c5c9454723f5d7ba903 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:57:52.288271 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7fbc3-e890-4e25-bfdf-a8a2c4f08332 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:52.298566 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7fbc3-e890-4e25-bfdf-a8a2c4f08332 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:52.354041 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b726eb-7f8c-4a9f-ac31-a23b4813bdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:52.354666 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b726eb-7f8c-4a9f-ac31-a23b4813bdeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:52.354945 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b726eb-7f8c-4a9f-ac31-a23b4813bdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:52.355218 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b726eb-7f8c-4a9f-ac31-a23b4813bdeb admin admin] PATH_INFO: `/v3/users/369be94e02704efbb282c39337c1364d` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:52.356380 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b726eb-7f8c-4a9f-ac31-a23b4813bdeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=369be94e02704efbb282c39337c1364d)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:52.358295 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b726eb-7f8c-4a9f-ac31-a23b4813bdeb admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:52.536651 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-67b726eb-7f8c-4a9f-ac31-a23b4813bdeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '369be94e02704efbb282c39337c1364d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:52.537320 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-67b726eb-7f8c-4a9f-ac31-a23b4813bdeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '369be94e02704efbb282c39337c1364d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:52.544817 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-67b726eb-7f8c-4a9f-ac31-a23b4813bdeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '369be94e02704efbb282c39337c1364d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:52.545468 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-67b726eb-7f8c-4a9f-ac31-a23b4813bdeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '369be94e02704efbb282c39337c1364d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:52.618328 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-67b726eb-7f8c-4a9f-ac31-a23b4813bdeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '369be94e02704efbb282c39337c1364d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:52.637822 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1401/2812] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:57:52 2022] DELETE /identity/v3/users/369be94e02704efbb282c39337c1364d => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:57:53.059671 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45700bee-352c-420a-8a89-cb5fc07f1460 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:53.061159 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-45700bee-352c-420a-8a89-cb5fc07f1460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:57:53.074472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45700bee-352c-420a-8a89-cb5fc07f1460 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:53.131136 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e521a-e345-49c2-9fdd-412251d6f94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:53.131863 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e521a-e345-49c2-9fdd-412251d6f94a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:53.132142 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e521a-e345-49c2-9fdd-412251d6f94a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:53.132415 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e521a-e345-49c2-9fdd-412251d6f94a admin admin] PATH_INFO: `/v3/projects/38e79be6593a42008efe3d5199ae0af9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:53.133547 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e521a-e345-49c2-9fdd-412251d6f94a admin admin] RBAC: Authorizing `identity:delete_project(project_id=38e79be6593a42008efe3d5199ae0af9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:53.135484 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e521a-e345-49c2-9fdd-412251d6f94a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:53.248591 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0c3e521a-e345-49c2-9fdd-412251d6f94a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38e79be6593a42008efe3d5199ae0af9', 'request_id': 'req-0c3e521a-e345-49c2-9fdd-412251d6f94a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:53.254343 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0c3e521a-e345-49c2-9fdd-412251d6f94a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38e79be6593a42008efe3d5199ae0af9', 'request_id': 'req-0c3e521a-e345-49c2-9fdd-412251d6f94a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:53.326663 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0c3e521a-e345-49c2-9fdd-412251d6f94a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38e79be6593a42008efe3d5199ae0af9', 'request_id': 'req-0c3e521a-e345-49c2-9fdd-412251d6f94a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:53.338864 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0c3e521a-e345-49c2-9fdd-412251d6f94a admin admin] The token cache is being invalidate because project 38e79be6593a42008efe3d5199ae0af9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:57:53.339185 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0c3e521a-e345-49c2-9fdd-412251d6f94a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:53.339866 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0c3e521a-e345-49c2-9fdd-412251d6f94a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:57:53.341720 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1412/2813] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:57:53 2022] DELETE /identity/v3/projects/38e79be6593a42008efe3d5199ae0af9 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:57:53.347327 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9ee6f-8d47-4763-bd46-c7b5438fffac None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:53.347805 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9ee6f-8d47-4763-bd46-c7b5438fffac None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:53.347917 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9ee6f-8d47-4763-bd46-c7b5438fffac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:53.367647 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-fda9ee6f-8d47-4763-bd46-c7b5438fffac None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:57:53.368878 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-fda9ee6f-8d47-4763-bd46-c7b5438fffac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:57:53.378296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:57:53.427749 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1402/2814] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:57:53.442110 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8cf34-6d4b-4350-aa1f-1a7e9d513cd1 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:53.442399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8cf34-6d4b-4350-aa1f-1a7e9d513cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:53.442682 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8cf34-6d4b-4350-aa1f-1a7e9d513cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:53.462551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-91a8cf34-6d4b-4350-aa1f-1a7e9d513cd1 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:57:53.463811 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-91a8cf34-6d4b-4350-aa1f-1a7e9d513cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:57:53.471975 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1413/2815] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:57:53.476184 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9ee6f-8d47-4763-bd46-c7b5438fffac None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:53.486415 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9ee6f-8d47-4763-bd46-c7b5438fffac None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:53.491182 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddf771-0618-451d-ae58-3288f95896bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:53.492555 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddf771-0618-451d-ae58-3288f95896bd admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:53.492878 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddf771-0618-451d-ae58-3288f95896bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:53.493234 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddf771-0618-451d-ae58-3288f95896bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:53.493937 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ddf771-0618-451d-ae58-3288f95896bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:57:53.494279 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ddf771-0618-451d-ae58-3288f95896bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:53.496003 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ddf771-0618-451d-ae58-3288f95896bd admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:53.508101 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1403/2816] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:57:53.512552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8cf34-6d4b-4350-aa1f-1a7e9d513cd1 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:53.517741 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:57:53.523006 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8cf34-6d4b-4350-aa1f-1a7e9d513cd1 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:53.527733 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8090641-52a8-4aa4-9076-6fda9ee6bab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:53.528568 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8090641-52a8-4aa4-9076-6fda9ee6bab5 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:53.528850 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8090641-52a8-4aa4-9076-6fda9ee6bab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:53.538934 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8090641-52a8-4aa4-9076-6fda9ee6bab5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:53.538934 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8090641-52a8-4aa4-9076-6fda9ee6bab5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:53.538934 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8090641-52a8-4aa4-9076-6fda9ee6bab5 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:53.596655 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1414/2817] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:57:53 2022] POST /identity/v3/projects => generated 375 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:57:53.600764 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddf771-0618-451d-ae58-3288f95896bd admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:53.611088 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddf771-0618-451d-ae58-3288f95896bd admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:53.670252 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab4899-d62e-4415-9df0-c8a950a929ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:53.670876 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab4899-d62e-4415-9df0-c8a950a929ed admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:53.671231 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab4899-d62e-4415-9df0-c8a950a929ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:53.671542 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab4899-d62e-4415-9df0-c8a950a929ed admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:53.672197 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab4899-d62e-4415-9df0-c8a950a929ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:53.674323 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab4899-d62e-4415-9df0-c8a950a929ed admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:53.830113 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1404/2818] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:57:53 2022] POST /identity/v3/users => generated 288 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:57:53.834256 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8090641-52a8-4aa4-9076-6fda9ee6bab5 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:53.844835 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8090641-52a8-4aa4-9076-6fda9ee6bab5 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:53.849460 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bd749-489f-4726-b8a1-67e34b10be5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:53.850060 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bd749-489f-4726-b8a1-67e34b10be5a admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:53.850332 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bd749-489f-4726-b8a1-67e34b10be5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:53.850601 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bd749-489f-4726-b8a1-67e34b10be5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:53.851292 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5bd749-489f-4726-b8a1-67e34b10be5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:53.852893 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5bd749-489f-4726-b8a1-67e34b10be5a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:53.863822 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1415/2819] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:57:53.868182 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab4899-d62e-4415-9df0-c8a950a929ed admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:53.879216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab4899-d62e-4415-9df0-c8a950a929ed admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:53.884029 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d239f-3734-4c1d-994d-96a3ef61d861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:53.884656 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d239f-3734-4c1d-994d-96a3ef61d861 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:53.884941 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d239f-3734-4c1d-994d-96a3ef61d861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:53.885284 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d239f-3734-4c1d-994d-96a3ef61d861 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:53.885914 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d239f-3734-4c1d-994d-96a3ef61d861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:53.887537 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d239f-3734-4c1d-994d-96a3ef61d861 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:53.899997 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1405/2820] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:57:53.904295 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bd749-489f-4726-b8a1-67e34b10be5a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:53.914422 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bd749-489f-4726-b8a1-67e34b10be5a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:53.919847 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4bfff-70c0-48ab-a131-6dfdecf1216b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:53.920506 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4bfff-70c0-48ab-a131-6dfdecf1216b admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:53.920784 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4bfff-70c0-48ab-a131-6dfdecf1216b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:53.921056 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4bfff-70c0-48ab-a131-6dfdecf1216b admin admin] PATH_INFO: `/v3/projects/ebc82a142f994b19a26c8910fd371512/users/05532eb5279943e8b50f83c52b1b7cfd/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:53.936553 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4bfff-70c0-48ab-a131-6dfdecf1216b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebc82a142f994b19a26c8910fd371512, user_id=05532eb5279943e8b50f83c52b1b7cfd, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:53.940073 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4bfff-70c0-48ab-a131-6dfdecf1216b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:53.999711 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1416/2821] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:57:53 2022] PUT /identity/v3/projects/ebc82a142f994b19a26c8910fd371512/users/05532eb5279943e8b50f83c52b1b7cfd/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:57:54.011922 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225b441-e801-4bb5-98b2-211ba841c23d None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:54.012213 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225b441-e801-4bb5-98b2-211ba841c23d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:54.012492 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225b441-e801-4bb5-98b2-211ba841c23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:54.040219 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-e225b441-e801-4bb5-98b2-211ba841c23d None None] MFA Rules not processed for user `05532eb5279943e8b50f83c52b1b7cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:57:54.043178 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e225b441-e801-4bb5-98b2-211ba841c23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:57:54.105216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1406/2822] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:57:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:57:54.117035 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4bfff-70c0-48ab-a131-6dfdecf1216b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:54.118770 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e7c4bfff-70c0-48ab-a131-6dfdecf1216b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:57:54.174867 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4bfff-70c0-48ab-a131-6dfdecf1216b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:54.178693 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39ceab-c8db-4053-a9a9-f6c4b845f605 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7690af0cd266458f9cdd799c98ff5bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:54.179476 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39ceab-c8db-4053-a9a9-f6c4b845f605 service glance] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:54.179980 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39ceab-c8db-4053-a9a9-f6c4b845f605 service glance] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:54.180321 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39ceab-c8db-4053-a9a9-f6c4b845f605 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:54.190136 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f39ceab-c8db-4053-a9a9-f6c4b845f605 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:54.191711 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f39ceab-c8db-4053-a9a9-f6c4b845f605 service glance] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:54.200775 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1417/2823] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:57:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:57:59.546630 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225b441-e801-4bb5-98b2-211ba841c23d None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:57:59.546630 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e225b441-e801-4bb5-98b2-211ba841c23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:57:59.557385 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:57:59.617824 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225b441-e801-4bb5-98b2-211ba841c23d None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:57:59.623085 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca2331-ac2b-4a39-a51a-8a856b885118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:57:59.623987 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca2331-ac2b-4a39-a51a-8a856b885118 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:57:59.624335 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca2331-ac2b-4a39-a51a-8a856b885118 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:57:59.626745 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca2331-ac2b-4a39-a51a-8a856b885118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:57:59.628968 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-88ca2331-ac2b-4a39-a51a-8a856b885118 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:57:59.647402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca2331-ac2b-4a39-a51a-8a856b885118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:57:59.648859 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca2331-ac2b-4a39-a51a-8a856b885118 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:57:59.658585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1407/2824] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:57:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:58:00.700796 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39ceab-c8db-4053-a9a9-f6c4b845f605 service glance] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:00.702856 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5f39ceab-c8db-4053-a9a9-f6c4b845f605 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:00.808081 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39ceab-c8db-4053-a9a9-f6c4b845f605 service glance] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:00.819413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711a8c3-01d6-4025-bcdd-e7e5bfeefa71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:00.819413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711a8c3-01d6-4025-bcdd-e7e5bfeefa71 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:00.819413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711a8c3-01d6-4025-bcdd-e7e5bfeefa71 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:00.819413 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711a8c3-01d6-4025-bcdd-e7e5bfeefa71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:00.819914 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d711a8c3-01d6-4025-bcdd-e7e5bfeefa71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:00.844076 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d711a8c3-01d6-4025-bcdd-e7e5bfeefa71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:00.846192 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d711a8c3-01d6-4025-bcdd-e7e5bfeefa71 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:00.859868 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1418/2825] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:58:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:58:08.778246 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0555bbd-31cb-46c7-b320-4e8da3277c76 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:08.778771 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0555bbd-31cb-46c7-b320-4e8da3277c76 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:08.778771 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0555bbd-31cb-46c7-b320-4e8da3277c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:08.829617 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-b0555bbd-31cb-46c7-b320-4e8da3277c76 None None] MFA Rules not processed for user `84fcccb19a5e43ac9da5d7ca501563e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:58:08.830772 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b0555bbd-31cb-46c7-b320-4e8da3277c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:08.898382 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1408/2826] 10.222.0.26 () {58 vars in 967 bytes} [Sun Sep 11 08:58:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:58:08.941326 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711a8c3-01d6-4025-bcdd-e7e5bfeefa71 service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:08.942755 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d711a8c3-01d6-4025-bcdd-e7e5bfeefa71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:08.979793 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:58:09.032953 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711a8c3-01d6-4025-bcdd-e7e5bfeefa71 service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:09.038109 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e846b5-8d40-4932-ab1b-6a6f201a67bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a4f25df9724d34afdd6a41e719546a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:09.038710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e846b5-8d40-4932-ab1b-6a6f201a67bf service swift] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:09.038992 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e846b5-8d40-4932-ab1b-6a6f201a67bf service swift] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:09.039284 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e846b5-8d40-4932-ab1b-6a6f201a67bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:09.053789 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e846b5-8d40-4932-ab1b-6a6f201a67bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:09.055435 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e846b5-8d40-4932-ab1b-6a6f201a67bf service swift] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:09.065114 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1419/2827] 10.222.0.26 () {60 vars in 1384 bytes} [Sun Sep 11 08:58:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 08:58:10.504644 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0555bbd-31cb-46c7-b320-4e8da3277c76 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:10.570010 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0555bbd-31cb-46c7-b320-4e8da3277c76 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:10.575220 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158f94c-6617-4d21-a194-c6b56d1d0b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:10.576067 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158f94c-6617-4d21-a194-c6b56d1d0b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:10.576452 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158f94c-6617-4d21-a194-c6b56d1d0b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:10.576629 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158f94c-6617-4d21-a194-c6b56d1d0b61 admin admin] PATH_INFO: `/v3/users/05532eb5279943e8b50f83c52b1b7cfd` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:10.577793 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7158f94c-6617-4d21-a194-c6b56d1d0b61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05532eb5279943e8b50f83c52b1b7cfd)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:10.580296 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7158f94c-6617-4d21-a194-c6b56d1d0b61 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:10.678297 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:58:10.758605 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7158f94c-6617-4d21-a194-c6b56d1d0b61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05532eb5279943e8b50f83c52b1b7cfd'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:10.759238 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7158f94c-6617-4d21-a194-c6b56d1d0b61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05532eb5279943e8b50f83c52b1b7cfd'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:10.766614 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7158f94c-6617-4d21-a194-c6b56d1d0b61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05532eb5279943e8b50f83c52b1b7cfd'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:10.767355 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7158f94c-6617-4d21-a194-c6b56d1d0b61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05532eb5279943e8b50f83c52b1b7cfd'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:10.811925 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7158f94c-6617-4d21-a194-c6b56d1d0b61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05532eb5279943e8b50f83c52b1b7cfd'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:10.830385 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1409/2828] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:58:10 2022] DELETE /identity/v3/users/05532eb5279943e8b50f83c52b1b7cfd => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:58:10.835141 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b41897-fbaf-42b2-b2da-b4c59d019ff4 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:10.836138 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b41897-fbaf-42b2-b2da-b4c59d019ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:10.836594 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b41897-fbaf-42b2-b2da-b4c59d019ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:10.858466 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-52b41897-fbaf-42b2-b2da-b4c59d019ff4 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:58:10.860290 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-52b41897-fbaf-42b2-b2da-b4c59d019ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:10.930630 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1420/2829] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:58:10.941652 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158f94c-6617-4d21-a194-c6b56d1d0b61 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:10.943163 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7158f94c-6617-4d21-a194-c6b56d1d0b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:11.003443 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158f94c-6617-4d21-a194-c6b56d1d0b61 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:11.007200 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3523207-13e0-496b-9485-9a152e99723e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:11.007842 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3523207-13e0-496b-9485-9a152e99723e service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:11.008119 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3523207-13e0-496b-9485-9a152e99723e service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:11.008389 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3523207-13e0-496b-9485-9a152e99723e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:11.018393 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3523207-13e0-496b-9485-9a152e99723e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:11.019789 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3523207-13e0-496b-9485-9a152e99723e service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:11.029867 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1410/2830] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:58:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:58:11.621728 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b41897-fbaf-42b2-b2da-b4c59d019ff4 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:11.625554 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-52b41897-fbaf-42b2-b2da-b4c59d019ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:11.635879 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b41897-fbaf-42b2-b2da-b4c59d019ff4 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:11.641230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b56ed-94ff-4d36-9c50-9f28e1945db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:11.641873 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b56ed-94ff-4d36-9c50-9f28e1945db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:11.643041 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b56ed-94ff-4d36-9c50-9f28e1945db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:11.643132 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b56ed-94ff-4d36-9c50-9f28e1945db0 admin admin] PATH_INFO: `/v3/projects/ebc82a142f994b19a26c8910fd371512` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:11.644325 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b56ed-94ff-4d36-9c50-9f28e1945db0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebc82a142f994b19a26c8910fd371512)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:11.647564 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b56ed-94ff-4d36-9c50-9f28e1945db0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:11.773674 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-714b56ed-94ff-4d36-9c50-9f28e1945db0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebc82a142f994b19a26c8910fd371512', 'request_id': 'req-714b56ed-94ff-4d36-9c50-9f28e1945db0'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:11.780241 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-714b56ed-94ff-4d36-9c50-9f28e1945db0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebc82a142f994b19a26c8910fd371512', 'request_id': 'req-714b56ed-94ff-4d36-9c50-9f28e1945db0'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:11.880868 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-714b56ed-94ff-4d36-9c50-9f28e1945db0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebc82a142f994b19a26c8910fd371512', 'request_id': 'req-714b56ed-94ff-4d36-9c50-9f28e1945db0'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:11.895511 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-714b56ed-94ff-4d36-9c50-9f28e1945db0 admin admin] The token cache is being invalidate because project ebc82a142f994b19a26c8910fd371512 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:58:11.895831 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-714b56ed-94ff-4d36-9c50-9f28e1945db0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:11.896530 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-714b56ed-94ff-4d36-9c50-9f28e1945db0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:11.898855 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1421/2831] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:58:11 2022] DELETE /identity/v3/projects/ebc82a142f994b19a26c8910fd371512 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:58:11.903611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea99819-388b-4ba6-a1b5-47617824ef41 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:11.904099 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea99819-388b-4ba6-a1b5-47617824ef41 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:11.904205 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea99819-388b-4ba6-a1b5-47617824ef41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:11.926508 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-7ea99819-388b-4ba6-a1b5-47617824ef41 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:58:11.927958 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7ea99819-388b-4ba6-a1b5-47617824ef41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:11.998368 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1411/2832] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:58:12.006581 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b395fc1-f62c-4443-a4ec-c1e3725d438b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:12.006972 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b395fc1-f62c-4443-a4ec-c1e3725d438b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:12.007273 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b395fc1-f62c-4443-a4ec-c1e3725d438b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:12.028225 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-9b395fc1-f62c-4443-a4ec-c1e3725d438b None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:58:12.029445 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9b395fc1-f62c-4443-a4ec-c1e3725d438b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:12.038283 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1422/2833] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:58:12.042703 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea99819-388b-4ba6-a1b5-47617824ef41 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:12.053842 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea99819-388b-4ba6-a1b5-47617824ef41 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:12.059045 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9950f7-c2f1-4ed9-8905-b106be195fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:12.059836 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9950f7-c2f1-4ed9-8905-b106be195fbe admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:12.060174 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9950f7-c2f1-4ed9-8905-b106be195fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:12.060699 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9950f7-c2f1-4ed9-8905-b106be195fbe admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:12.061423 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9950f7-c2f1-4ed9-8905-b106be195fbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:58:12.062022 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9950f7-c2f1-4ed9-8905-b106be195fbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:12.063724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9950f7-c2f1-4ed9-8905-b106be195fbe admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:12.076510 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1412/2834] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:58:12.080873 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b395fc1-f62c-4443-a4ec-c1e3725d438b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:12.092383 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b395fc1-f62c-4443-a4ec-c1e3725d438b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:12.099063 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abecff-0857-4d91-855b-152a23b4e3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:12.099631 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abecff-0857-4d91-855b-152a23b4e3e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:12.100355 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abecff-0857-4d91-855b-152a23b4e3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:12.100355 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abecff-0857-4d91-855b-152a23b4e3e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:12.100828 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abecff-0857-4d91-855b-152a23b4e3e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:12.102835 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abecff-0857-4d91-855b-152a23b4e3e0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:12.173059 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:58:12.185132 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1423/2835] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:58:12 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:58:12.185536 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9950f7-c2f1-4ed9-8905-b106be195fbe admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:12.197580 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9950f7-c2f1-4ed9-8905-b106be195fbe admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:12.238326 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:58:12.266055 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8affa0-c38f-48a2-81ea-b66bcf9fa2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:12.267609 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8affa0-c38f-48a2-81ea-b66bcf9fa2dc admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:12.267765 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8affa0-c38f-48a2-81ea-b66bcf9fa2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:12.268100 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8affa0-c38f-48a2-81ea-b66bcf9fa2dc admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:12.268945 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8affa0-c38f-48a2-81ea-b66bcf9fa2dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:12.271061 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8affa0-c38f-48a2-81ea-b66bcf9fa2dc admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:12.350809 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1413/2836] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:58:12 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:58:12.354924 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abecff-0857-4d91-855b-152a23b4e3e0 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:12.365641 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abecff-0857-4d91-855b-152a23b4e3e0 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:12.371002 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c98e6-0e6c-475b-a002-06159cd3bef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:12.371670 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c98e6-0e6c-475b-a002-06159cd3bef1 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:12.371951 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c98e6-0e6c-475b-a002-06159cd3bef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:12.372223 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c98e6-0e6c-475b-a002-06159cd3bef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:12.372912 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c98e6-0e6c-475b-a002-06159cd3bef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:12.374551 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c98e6-0e6c-475b-a002-06159cd3bef1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:12.384962 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1424/2837] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:58:12.389268 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8affa0-c38f-48a2-81ea-b66bcf9fa2dc admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:12.399903 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8affa0-c38f-48a2-81ea-b66bcf9fa2dc admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:12.404452 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197f484-b32a-4a58-bd2b-3fafad225c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:12.406332 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197f484-b32a-4a58-bd2b-3fafad225c40 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:12.406332 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197f484-b32a-4a58-bd2b-3fafad225c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:12.406332 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197f484-b32a-4a58-bd2b-3fafad225c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:12.406332 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197f484-b32a-4a58-bd2b-3fafad225c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:12.408405 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197f484-b32a-4a58-bd2b-3fafad225c40 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:12.418884 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1414/2838] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:58:12.423738 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c98e6-0e6c-475b-a002-06159cd3bef1 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:12.434004 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c98e6-0e6c-475b-a002-06159cd3bef1 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:12.439416 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b0c9a-ba68-4e81-a5ad-e453e40ace65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:12.440094 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b0c9a-ba68-4e81-a5ad-e453e40ace65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:12.440377 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b0c9a-ba68-4e81-a5ad-e453e40ace65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:12.440656 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b0c9a-ba68-4e81-a5ad-e453e40ace65 admin admin] PATH_INFO: `/v3/projects/6ab4712973be4b0aa7da5bef0a494017/users/5c878c6cc9f745fa8aa49d99c2b68ff8/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:12.457114 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b0c9a-ba68-4e81-a5ad-e453e40ace65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ab4712973be4b0aa7da5bef0a494017, user_id=5c878c6cc9f745fa8aa49d99c2b68ff8, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:12.459912 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b0c9a-ba68-4e81-a5ad-e453e40ace65 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:12.579120 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1425/2839] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:58:12 2022] PUT /identity/v3/projects/6ab4712973be4b0aa7da5bef0a494017/users/5c878c6cc9f745fa8aa49d99c2b68ff8/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:58:12.592076 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc176b47-b38e-4997-80b9-56019576e979 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:12.592562 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc176b47-b38e-4997-80b9-56019576e979 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:12.593499 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc176b47-b38e-4997-80b9-56019576e979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:12.640016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-fc176b47-b38e-4997-80b9-56019576e979 None None] MFA Rules not processed for user `5c878c6cc9f745fa8aa49d99c2b68ff8`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:58:12.641399 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-fc176b47-b38e-4997-80b9-56019576e979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:12.728995 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1415/2840] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:58:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:58:12.733646 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b0c9a-ba68-4e81-a5ad-e453e40ace65 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:12.803552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b0c9a-ba68-4e81-a5ad-e453e40ace65 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:12.808426 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3d453-65ec-474d-81a7-561422e46385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:12.809079 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3d453-65ec-474d-81a7-561422e46385 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:12.809362 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3d453-65ec-474d-81a7-561422e46385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:12.809638 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3d453-65ec-474d-81a7-561422e46385 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:12.810287 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3d453-65ec-474d-81a7-561422e46385 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:12.812391 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3d453-65ec-474d-81a7-561422e46385 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:12.899992 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1426/2841] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:58:12 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:58:12.903989 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc176b47-b38e-4997-80b9-56019576e979 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:12.916093 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc176b47-b38e-4997-80b9-56019576e979 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:12.980335 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e79ac-9955-45a2-9b58-ebc2227a38bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:12.980963 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e79ac-9955-45a2-9b58-ebc2227a38bd admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:12.981245 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e79ac-9955-45a2-9b58-ebc2227a38bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:12.981518 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e79ac-9955-45a2-9b58-ebc2227a38bd admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:12.982219 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e79ac-9955-45a2-9b58-ebc2227a38bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:12.984164 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e79ac-9955-45a2-9b58-ebc2227a38bd admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:13.121600 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1416/2842] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:58:12 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:58:13.125816 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3d453-65ec-474d-81a7-561422e46385 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:13.136431 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3d453-65ec-474d-81a7-561422e46385 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:13.141517 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b380252-e318-4789-9af9-b1106c1e7e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:13.142775 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b380252-e318-4789-9af9-b1106c1e7e8b admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:13.143058 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b380252-e318-4789-9af9-b1106c1e7e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:13.143368 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b380252-e318-4789-9af9-b1106c1e7e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:13.144779 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b380252-e318-4789-9af9-b1106c1e7e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:13.145726 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b380252-e318-4789-9af9-b1106c1e7e8b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:13.157382 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1427/2843] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:58:13.162539 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e79ac-9955-45a2-9b58-ebc2227a38bd admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:13.174004 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e79ac-9955-45a2-9b58-ebc2227a38bd admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:13.180300 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aca38d-eb03-4bf8-812d-87e5481fdbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:13.181487 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aca38d-eb03-4bf8-812d-87e5481fdbec admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:13.182068 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aca38d-eb03-4bf8-812d-87e5481fdbec admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:13.182547 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aca38d-eb03-4bf8-812d-87e5481fdbec admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:13.183577 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aca38d-eb03-4bf8-812d-87e5481fdbec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:13.185724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aca38d-eb03-4bf8-812d-87e5481fdbec admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:13.211533 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1417/2844] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:58:13.213765 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b380252-e318-4789-9af9-b1106c1e7e8b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:13.249325 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b380252-e318-4789-9af9-b1106c1e7e8b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:13.254640 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640eaf90-c0af-45d1-a68a-bac4abd7984a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:13.256121 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640eaf90-c0af-45d1-a68a-bac4abd7984a admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:13.256533 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640eaf90-c0af-45d1-a68a-bac4abd7984a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:13.256885 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640eaf90-c0af-45d1-a68a-bac4abd7984a admin admin] PATH_INFO: `/v3/projects/c460e14af3394f60b5fb3148ade0d9b4/users/2cd3d2d74b384c05a03a86f5a1a0c1cc/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:13.281160 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640eaf90-c0af-45d1-a68a-bac4abd7984a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c460e14af3394f60b5fb3148ade0d9b4, user_id=2cd3d2d74b384c05a03a86f5a1a0c1cc, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:13.284530 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640eaf90-c0af-45d1-a68a-bac4abd7984a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:13.362411 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1428/2845] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:58:13 2022] PUT /identity/v3/projects/c460e14af3394f60b5fb3148ade0d9b4/users/2cd3d2d74b384c05a03a86f5a1a0c1cc/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:58:13.374393 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0c411-348f-4995-87fa-598dc5eb109f None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:13.374603 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0c411-348f-4995-87fa-598dc5eb109f None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:13.375556 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0c411-348f-4995-87fa-598dc5eb109f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:13.405648 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-ace0c411-348f-4995-87fa-598dc5eb109f None None] MFA Rules not processed for user `2cd3d2d74b384c05a03a86f5a1a0c1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:58:13.406863 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ace0c411-348f-4995-87fa-598dc5eb109f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:13.417120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:58:13.495877 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1418/2846] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:58:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:58:13.500432 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640eaf90-c0af-45d1-a68a-bac4abd7984a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:13.576249 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640eaf90-c0af-45d1-a68a-bac4abd7984a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:13.584408 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d8d73-bd72-42ee-94f2-dada1094be4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:13.585526 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d8d73-bd72-42ee-94f2-dada1094be4c admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:13.585941 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d8d73-bd72-42ee-94f2-dada1094be4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:13.586472 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d8d73-bd72-42ee-94f2-dada1094be4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:13.587624 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d8d73-bd72-42ee-94f2-dada1094be4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:13.590529 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d8d73-bd72-42ee-94f2-dada1094be4c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:13.709499 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:58:13.718811 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1429/2847] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:58:13 2022] POST /identity/v3/projects => generated 385 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:58:13.722689 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0c411-348f-4995-87fa-598dc5eb109f None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:13.734570 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0c411-348f-4995-87fa-598dc5eb109f None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:13.805738 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc389c0-b9fa-4d81-8418-342ca9425928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:13.806371 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc389c0-b9fa-4d81-8418-342ca9425928 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:13.806647 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc389c0-b9fa-4d81-8418-342ca9425928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:13.807165 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc389c0-b9fa-4d81-8418-342ca9425928 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:13.807606 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc389c0-b9fa-4d81-8418-342ca9425928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:13.809580 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc389c0-b9fa-4d81-8418-342ca9425928 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:13.853431 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d8d73-bd72-42ee-94f2-dada1094be4c admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:13.855589 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f15d8d73-bd72-42ee-94f2-dada1094be4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:13.923284 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1419/2848] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:58:13 2022] POST /identity/v3/users => generated 299 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:58:13.926194 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc389c0-b9fa-4d81-8418-342ca9425928 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:13.936190 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc389c0-b9fa-4d81-8418-342ca9425928 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:13.940892 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fafdf-8b8d-44c4-8959-ff26b0a34c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:13.941503 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fafdf-8b8d-44c4-8959-ff26b0a34c2b admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:13.941777 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fafdf-8b8d-44c4-8959-ff26b0a34c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:13.942053 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fafdf-8b8d-44c4-8959-ff26b0a34c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:13.942692 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860fafdf-8b8d-44c4-8959-ff26b0a34c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:13.945242 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860fafdf-8b8d-44c4-8959-ff26b0a34c2b admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:13.945954 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d8d73-bd72-42ee-94f2-dada1094be4c admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:13.953956 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16814aca-66d6-4458-b932-2f4bb3db9804 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a48c49f7a9f44cef89dd024fecea422f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:13.955146 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16814aca-66d6-4458-b932-2f4bb3db9804 service placement] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:13.955461 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16814aca-66d6-4458-b932-2f4bb3db9804 service placement] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:13.955739 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16814aca-66d6-4458-b932-2f4bb3db9804 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:13.957554 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-16814aca-66d6-4458-b932-2f4bb3db9804 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:13.963109 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1420/2849] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 08:58:13.970898 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fafdf-8b8d-44c4-8959-ff26b0a34c2b admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:13.972110 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16814aca-66d6-4458-b932-2f4bb3db9804 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:13.973923 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16814aca-66d6-4458-b932-2f4bb3db9804 service placement] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:13.981265 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fafdf-8b8d-44c4-8959-ff26b0a34c2b admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:13.985111 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1430/2850] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:58:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:58:13.988463 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc7b06-9cb1-4149-8e4c-633e03276fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:13.991206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc7b06-9cb1-4149-8e4c-633e03276fd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:13.991206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc7b06-9cb1-4149-8e4c-633e03276fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:13.991206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc7b06-9cb1-4149-8e4c-633e03276fd4 admin admin] PATH_INFO: `/v3/projects/681a9d9418ab421696621f8349ecea45/users/f6463370f6764b46bfe4befd9a8be2eb/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:14.016443 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc7b06-9cb1-4149-8e4c-633e03276fd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=681a9d9418ab421696621f8349ecea45, user_id=f6463370f6764b46bfe4befd9a8be2eb, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:14.019842 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc7b06-9cb1-4149-8e4c-633e03276fd4 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:14.126584 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1421/2851] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:58:13 2022] PUT /identity/v3/projects/681a9d9418ab421696621f8349ecea45/users/f6463370f6764b46bfe4befd9a8be2eb/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:58:14.130468 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16814aca-66d6-4458-b932-2f4bb3db9804 service placement] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:14.141148 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16814aca-66d6-4458-b932-2f4bb3db9804 service placement] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:14.201972 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0cd3c-5378-4629-9f5d-67346499af2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:14.202583 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0cd3c-5378-4629-9f5d-67346499af2d admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:14.202867 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0cd3c-5378-4629-9f5d-67346499af2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:14.203606 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0cd3c-5378-4629-9f5d-67346499af2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:14.203812 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0cd3c-5378-4629-9f5d-67346499af2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:14.206004 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0cd3c-5378-4629-9f5d-67346499af2d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:14.217481 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1431/2852] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:58:14.222413 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc7b06-9cb1-4149-8e4c-633e03276fd4 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:14.233038 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc7b06-9cb1-4149-8e4c-633e03276fd4 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:14.238323 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce6e43-d43a-4fde-8708-7de19c63cb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:14.239000 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce6e43-d43a-4fde-8708-7de19c63cb0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:14.239309 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce6e43-d43a-4fde-8708-7de19c63cb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:14.239592 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce6e43-d43a-4fde-8708-7de19c63cb0d admin admin] PATH_INFO: `/v3/projects/681a9d9418ab421696621f8349ecea45/users/f6463370f6764b46bfe4befd9a8be2eb/roles/d12af9f1dfb344cd8a6a493e165030ba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:14.241587 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce6e43-d43a-4fde-8708-7de19c63cb0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=681a9d9418ab421696621f8349ecea45, user_id=f6463370f6764b46bfe4befd9a8be2eb, role_id=d12af9f1dfb344cd8a6a493e165030ba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:14.244284 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce6e43-d43a-4fde-8708-7de19c63cb0d admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:14.256814 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1422/2853] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:58:14 2022] PUT /identity/v3/projects/681a9d9418ab421696621f8349ecea45/users/f6463370f6764b46bfe4befd9a8be2eb/roles/d12af9f1dfb344cd8a6a493e165030ba => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:58:14.267715 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8597097-082e-473a-9284-35922b4ba2b3 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:14.268008 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8597097-082e-473a-9284-35922b4ba2b3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:14.268292 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8597097-082e-473a-9284-35922b4ba2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:14.300171 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c8597097-082e-473a-9284-35922b4ba2b3 None None] MFA Rules not processed for user `f6463370f6764b46bfe4befd9a8be2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:58:14.301635 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c8597097-082e-473a-9284-35922b4ba2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:14.381104 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1432/2854] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:58:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:58:14.393636 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce6e43-d43a-4fde-8708-7de19c63cb0d admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:14.395817 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-fdce6e43-d43a-4fde-8708-7de19c63cb0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:14.469058 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce6e43-d43a-4fde-8708-7de19c63cb0d admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:14.473548 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e308052-56b5-4eea-955a-ffdcee55f0ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:14.474084 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e308052-56b5-4eea-955a-ffdcee55f0ac service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:14.474366 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e308052-56b5-4eea-955a-ffdcee55f0ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:14.474684 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e308052-56b5-4eea-955a-ffdcee55f0ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:14.481109 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:58:14.537154 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e308052-56b5-4eea-955a-ffdcee55f0ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:14.539716 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e308052-56b5-4eea-955a-ffdcee55f0ac service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:14.550815 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1423/2855] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:58:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:58:16.622181 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8597097-082e-473a-9284-35922b4ba2b3 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:16.623236 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c8597097-082e-473a-9284-35922b4ba2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:16.637980 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8597097-082e-473a-9284-35922b4ba2b3 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:16.641805 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab202898-bbf2-4ae4-ac69-6917c7caf52b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:16.643039 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab202898-bbf2-4ae4-ac69-6917c7caf52b service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:16.643357 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab202898-bbf2-4ae4-ac69-6917c7caf52b service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:16.643806 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab202898-bbf2-4ae4-ac69-6917c7caf52b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:16.649603 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:58:16.723302 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab202898-bbf2-4ae4-ac69-6917c7caf52b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:16.724952 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab202898-bbf2-4ae4-ac69-6917c7caf52b service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:16.734985 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1433/2856] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:58:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:58:17.917473 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e308052-56b5-4eea-955a-ffdcee55f0ac service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:17.919434 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2e308052-56b5-4eea-955a-ffdcee55f0ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:17.988517 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e308052-56b5-4eea-955a-ffdcee55f0ac service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:17.993085 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a07c3-989a-4587-87b4-9f06b5b29201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:17.993753 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a07c3-989a-4587-87b4-9f06b5b29201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:17.994029 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a07c3-989a-4587-87b4-9f06b5b29201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:17.994299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a07c3-989a-4587-87b4-9f06b5b29201 admin admin] PATH_INFO: `/v3/users/a689ca2ce6a34716973ceb56826a4676` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:17.995459 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a07c3-989a-4587-87b4-9f06b5b29201 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a689ca2ce6a34716973ceb56826a4676)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:17.997372 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a07c3-989a-4587-87b4-9f06b5b29201 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:18.198285 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e47a07c3-989a-4587-87b4-9f06b5b29201 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a689ca2ce6a34716973ceb56826a4676'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:18.198967 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e47a07c3-989a-4587-87b4-9f06b5b29201 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a689ca2ce6a34716973ceb56826a4676'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:18.206834 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e47a07c3-989a-4587-87b4-9f06b5b29201 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a689ca2ce6a34716973ceb56826a4676'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:18.207500 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e47a07c3-989a-4587-87b4-9f06b5b29201 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a689ca2ce6a34716973ceb56826a4676'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:18.275051 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e47a07c3-989a-4587-87b4-9f06b5b29201 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a689ca2ce6a34716973ceb56826a4676'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:18.296544 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1424/2857] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:58:17 2022] DELETE /identity/v3/users/a689ca2ce6a34716973ceb56826a4676 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:58:18.368044 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab202898-bbf2-4ae4-ac69-6917c7caf52b service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:18.377685 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab202898-bbf2-4ae4-ac69-6917c7caf52b service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:18.429596 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002ddea-8438-48a0-9e03-3b5ad8ab2099 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:18.430239 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002ddea-8438-48a0-9e03-3b5ad8ab2099 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:18.430543 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002ddea-8438-48a0-9e03-3b5ad8ab2099 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:18.431441 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002ddea-8438-48a0-9e03-3b5ad8ab2099 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:18.432646 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4002ddea-8438-48a0-9e03-3b5ad8ab2099 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:18.497555 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002ddea-8438-48a0-9e03-3b5ad8ab2099 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:18.499190 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002ddea-8438-48a0-9e03-3b5ad8ab2099 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:18.509610 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1434/2858] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:58:18 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:58:18.562133 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a07c3-989a-4587-87b4-9f06b5b29201 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:18.563697 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e47a07c3-989a-4587-87b4-9f06b5b29201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:18.600141 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:58:18.634008 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a07c3-989a-4587-87b4-9f06b5b29201 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:18.638923 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc1eeb-5c8b-4868-9848-95ff369e29ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:18.639657 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc1eeb-5c8b-4868-9848-95ff369e29ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:18.639943 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc1eeb-5c8b-4868-9848-95ff369e29ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:18.640217 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc1eeb-5c8b-4868-9848-95ff369e29ea admin admin] PATH_INFO: `/v3/projects/a2fa9e135d2743b191acfb1616c3b3f0` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:18.641440 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc1eeb-5c8b-4868-9848-95ff369e29ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2fa9e135d2743b191acfb1616c3b3f0)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:18.643427 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc1eeb-5c8b-4868-9848-95ff369e29ea admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:18.785846 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f3bc1eeb-5c8b-4868-9848-95ff369e29ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2fa9e135d2743b191acfb1616c3b3f0', 'request_id': 'req-f3bc1eeb-5c8b-4868-9848-95ff369e29ea'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:18.791367 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f3bc1eeb-5c8b-4868-9848-95ff369e29ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2fa9e135d2743b191acfb1616c3b3f0', 'request_id': 'req-f3bc1eeb-5c8b-4868-9848-95ff369e29ea'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:18.874855 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f3bc1eeb-5c8b-4868-9848-95ff369e29ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2fa9e135d2743b191acfb1616c3b3f0', 'request_id': 'req-f3bc1eeb-5c8b-4868-9848-95ff369e29ea'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:18.887633 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f3bc1eeb-5c8b-4868-9848-95ff369e29ea admin admin] The token cache is being invalidate because project a2fa9e135d2743b191acfb1616c3b3f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:58:18.887958 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f3bc1eeb-5c8b-4868-9848-95ff369e29ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:18.888607 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f3bc1eeb-5c8b-4868-9848-95ff369e29ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:18.890148 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1425/2859] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:58:18 2022] DELETE /identity/v3/projects/a2fa9e135d2743b191acfb1616c3b3f0 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:58:18.894909 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002ddea-8438-48a0-9e03-3b5ad8ab2099 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:18.905736 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002ddea-8438-48a0-9e03-3b5ad8ab2099 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:18.957917 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:58:18.963830 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39a6da-91e1-4f99-8023-e953d4362945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:18.964486 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39a6da-91e1-4f99-8023-e953d4362945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:18.964789 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39a6da-91e1-4f99-8023-e953d4362945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:18.965066 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39a6da-91e1-4f99-8023-e953d4362945 admin admin] PATH_INFO: `/v3/users/1a73109fe8fe4443adad6cefa097314a` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:18.966187 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39a6da-91e1-4f99-8023-e953d4362945 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a73109fe8fe4443adad6cefa097314a)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:18.968453 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39a6da-91e1-4f99-8023-e953d4362945 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:19.195440 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1d39a6da-91e1-4f99-8023-e953d4362945 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a73109fe8fe4443adad6cefa097314a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:19.269959 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1d39a6da-91e1-4f99-8023-e953d4362945 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a73109fe8fe4443adad6cefa097314a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:19.270599 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1d39a6da-91e1-4f99-8023-e953d4362945 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a73109fe8fe4443adad6cefa097314a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:19.276151 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1d39a6da-91e1-4f99-8023-e953d4362945 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a73109fe8fe4443adad6cefa097314a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:19.278837 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1d39a6da-91e1-4f99-8023-e953d4362945 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a73109fe8fe4443adad6cefa097314a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:19.296503 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1435/2860] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:58:18 2022] DELETE /identity/v3/users/1a73109fe8fe4443adad6cefa097314a => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:58:19.544060 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc1eeb-5c8b-4868-9848-95ff369e29ea admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:19.545795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f3bc1eeb-5c8b-4868-9848-95ff369e29ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:19.561967 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc1eeb-5c8b-4868-9848-95ff369e29ea admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:19.621583 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d25b9-a820-4087-93a9-b42a68851035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:19.622224 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d25b9-a820-4087-93a9-b42a68851035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:19.622509 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d25b9-a820-4087-93a9-b42a68851035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:19.622785 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d25b9-a820-4087-93a9-b42a68851035 admin admin] PATH_INFO: `/v3/projects/383e8cd4fc6541818bfa0615c288c07e` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:19.623936 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d25b9-a820-4087-93a9-b42a68851035 admin admin] RBAC: Authorizing `identity:delete_project(project_id=383e8cd4fc6541818bfa0615c288c07e)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:19.625850 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d25b9-a820-4087-93a9-b42a68851035 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:19.729487 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-547d25b9-a820-4087-93a9-b42a68851035 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '383e8cd4fc6541818bfa0615c288c07e', 'request_id': 'req-547d25b9-a820-4087-93a9-b42a68851035'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:19.738618 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-547d25b9-a820-4087-93a9-b42a68851035 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '383e8cd4fc6541818bfa0615c288c07e', 'request_id': 'req-547d25b9-a820-4087-93a9-b42a68851035'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:19.741464 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:58:19.823168 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-547d25b9-a820-4087-93a9-b42a68851035 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '383e8cd4fc6541818bfa0615c288c07e', 'request_id': 'req-547d25b9-a820-4087-93a9-b42a68851035'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:19.845414 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-547d25b9-a820-4087-93a9-b42a68851035 admin admin] The token cache is being invalidate because project 383e8cd4fc6541818bfa0615c288c07e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:58:19.845414 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-547d25b9-a820-4087-93a9-b42a68851035 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:19.845414 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-547d25b9-a820-4087-93a9-b42a68851035 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:19.845414 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1426/2861] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:58:19 2022] DELETE /identity/v3/projects/383e8cd4fc6541818bfa0615c288c07e => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:58:23.325046 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39a6da-91e1-4f99-8023-e953d4362945 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:23.326499 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1d39a6da-91e1-4f99-8023-e953d4362945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:23.339950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39a6da-91e1-4f99-8023-e953d4362945 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:23.400243 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffdd3b-e7bf-4607-82ab-b9a74a7a51f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:23.400799 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffdd3b-e7bf-4607-82ab-b9a74a7a51f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:23.401082 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffdd3b-e7bf-4607-82ab-b9a74a7a51f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:23.401362 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffdd3b-e7bf-4607-82ab-b9a74a7a51f8 admin admin] PATH_INFO: `/v3/users/5c878c6cc9f745fa8aa49d99c2b68ff8` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:23.402495 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ffdd3b-e7bf-4607-82ab-b9a74a7a51f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c878c6cc9f745fa8aa49d99c2b68ff8)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:23.404473 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ffdd3b-e7bf-4607-82ab-b9a74a7a51f8 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:23.621116 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-55ffdd3b-e7bf-4607-82ab-b9a74a7a51f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c878c6cc9f745fa8aa49d99c2b68ff8'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:23.698247 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-55ffdd3b-e7bf-4607-82ab-b9a74a7a51f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c878c6cc9f745fa8aa49d99c2b68ff8'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:23.698961 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-55ffdd3b-e7bf-4607-82ab-b9a74a7a51f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c878c6cc9f745fa8aa49d99c2b68ff8'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:23.699627 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-55ffdd3b-e7bf-4607-82ab-b9a74a7a51f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c878c6cc9f745fa8aa49d99c2b68ff8'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:23.708848 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-55ffdd3b-e7bf-4607-82ab-b9a74a7a51f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c878c6cc9f745fa8aa49d99c2b68ff8'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:23.721328 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:58:23.728723 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1436/2862] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:58:23 2022] DELETE /identity/v3/users/5c878c6cc9f745fa8aa49d99c2b68ff8 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:58:23.733346 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80e840-1ffd-406e-a589-43d7ff658094 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:23.733841 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80e840-1ffd-406e-a589-43d7ff658094 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:23.733941 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80e840-1ffd-406e-a589-43d7ff658094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:23.753592 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-9a80e840-1ffd-406e-a589-43d7ff658094 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:58:23.754809 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9a80e840-1ffd-406e-a589-43d7ff658094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:23.811936 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1427/2863] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:58:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:58:23.822256 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffdd3b-e7bf-4607-82ab-b9a74a7a51f8 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:23.823701 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-55ffdd3b-e7bf-4607-82ab-b9a74a7a51f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:23.882125 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffdd3b-e7bf-4607-82ab-b9a74a7a51f8 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:23.885789 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fdb19d-d185-4adc-b18f-b19331efd9f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:23.886391 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdb19d-d185-4adc-b18f-b19331efd9f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:23.886672 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdb19d-d185-4adc-b18f-b19331efd9f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:23.886950 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdb19d-d185-4adc-b18f-b19331efd9f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:23.896732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fdb19d-d185-4adc-b18f-b19331efd9f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:23.899110 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fdb19d-d185-4adc-b18f-b19331efd9f0 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:23.911054 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1437/2864] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:58:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:58:24.299541 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80e840-1ffd-406e-a589-43d7ff658094 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:24.303829 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9a80e840-1ffd-406e-a589-43d7ff658094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:24.319224 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80e840-1ffd-406e-a589-43d7ff658094 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:24.323981 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44bbdb-6417-4015-9912-f430bc866425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:24.324623 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44bbdb-6417-4015-9912-f430bc866425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:24.324908 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44bbdb-6417-4015-9912-f430bc866425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:24.325211 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44bbdb-6417-4015-9912-f430bc866425 admin admin] PATH_INFO: `/v3/projects/6ab4712973be4b0aa7da5bef0a494017` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:24.326394 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a44bbdb-6417-4015-9912-f430bc866425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ab4712973be4b0aa7da5bef0a494017)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:24.328308 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a44bbdb-6417-4015-9912-f430bc866425 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:24.619064 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1a44bbdb-6417-4015-9912-f430bc866425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ab4712973be4b0aa7da5bef0a494017', 'request_id': 'req-1a44bbdb-6417-4015-9912-f430bc866425'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:24.624653 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1a44bbdb-6417-4015-9912-f430bc866425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ab4712973be4b0aa7da5bef0a494017', 'request_id': 'req-1a44bbdb-6417-4015-9912-f430bc866425'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:24.731748 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1a44bbdb-6417-4015-9912-f430bc866425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ab4712973be4b0aa7da5bef0a494017', 'request_id': 'req-1a44bbdb-6417-4015-9912-f430bc866425'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:24.744390 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1a44bbdb-6417-4015-9912-f430bc866425 admin admin] The token cache is being invalidate because project 6ab4712973be4b0aa7da5bef0a494017 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:58:24.746328 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1a44bbdb-6417-4015-9912-f430bc866425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:24.746328 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1a44bbdb-6417-4015-9912-f430bc866425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:24.746846 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1428/2865] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:58:24 2022] DELETE /identity/v3/projects/6ab4712973be4b0aa7da5bef0a494017 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:58:24.753767 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fdb19d-d185-4adc-b18f-b19331efd9f0 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:24.765349 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fdb19d-d185-4adc-b18f-b19331efd9f0 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:24.829241 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3497dd0e-6e69-4591-932b-8096a67f60cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:24.829877 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497dd0e-6e69-4591-932b-8096a67f60cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:24.830180 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497dd0e-6e69-4591-932b-8096a67f60cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:24.830454 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497dd0e-6e69-4591-932b-8096a67f60cd admin admin] PATH_INFO: `/v3/users/2cd3d2d74b384c05a03a86f5a1a0c1cc` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:24.832168 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3497dd0e-6e69-4591-932b-8096a67f60cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cd3d2d74b384c05a03a86f5a1a0c1cc)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:24.835853 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3497dd0e-6e69-4591-932b-8096a67f60cd admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:25.057985 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3497dd0e-6e69-4591-932b-8096a67f60cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cd3d2d74b384c05a03a86f5a1a0c1cc'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:25.160940 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3497dd0e-6e69-4591-932b-8096a67f60cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cd3d2d74b384c05a03a86f5a1a0c1cc'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:25.161569 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3497dd0e-6e69-4591-932b-8096a67f60cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cd3d2d74b384c05a03a86f5a1a0c1cc'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:25.162203 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3497dd0e-6e69-4591-932b-8096a67f60cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cd3d2d74b384c05a03a86f5a1a0c1cc'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:25.170554 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3497dd0e-6e69-4591-932b-8096a67f60cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cd3d2d74b384c05a03a86f5a1a0c1cc'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:25.189394 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1438/2866] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:58:24 2022] DELETE /identity/v3/users/2cd3d2d74b384c05a03a86f5a1a0c1cc => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:58:25.614954 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44bbdb-6417-4015-9912-f430bc866425 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:25.617408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1a44bbdb-6417-4015-9912-f430bc866425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:25.630540 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44bbdb-6417-4015-9912-f430bc866425 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:25.709746 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c312f-6a02-4430-b26f-015bf54e9e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:25.710422 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c312f-6a02-4430-b26f-015bf54e9e27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:25.710673 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c312f-6a02-4430-b26f-015bf54e9e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:25.710947 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c312f-6a02-4430-b26f-015bf54e9e27 admin admin] PATH_INFO: `/v3/projects/c460e14af3394f60b5fb3148ade0d9b4` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:25.712130 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c312f-6a02-4430-b26f-015bf54e9e27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c460e14af3394f60b5fb3148ade0d9b4)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:25.714061 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c312f-6a02-4430-b26f-015bf54e9e27 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:25.726529 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:58:25.829728 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-551c312f-6a02-4430-b26f-015bf54e9e27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c460e14af3394f60b5fb3148ade0d9b4', 'request_id': 'req-551c312f-6a02-4430-b26f-015bf54e9e27'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:25.835228 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-551c312f-6a02-4430-b26f-015bf54e9e27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c460e14af3394f60b5fb3148ade0d9b4', 'request_id': 'req-551c312f-6a02-4430-b26f-015bf54e9e27'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:25.909482 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-551c312f-6a02-4430-b26f-015bf54e9e27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c460e14af3394f60b5fb3148ade0d9b4', 'request_id': 'req-551c312f-6a02-4430-b26f-015bf54e9e27'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:25.921589 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-551c312f-6a02-4430-b26f-015bf54e9e27 admin admin] The token cache is being invalidate because project c460e14af3394f60b5fb3148ade0d9b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:58:25.921878 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-551c312f-6a02-4430-b26f-015bf54e9e27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:25.922508 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-551c312f-6a02-4430-b26f-015bf54e9e27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:25.924012 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1429/2867] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:58:25 2022] DELETE /identity/v3/projects/c460e14af3394f60b5fb3148ade0d9b4 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:58:25.928770 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3497dd0e-6e69-4591-932b-8096a67f60cd admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:25.930432 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3497dd0e-6e69-4591-932b-8096a67f60cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:25.944804 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3497dd0e-6e69-4591-932b-8096a67f60cd admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:25.958193 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:58:26.005045 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4035e35-305d-4cd6-810a-1c0b3bb9288a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:26.005677 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4035e35-305d-4cd6-810a-1c0b3bb9288a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:26.005958 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4035e35-305d-4cd6-810a-1c0b3bb9288a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:26.006237 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4035e35-305d-4cd6-810a-1c0b3bb9288a admin admin] PATH_INFO: `/v3/users/f6463370f6764b46bfe4befd9a8be2eb` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:26.007401 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4035e35-305d-4cd6-810a-1c0b3bb9288a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6463370f6764b46bfe4befd9a8be2eb)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:26.009340 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4035e35-305d-4cd6-810a-1c0b3bb9288a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:26.214807 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d4035e35-305d-4cd6-810a-1c0b3bb9288a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6463370f6764b46bfe4befd9a8be2eb'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:26.257166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d4035e35-305d-4cd6-810a-1c0b3bb9288a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6463370f6764b46bfe4befd9a8be2eb'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:26.257834 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d4035e35-305d-4cd6-810a-1c0b3bb9288a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6463370f6764b46bfe4befd9a8be2eb'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:26.258534 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d4035e35-305d-4cd6-810a-1c0b3bb9288a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6463370f6764b46bfe4befd9a8be2eb'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:26.265810 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d4035e35-305d-4cd6-810a-1c0b3bb9288a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6463370f6764b46bfe4befd9a8be2eb'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:26.282746 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1439/2868] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:58:25 2022] DELETE /identity/v3/users/f6463370f6764b46bfe4befd9a8be2eb => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:58:26.658940 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c312f-6a02-4430-b26f-015bf54e9e27 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:26.661016 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-551c312f-6a02-4430-b26f-015bf54e9e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:26.679331 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c312f-6a02-4430-b26f-015bf54e9e27 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:26.740673 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33059d34-72f4-4ff9-9932-3538a1717ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:26.741287 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33059d34-72f4-4ff9-9932-3538a1717ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:26.741567 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33059d34-72f4-4ff9-9932-3538a1717ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:26.741852 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33059d34-72f4-4ff9-9932-3538a1717ec1 admin admin] PATH_INFO: `/v3/projects/681a9d9418ab421696621f8349ecea45` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:26.743038 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33059d34-72f4-4ff9-9932-3538a1717ec1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=681a9d9418ab421696621f8349ecea45)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:26.745255 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33059d34-72f4-4ff9-9932-3538a1717ec1 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:26.914736 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-33059d34-72f4-4ff9-9932-3538a1717ec1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '681a9d9418ab421696621f8349ecea45', 'request_id': 'req-33059d34-72f4-4ff9-9932-3538a1717ec1'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:26.920354 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-33059d34-72f4-4ff9-9932-3538a1717ec1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '681a9d9418ab421696621f8349ecea45', 'request_id': 'req-33059d34-72f4-4ff9-9932-3538a1717ec1'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:27.006126 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-33059d34-72f4-4ff9-9932-3538a1717ec1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '681a9d9418ab421696621f8349ecea45', 'request_id': 'req-33059d34-72f4-4ff9-9932-3538a1717ec1'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:27.017773 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-33059d34-72f4-4ff9-9932-3538a1717ec1 admin admin] The token cache is being invalidate because project 681a9d9418ab421696621f8349ecea45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:58:27.018066 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-33059d34-72f4-4ff9-9932-3538a1717ec1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:27.018695 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-33059d34-72f4-4ff9-9932-3538a1717ec1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:27.020210 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1430/2869] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:58:26 2022] DELETE /identity/v3/projects/681a9d9418ab421696621f8349ecea45 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:58:27.025107 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3c7da-d9d7-47ca-887e-411834c5b7df None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:27.025616 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3c7da-d9d7-47ca-887e-411834c5b7df None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:27.025734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3c7da-d9d7-47ca-887e-411834c5b7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:27.044691 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-efb3c7da-d9d7-47ca-887e-411834c5b7df None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:58:27.045895 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-efb3c7da-d9d7-47ca-887e-411834c5b7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:27.105577 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1440/2870] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:58:27.115633 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8cb90-e908-41d2-a99c-b68fcac25647 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:27.115924 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8cb90-e908-41d2-a99c-b68fcac25647 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:27.116206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8cb90-e908-41d2-a99c-b68fcac25647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:27.136376 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-71e8cb90-e908-41d2-a99c-b68fcac25647 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:58:27.137573 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-71e8cb90-e908-41d2-a99c-b68fcac25647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:27.145865 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1431/2871] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:58:27.150161 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3c7da-d9d7-47ca-887e-411834c5b7df None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:27.160645 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3c7da-d9d7-47ca-887e-411834c5b7df None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:27.165360 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9115b-9c0c-4bcb-b860-e59ab9de5360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:27.166042 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9115b-9c0c-4bcb-b860-e59ab9de5360 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:27.166274 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9115b-9c0c-4bcb-b860-e59ab9de5360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:27.166546 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9115b-9c0c-4bcb-b860-e59ab9de5360 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:27.167193 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9115b-9c0c-4bcb-b860-e59ab9de5360 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:58:27.167536 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9115b-9c0c-4bcb-b860-e59ab9de5360 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:27.169154 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9115b-9c0c-4bcb-b860-e59ab9de5360 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:27.182149 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1441/2872] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:58:27.186592 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8cb90-e908-41d2-a99c-b68fcac25647 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:27.196761 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8cb90-e908-41d2-a99c-b68fcac25647 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:27.201579 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a74d4d-c6b0-494b-be00-47177cdd0d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:27.202195 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a74d4d-c6b0-494b-be00-47177cdd0d37 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:27.202477 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a74d4d-c6b0-494b-be00-47177cdd0d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:27.202754 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a74d4d-c6b0-494b-be00-47177cdd0d37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:27.203471 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a74d4d-c6b0-494b-be00-47177cdd0d37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:27.205342 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a74d4d-c6b0-494b-be00-47177cdd0d37 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:27.294202 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1432/2873] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:58:27 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:58:27.298408 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9115b-9c0c-4bcb-b860-e59ab9de5360 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:27.308710 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9115b-9c0c-4bcb-b860-e59ab9de5360 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:27.330805 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:58:27.368432 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f8ec6-1a53-4905-ad25-19497f7f807b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:27.369047 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f8ec6-1a53-4905-ad25-19497f7f807b admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:27.369331 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f8ec6-1a53-4905-ad25-19497f7f807b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:27.369606 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f8ec6-1a53-4905-ad25-19497f7f807b admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:27.370250 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f8ec6-1a53-4905-ad25-19497f7f807b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:27.372256 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f8ec6-1a53-4905-ad25-19497f7f807b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:27.458327 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1442/2874] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:58:27 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:58:27.462726 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a74d4d-c6b0-494b-be00-47177cdd0d37 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:27.468619 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:58:27.475002 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a74d4d-c6b0-494b-be00-47177cdd0d37 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:27.479839 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29026922-11c6-4694-9657-319ee55b5bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:27.480457 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29026922-11c6-4694-9657-319ee55b5bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:27.480741 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29026922-11c6-4694-9657-319ee55b5bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:27.481019 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29026922-11c6-4694-9657-319ee55b5bf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:27.481764 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29026922-11c6-4694-9657-319ee55b5bf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:27.483398 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29026922-11c6-4694-9657-319ee55b5bf5 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:27.494193 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1433/2875] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:58:27.501631 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f8ec6-1a53-4905-ad25-19497f7f807b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:27.511863 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f8ec6-1a53-4905-ad25-19497f7f807b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:27.517087 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970bd523-6fd9-4749-b29a-f47623a7555f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:27.517704 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bd523-6fd9-4749-b29a-f47623a7555f admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:27.517987 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bd523-6fd9-4749-b29a-f47623a7555f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:27.518264 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bd523-6fd9-4749-b29a-f47623a7555f admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:27.519520 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970bd523-6fd9-4749-b29a-f47623a7555f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:27.521230 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970bd523-6fd9-4749-b29a-f47623a7555f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:27.532229 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1443/2876] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:58:27.537290 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29026922-11c6-4694-9657-319ee55b5bf5 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:27.547421 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29026922-11c6-4694-9657-319ee55b5bf5 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:27.552095 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80509da0-e962-4a73-bdd3-19122a3320b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:27.552755 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80509da0-e962-4a73-bdd3-19122a3320b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:27.553077 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80509da0-e962-4a73-bdd3-19122a3320b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:27.553592 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80509da0-e962-4a73-bdd3-19122a3320b1 admin admin] PATH_INFO: `/v3/projects/58013a17c8db494f9826bdcb57d4adbd/users/ca6832f5818f42d78f277dbbcef82055/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:27.569929 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80509da0-e962-4a73-bdd3-19122a3320b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58013a17c8db494f9826bdcb57d4adbd, user_id=ca6832f5818f42d78f277dbbcef82055, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:27.572743 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80509da0-e962-4a73-bdd3-19122a3320b1 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:27.647422 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1434/2877] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:58:27 2022] PUT /identity/v3/projects/58013a17c8db494f9826bdcb57d4adbd/users/ca6832f5818f42d78f277dbbcef82055/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:58:27.657644 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0140c2e-fab8-411f-9d7f-0301133bea78 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:27.657928 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0140c2e-fab8-411f-9d7f-0301133bea78 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:27.658197 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0140c2e-fab8-411f-9d7f-0301133bea78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:27.686350 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-a0140c2e-fab8-411f-9d7f-0301133bea78 None None] MFA Rules not processed for user `ca6832f5818f42d78f277dbbcef82055`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:58:27.687600 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a0140c2e-fab8-411f-9d7f-0301133bea78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:27.750389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1444/2878] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:58:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:58:27.761760 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80509da0-e962-4a73-bdd3-19122a3320b1 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:27.763469 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-80509da0-e962-4a73-bdd3-19122a3320b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:27.822982 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80509da0-e962-4a73-bdd3-19122a3320b1 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:27.826776 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432819e5-e8dd-499b-8bac-c563fa40b176 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:27.827425 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432819e5-e8dd-499b-8bac-c563fa40b176 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:27.827706 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432819e5-e8dd-499b-8bac-c563fa40b176 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:27.827982 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432819e5-e8dd-499b-8bac-c563fa40b176 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:27.837281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432819e5-e8dd-499b-8bac-c563fa40b176 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:27.838760 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432819e5-e8dd-499b-8bac-c563fa40b176 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:27.848616 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1435/2879] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:58:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:58:30.911191 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0140c2e-fab8-411f-9d7f-0301133bea78 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:30.978180 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0140c2e-fab8-411f-9d7f-0301133bea78 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:30.982972 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879e9a9-c2d3-479d-9527-c67a34c92717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:30.983644 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879e9a9-c2d3-479d-9527-c67a34c92717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:30.983928 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879e9a9-c2d3-479d-9527-c67a34c92717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:30.984208 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879e9a9-c2d3-479d-9527-c67a34c92717 admin admin] PATH_INFO: `/v3/users/ca6832f5818f42d78f277dbbcef82055` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:30.985356 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879e9a9-c2d3-479d-9527-c67a34c92717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca6832f5818f42d78f277dbbcef82055)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:30.988000 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879e9a9-c2d3-479d-9527-c67a34c92717 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:31.183003 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:58:31.193483 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9879e9a9-c2d3-479d-9527-c67a34c92717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca6832f5818f42d78f277dbbcef82055'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:31.268821 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9879e9a9-c2d3-479d-9527-c67a34c92717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca6832f5818f42d78f277dbbcef82055'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:31.269379 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9879e9a9-c2d3-479d-9527-c67a34c92717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca6832f5818f42d78f277dbbcef82055'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:31.270033 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9879e9a9-c2d3-479d-9527-c67a34c92717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca6832f5818f42d78f277dbbcef82055'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:31.277834 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9879e9a9-c2d3-479d-9527-c67a34c92717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca6832f5818f42d78f277dbbcef82055'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:31.296120 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1445/2880] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:58:30 2022] DELETE /identity/v3/users/ca6832f5818f42d78f277dbbcef82055 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:58:31.301177 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af80f6-fdaf-4194-bc6a-5e8a756c0d79 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:31.308686 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af80f6-fdaf-4194-bc6a-5e8a756c0d79 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:31.308686 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af80f6-fdaf-4194-bc6a-5e8a756c0d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:31.322465 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-15af80f6-fdaf-4194-bc6a-5e8a756c0d79 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:58:31.323736 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-15af80f6-fdaf-4194-bc6a-5e8a756c0d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:31.385402 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1436/2881] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:58:31.395763 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879e9a9-c2d3-479d-9527-c67a34c92717 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:31.397241 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9879e9a9-c2d3-479d-9527-c67a34c92717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:31.457264 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879e9a9-c2d3-479d-9527-c67a34c92717 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:31.461600 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1983babf-f38e-4f94-85ac-0b4729092ebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:31.462259 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983babf-f38e-4f94-85ac-0b4729092ebf service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:31.462518 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983babf-f38e-4f94-85ac-0b4729092ebf service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:31.462787 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983babf-f38e-4f94-85ac-0b4729092ebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:31.473174 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1983babf-f38e-4f94-85ac-0b4729092ebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:31.474607 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1983babf-f38e-4f94-85ac-0b4729092ebf service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:31.483961 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1446/2882] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:58:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:58:31.893745 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af80f6-fdaf-4194-bc6a-5e8a756c0d79 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:31.895386 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-15af80f6-fdaf-4194-bc6a-5e8a756c0d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:31.907958 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af80f6-fdaf-4194-bc6a-5e8a756c0d79 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:31.913519 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3dd483-ab41-4ace-8ca8-ef6f7b37fa7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:31.914280 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3dd483-ab41-4ace-8ca8-ef6f7b37fa7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:31.914567 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3dd483-ab41-4ace-8ca8-ef6f7b37fa7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:31.914846 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3dd483-ab41-4ace-8ca8-ef6f7b37fa7e admin admin] PATH_INFO: `/v3/projects/58013a17c8db494f9826bdcb57d4adbd` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:31.916019 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3dd483-ab41-4ace-8ca8-ef6f7b37fa7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=58013a17c8db494f9826bdcb57d4adbd)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:31.917953 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3dd483-ab41-4ace-8ca8-ef6f7b37fa7e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:32.037957 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-9e3dd483-ab41-4ace-8ca8-ef6f7b37fa7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58013a17c8db494f9826bdcb57d4adbd', 'request_id': 'req-9e3dd483-ab41-4ace-8ca8-ef6f7b37fa7e'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:32.043858 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-9e3dd483-ab41-4ace-8ca8-ef6f7b37fa7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58013a17c8db494f9826bdcb57d4adbd', 'request_id': 'req-9e3dd483-ab41-4ace-8ca8-ef6f7b37fa7e'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:32.104900 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-9e3dd483-ab41-4ace-8ca8-ef6f7b37fa7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58013a17c8db494f9826bdcb57d4adbd', 'request_id': 'req-9e3dd483-ab41-4ace-8ca8-ef6f7b37fa7e'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:32.106521 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:58:32.118427 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-9e3dd483-ab41-4ace-8ca8-ef6f7b37fa7e admin admin] The token cache is being invalidate because project 58013a17c8db494f9826bdcb57d4adbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:58:32.119448 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-9e3dd483-ab41-4ace-8ca8-ef6f7b37fa7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:32.119996 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-9e3dd483-ab41-4ace-8ca8-ef6f7b37fa7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:32.121524 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1437/2883] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:58:31 2022] DELETE /identity/v3/projects/58013a17c8db494f9826bdcb57d4adbd => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:58:32.126385 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900481c-e782-482e-94ae-1047600ab7fd None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:32.126873 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900481c-e782-482e-94ae-1047600ab7fd None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:32.126973 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900481c-e782-482e-94ae-1047600ab7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:32.146806 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-7900481c-e782-482e-94ae-1047600ab7fd None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:58:32.147975 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7900481c-e782-482e-94ae-1047600ab7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:32.212947 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1447/2884] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:58:32.220941 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8e4d6-9e00-475a-88f8-e2af4f4cadbe None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:32.221233 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8e4d6-9e00-475a-88f8-e2af4f4cadbe None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:32.222123 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8e4d6-9e00-475a-88f8-e2af4f4cadbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:32.241676 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-89f8e4d6-9e00-475a-88f8-e2af4f4cadbe None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:58:32.242890 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-89f8e4d6-9e00-475a-88f8-e2af4f4cadbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:32.250893 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1438/2885] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:58:32.255143 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900481c-e782-482e-94ae-1047600ab7fd None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:32.265367 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900481c-e782-482e-94ae-1047600ab7fd None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:32.270818 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6bb507-3a5d-4e87-bb67-f01f374a9a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:32.271449 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bb507-3a5d-4e87-bb67-f01f374a9a5d admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:32.271753 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bb507-3a5d-4e87-bb67-f01f374a9a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:32.272034 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bb507-3a5d-4e87-bb67-f01f374a9a5d admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:32.272682 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6bb507-3a5d-4e87-bb67-f01f374a9a5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:58:32.273045 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6bb507-3a5d-4e87-bb67-f01f374a9a5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:32.274661 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6bb507-3a5d-4e87-bb67-f01f374a9a5d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:32.286927 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1448/2886] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 08:58:32.291385 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8e4d6-9e00-475a-88f8-e2af4f4cadbe None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:32.301075 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8e4d6-9e00-475a-88f8-e2af4f4cadbe None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:32.305842 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c83e0-c975-42a1-8a0b-a2885b6996e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:32.306438 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c83e0-c975-42a1-8a0b-a2885b6996e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:32.306714 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c83e0-c975-42a1-8a0b-a2885b6996e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:32.306982 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c83e0-c975-42a1-8a0b-a2885b6996e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:32.307659 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c83e0-c975-42a1-8a0b-a2885b6996e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:32.309581 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c83e0-c975-42a1-8a0b-a2885b6996e9 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:32.442734 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1439/2887] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:58:32 2022] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:58:32.446815 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6bb507-3a5d-4e87-bb67-f01f374a9a5d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:32.457474 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6bb507-3a5d-4e87-bb67-f01f374a9a5d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:32.498552 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:58:32.515665 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c01d6-d90f-4e4c-8265-9e61c2e75c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:32.516297 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c01d6-d90f-4e4c-8265-9e61c2e75c40 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:32.516594 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c01d6-d90f-4e4c-8265-9e61c2e75c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:32.516878 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c01d6-d90f-4e4c-8265-9e61c2e75c40 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:32.517516 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c01d6-d90f-4e4c-8265-9e61c2e75c40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:32.520186 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c01d6-d90f-4e4c-8265-9e61c2e75c40 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:32.657003 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1449/2888] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:58:32 2022] POST /identity/v3/users => generated 286 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 08:58:32.661161 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c83e0-c975-42a1-8a0b-a2885b6996e9 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:32.671734 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c83e0-c975-42a1-8a0b-a2885b6996e9 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:32.676686 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fd8be-5ed7-4a10-afbb-85d5217ec1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:32.677294 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fd8be-5ed7-4a10-afbb-85d5217ec1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:32.677578 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fd8be-5ed7-4a10-afbb-85d5217ec1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:32.677858 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fd8be-5ed7-4a10-afbb-85d5217ec1a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:32.678503 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fd8be-5ed7-4a10-afbb-85d5217ec1a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:32.680124 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fd8be-5ed7-4a10-afbb-85d5217ec1a8 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:32.692061 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1440/2889] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:58:32.696644 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c01d6-d90f-4e4c-8265-9e61c2e75c40 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:32.707401 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c01d6-d90f-4e4c-8265-9e61c2e75c40 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:32.712200 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669569a6-296f-4c2a-b40f-6f3d6e26e580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:32.712795 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669569a6-296f-4c2a-b40f-6f3d6e26e580 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:32.713072 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669569a6-296f-4c2a-b40f-6f3d6e26e580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:32.713347 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669569a6-296f-4c2a-b40f-6f3d6e26e580 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:32.713993 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669569a6-296f-4c2a-b40f-6f3d6e26e580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:32.715646 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669569a6-296f-4c2a-b40f-6f3d6e26e580 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:32.727580 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1450/2890] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:58:32.731976 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fd8be-5ed7-4a10-afbb-85d5217ec1a8 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:32.744886 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fd8be-5ed7-4a10-afbb-85d5217ec1a8 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:32.752463 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2e2fc-90da-43e6-8f49-554356eeb816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:32.753131 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2e2fc-90da-43e6-8f49-554356eeb816 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:32.753436 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2e2fc-90da-43e6-8f49-554356eeb816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:32.753720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2e2fc-90da-43e6-8f49-554356eeb816 admin admin] PATH_INFO: `/v3/projects/296038609e424d49ba19c51cb3d28227/users/e67cfe547ffb4d75b2aaf0bdeec6b471/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:32.769892 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2e2fc-90da-43e6-8f49-554356eeb816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=296038609e424d49ba19c51cb3d28227, user_id=e67cfe547ffb4d75b2aaf0bdeec6b471, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:32.772599 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2e2fc-90da-43e6-8f49-554356eeb816 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:32.852471 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1441/2891] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:58:32 2022] PUT /identity/v3/projects/296038609e424d49ba19c51cb3d28227/users/e67cfe547ffb4d75b2aaf0bdeec6b471/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:58:32.864002 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ed911-415a-4191-84ad-120771b77abe None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:32.864287 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ed911-415a-4191-84ad-120771b77abe None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:32.864561 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ed911-415a-4191-84ad-120771b77abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:32.891573 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-835ed911-415a-4191-84ad-120771b77abe None None] MFA Rules not processed for user `e67cfe547ffb4d75b2aaf0bdeec6b471`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:58:32.892780 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-835ed911-415a-4191-84ad-120771b77abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:32.961208 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1451/2892] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:58:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:58:32.974421 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2e2fc-90da-43e6-8f49-554356eeb816 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:32.976274 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-18e2e2fc-90da-43e6-8f49-554356eeb816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:33.034047 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2e2fc-90da-43e6-8f49-554356eeb816 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:33.038816 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959799ad-f970-4444-857f-e270e88cfb70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:33.039474 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959799ad-f970-4444-857f-e270e88cfb70 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:33.039760 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959799ad-f970-4444-857f-e270e88cfb70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:33.040038 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959799ad-f970-4444-857f-e270e88cfb70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:33.049335 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959799ad-f970-4444-857f-e270e88cfb70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:33.051471 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959799ad-f970-4444-857f-e270e88cfb70 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:33.061476 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1442/2893] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:58:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:58:33.089200 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ed911-415a-4191-84ad-120771b77abe None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:33.152333 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ed911-415a-4191-84ad-120771b77abe None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:33.156967 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5e684-74fb-4633-ad0a-bad673355f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:33.157604 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5e684-74fb-4633-ad0a-bad673355f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:33.157886 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5e684-74fb-4633-ad0a-bad673355f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:33.158210 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5e684-74fb-4633-ad0a-bad673355f17 admin admin] PATH_INFO: `/v3/users/e67cfe547ffb4d75b2aaf0bdeec6b471` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:33.159381 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5e684-74fb-4633-ad0a-bad673355f17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e67cfe547ffb4d75b2aaf0bdeec6b471)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:33.161814 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5e684-74fb-4633-ad0a-bad673355f17 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:33.363920 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-87a5e684-74fb-4633-ad0a-bad673355f17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e67cfe547ffb4d75b2aaf0bdeec6b471'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:33.367732 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:58:33.485866 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-87a5e684-74fb-4633-ad0a-bad673355f17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e67cfe547ffb4d75b2aaf0bdeec6b471'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:33.486521 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-87a5e684-74fb-4633-ad0a-bad673355f17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e67cfe547ffb4d75b2aaf0bdeec6b471'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:33.487166 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-87a5e684-74fb-4633-ad0a-bad673355f17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e67cfe547ffb4d75b2aaf0bdeec6b471'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:33.495174 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-87a5e684-74fb-4633-ad0a-bad673355f17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e67cfe547ffb4d75b2aaf0bdeec6b471'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:33.512876 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1452/2894] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 08:58:33 2022] DELETE /identity/v3/users/e67cfe547ffb4d75b2aaf0bdeec6b471 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:58:33.517429 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02202970-b8e5-4e2d-acc2-f7e2c40b1398 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:33.517956 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02202970-b8e5-4e2d-acc2-f7e2c40b1398 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:33.518058 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02202970-b8e5-4e2d-acc2-f7e2c40b1398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:33.536866 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-02202970-b8e5-4e2d-acc2-f7e2c40b1398 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:58:33.538070 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-02202970-b8e5-4e2d-acc2-f7e2c40b1398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:33.597616 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1443/2895] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:58:33.607721 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5e684-74fb-4633-ad0a-bad673355f17 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:33.609183 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-87a5e684-74fb-4633-ad0a-bad673355f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:33.665941 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5e684-74fb-4633-ad0a-bad673355f17 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:33.670654 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4890b96-7147-41c8-89e2-162eeadc5470 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:33.671292 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4890b96-7147-41c8-89e2-162eeadc5470 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:33.671575 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4890b96-7147-41c8-89e2-162eeadc5470 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:33.671845 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4890b96-7147-41c8-89e2-162eeadc5470 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:33.683189 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4890b96-7147-41c8-89e2-162eeadc5470 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:33.684681 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4890b96-7147-41c8-89e2-162eeadc5470 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:33.695562 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1453/2896] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:58:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 08:58:34.128206 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02202970-b8e5-4e2d-acc2-f7e2c40b1398 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:34.130146 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-02202970-b8e5-4e2d-acc2-f7e2c40b1398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:34.142770 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02202970-b8e5-4e2d-acc2-f7e2c40b1398 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:34.151556 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e82a9b-c5bf-420d-b569-6f91213973ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:34.152254 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e82a9b-c5bf-420d-b569-6f91213973ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:34.152533 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e82a9b-c5bf-420d-b569-6f91213973ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:34.152808 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e82a9b-c5bf-420d-b569-6f91213973ca admin admin] PATH_INFO: `/v3/projects/296038609e424d49ba19c51cb3d28227` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:34.154719 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e82a9b-c5bf-420d-b569-6f91213973ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=296038609e424d49ba19c51cb3d28227)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:34.156720 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e82a9b-c5bf-420d-b569-6f91213973ca admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:34.242460 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:58:34.257281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-31e82a9b-c5bf-420d-b569-6f91213973ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '296038609e424d49ba19c51cb3d28227', 'request_id': 'req-31e82a9b-c5bf-420d-b569-6f91213973ca'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:34.262876 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-31e82a9b-c5bf-420d-b569-6f91213973ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '296038609e424d49ba19c51cb3d28227', 'request_id': 'req-31e82a9b-c5bf-420d-b569-6f91213973ca'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:34.320737 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-31e82a9b-c5bf-420d-b569-6f91213973ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '296038609e424d49ba19c51cb3d28227', 'request_id': 'req-31e82a9b-c5bf-420d-b569-6f91213973ca'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:34.341887 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-31e82a9b-c5bf-420d-b569-6f91213973ca admin admin] The token cache is being invalidate because project 296038609e424d49ba19c51cb3d28227 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 08:58:34.342183 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-31e82a9b-c5bf-420d-b569-6f91213973ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:34.342852 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-31e82a9b-c5bf-420d-b569-6f91213973ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 08:58:34.344373 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1444/2897] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 08:58:34 2022] DELETE /identity/v3/projects/296038609e424d49ba19c51cb3d28227 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 08:58:34.350523 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d0c0b-93ba-43c2-8236-a6720d52f085 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:34.351052 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d0c0b-93ba-43c2-8236-a6720d52f085 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:34.351156 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d0c0b-93ba-43c2-8236-a6720d52f085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:34.371125 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-852d0c0b-93ba-43c2-8236-a6720d52f085 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:58:34.372379 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-852d0c0b-93ba-43c2-8236-a6720d52f085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:34.438095 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1454/2898] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:58:34.446778 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59acb9e-71be-4949-bcef-2f87f61a446c None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:34.447091 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59acb9e-71be-4949-bcef-2f87f61a446c None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:34.447406 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59acb9e-71be-4949-bcef-2f87f61a446c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:34.469200 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-c59acb9e-71be-4949-bcef-2f87f61a446c None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:58:34.470428 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c59acb9e-71be-4949-bcef-2f87f61a446c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:34.479971 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1445/2899] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:58:34.484353 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d0c0b-93ba-43c2-8236-a6720d52f085 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:34.494796 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d0c0b-93ba-43c2-8236-a6720d52f085 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:34.499458 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea44ca-384d-49cb-abd2-0c80e6e7257b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:34.500061 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea44ca-384d-49cb-abd2-0c80e6e7257b admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:34.500337 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea44ca-384d-49cb-abd2-0c80e6e7257b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:34.500609 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea44ca-384d-49cb-abd2-0c80e6e7257b admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:34.501256 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea44ca-384d-49cb-abd2-0c80e6e7257b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 08:58:34.501560 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea44ca-384d-49cb-abd2-0c80e6e7257b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:34.503164 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea44ca-384d-49cb-abd2-0c80e6e7257b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:34.515534 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1455/2900] 10.222.0.26 () {58 vars in 1153 bytes} [Sun Sep 11 08:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 08:58:34.520772 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59acb9e-71be-4949-bcef-2f87f61a446c None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:34.530132 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59acb9e-71be-4949-bcef-2f87f61a446c None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:34.534875 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627dea78-3a29-44b7-bcf8-03b0029dca66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:34.536040 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dea78-3a29-44b7-bcf8-03b0029dca66 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:34.536315 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dea78-3a29-44b7-bcf8-03b0029dca66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:34.536578 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dea78-3a29-44b7-bcf8-03b0029dca66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:34.537191 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627dea78-3a29-44b7-bcf8-03b0029dca66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:34.539067 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627dea78-3a29-44b7-bcf8-03b0029dca66 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:34.653937 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1446/2901] 10.222.0.26 () {60 vars in 1153 bytes} [Sun Sep 11 08:58:34 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:58:34.658187 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea44ca-384d-49cb-abd2-0c80e6e7257b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:34.668637 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea44ca-384d-49cb-abd2-0c80e6e7257b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:34.727387 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a08715-a346-4ab7-9d39-b01068bf5b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:34.727994 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a08715-a346-4ab7-9d39-b01068bf5b05 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:34.728276 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a08715-a346-4ab7-9d39-b01068bf5b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:34.728555 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a08715-a346-4ab7-9d39-b01068bf5b05 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:34.729209 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a08715-a346-4ab7-9d39-b01068bf5b05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:34.731174 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a08715-a346-4ab7-9d39-b01068bf5b05 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:34.739528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:58:34.824228 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1456/2902] 10.222.0.26 () {60 vars in 1144 bytes} [Sun Sep 11 08:58:34 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 08:58:34.828362 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627dea78-3a29-44b7-bcf8-03b0029dca66 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:34.839620 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627dea78-3a29-44b7-bcf8-03b0029dca66 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:34.844706 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40bd05-7c79-44d2-927d-fe696c20ea16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:34.845319 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40bd05-7c79-44d2-927d-fe696c20ea16 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:34.845634 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40bd05-7c79-44d2-927d-fe696c20ea16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:34.845913 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40bd05-7c79-44d2-927d-fe696c20ea16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:34.846554 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40bd05-7c79-44d2-927d-fe696c20ea16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:34.848240 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40bd05-7c79-44d2-927d-fe696c20ea16 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:34.859455 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1447/2903] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:58:34.863560 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a08715-a346-4ab7-9d39-b01068bf5b05 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:34.873837 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a08715-a346-4ab7-9d39-b01068bf5b05 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:34.879088 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936eb4f-7cc6-419e-bd1c-3d8e75b86660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:34.879720 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936eb4f-7cc6-419e-bd1c-3d8e75b86660 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:34.880001 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936eb4f-7cc6-419e-bd1c-3d8e75b86660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:34.880275 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936eb4f-7cc6-419e-bd1c-3d8e75b86660 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:34.880917 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936eb4f-7cc6-419e-bd1c-3d8e75b86660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:34.882541 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936eb4f-7cc6-419e-bd1c-3d8e75b86660 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:34.893022 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1457/2904] 10.222.0.26 () {58 vars in 1122 bytes} [Sun Sep 11 08:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 08:58:34.897776 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40bd05-7c79-44d2-927d-fe696c20ea16 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:34.907697 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40bd05-7c79-44d2-927d-fe696c20ea16 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:34.912784 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2113da5-ecef-45c8-9c84-9610f5c5e52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:34.913442 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2113da5-ecef-45c8-9c84-9610f5c5e52a admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:34.913723 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2113da5-ecef-45c8-9c84-9610f5c5e52a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:34.914021 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2113da5-ecef-45c8-9c84-9610f5c5e52a admin admin] PATH_INFO: `/v3/projects/4205c35f16aa40cc856a68472e82c0b6/users/f4a0d930d12f4bbbb37736d773437017/roles/3cecaf09e54b4f479cd391db74c49831` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:34.929712 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2113da5-ecef-45c8-9c84-9610f5c5e52a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4205c35f16aa40cc856a68472e82c0b6, user_id=f4a0d930d12f4bbbb37736d773437017, role_id=3cecaf09e54b4f479cd391db74c49831)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:34.932430 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2113da5-ecef-45c8-9c84-9610f5c5e52a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:35.057423 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1448/2905] 10.222.0.26 () {60 vars in 1483 bytes} [Sun Sep 11 08:58:34 2022] PUT /identity/v3/projects/4205c35f16aa40cc856a68472e82c0b6/users/f4a0d930d12f4bbbb37736d773437017/roles/3cecaf09e54b4f479cd391db74c49831 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 08:58:35.062755 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89747828-f440-4659-9206-a903db618d32 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:35.063043 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89747828-f440-4659-9206-a903db618d32 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:35.063345 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89747828-f440-4659-9206-a903db618d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:35.084655 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-89747828-f440-4659-9206-a903db618d32 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:58:35.085766 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-89747828-f440-4659-9206-a903db618d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:35.142711 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1458/2906] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:58:35.153346 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2113da5-ecef-45c8-9c84-9610f5c5e52a admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:35.155167 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-a2113da5-ecef-45c8-9c84-9610f5c5e52a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:35.214610 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2113da5-ecef-45c8-9c84-9610f5c5e52a admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:35.218682 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe91924-0f50-4bc4-b80a-7818ad96f37a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:35.219353 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe91924-0f50-4bc4-b80a-7818ad96f37a service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:35.219639 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe91924-0f50-4bc4-b80a-7818ad96f37a service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:35.220005 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe91924-0f50-4bc4-b80a-7818ad96f37a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:35.229795 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe91924-0f50-4bc4-b80a-7818ad96f37a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:35.231281 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe91924-0f50-4bc4-b80a-7818ad96f37a service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:35.241670 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1449/2907] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:58:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:58:36.504909 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0aeb68-e21c-4b51-bc25-a29b1ef3b16b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:36.506659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0aeb68-e21c-4b51-bc25-a29b1ef3b16b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:36.506659 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0aeb68-e21c-4b51-bc25-a29b1ef3b16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:36.536477 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-ce0aeb68-e21c-4b51-bc25-a29b1ef3b16b None None] MFA Rules not processed for user `f4a0d930d12f4bbbb37736d773437017`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:58:36.538453 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ce0aeb68-e21c-4b51-bc25-a29b1ef3b16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:36.610835 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1459/2908] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:58:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:58:36.624252 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe91924-0f50-4bc4-b80a-7818ad96f37a service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:36.625663 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1fe91924-0f50-4bc4-b80a-7818ad96f37a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:36.689565 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe91924-0f50-4bc4-b80a-7818ad96f37a service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:36.694090 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e2725-8bbe-4bab-9f64-53a6a7af1521 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211fa4ad83be44cd8164e0e47278273a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:36.694789 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e2725-8bbe-4bab-9f64-53a6a7af1521 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:36.695077 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e2725-8bbe-4bab-9f64-53a6a7af1521 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:36.695395 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e2725-8bbe-4bab-9f64-53a6a7af1521 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:36.704585 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e2725-8bbe-4bab-9f64-53a6a7af1521 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:36.706039 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e2725-8bbe-4bab-9f64-53a6a7af1521 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:36.709768 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:58:36.715881 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1450/2909] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:58:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:58:38.556652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6c398-02d5-40b0-9262-853b55c10116 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:38.557205 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6c398-02d5-40b0-9262-853b55c10116 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:38.557205 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6c398-02d5-40b0-9262-853b55c10116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:38.577088 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-09b6c398-02d5-40b0-9262-853b55c10116 None None] MFA Rules not processed for user `f4a0d930d12f4bbbb37736d773437017`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:58:38.578332 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-09b6c398-02d5-40b0-9262-853b55c10116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:38.585592 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1460/2910] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:58:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:58:38.842383 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e2725-8bbe-4bab-9f64-53a6a7af1521 service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:38.843847 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ec9e2725-8bbe-4bab-9f64-53a6a7af1521 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:38.856582 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e2725-8bbe-4bab-9f64-53a6a7af1521 service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:38.860289 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54ce55-2c55-4836-9056-2e954f32e0db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:38.860898 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54ce55-2c55-4836-9056-2e954f32e0db service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:38.861178 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54ce55-2c55-4836-9056-2e954f32e0db service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:38.861452 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54ce55-2c55-4836-9056-2e954f32e0db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:38.863813 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9c54ce55-2c55-4836-9056-2e954f32e0db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:38.874036 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54ce55-2c55-4836-9056-2e954f32e0db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:38.875563 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54ce55-2c55-4836-9056-2e954f32e0db service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:38.884704 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1451/2911] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:58:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:58:40.370626 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6c398-02d5-40b0-9262-853b55c10116 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:40.371513 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-09b6c398-02d5-40b0-9262-853b55c10116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:40.452971 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:58:40.463800 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6c398-02d5-40b0-9262-853b55c10116 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:40.469320 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94102ae1-ac13-49e8-8943-ac2e936d693e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a48c49f7a9f44cef89dd024fecea422f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:40.469947 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94102ae1-ac13-49e8-8943-ac2e936d693e service placement] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:40.470234 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94102ae1-ac13-49e8-8943-ac2e936d693e service placement] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:40.470511 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94102ae1-ac13-49e8-8943-ac2e936d693e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:40.472986 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-94102ae1-ac13-49e8-8943-ac2e936d693e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:40.486210 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94102ae1-ac13-49e8-8943-ac2e936d693e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:40.488414 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94102ae1-ac13-49e8-8943-ac2e936d693e service placement] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:40.499623 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1461/2912] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:58:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:58:48.153963 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54ce55-2c55-4836-9056-2e954f32e0db service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:48.155645 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9c54ce55-2c55-4836-9056-2e954f32e0db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:48.251533 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54ce55-2c55-4836-9056-2e954f32e0db service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:48.257234 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37561cc6-b47b-45cf-9a95-73e95f1c812d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:48.257852 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37561cc6-b47b-45cf-9a95-73e95f1c812d service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:48.258133 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37561cc6-b47b-45cf-9a95-73e95f1c812d service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:48.258408 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37561cc6-b47b-45cf-9a95-73e95f1c812d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:48.260313 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-37561cc6-b47b-45cf-9a95-73e95f1c812d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:48.273308 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37561cc6-b47b-45cf-9a95-73e95f1c812d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:48.275065 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37561cc6-b47b-45cf-9a95-73e95f1c812d service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:48.287501 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1452/2913] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:58:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:58:50.640029 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:58:54.117157 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94102ae1-ac13-49e8-8943-ac2e936d693e service placement] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:54.126594 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94102ae1-ac13-49e8-8943-ac2e936d693e service placement] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:54.131490 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530871ab-2f7f-461a-bfa3-40f25a7a7b89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:54.132082 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530871ab-2f7f-461a-bfa3-40f25a7a7b89 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:54.132362 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530871ab-2f7f-461a-bfa3-40f25a7a7b89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:54.132656 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530871ab-2f7f-461a-bfa3-40f25a7a7b89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:54.134367 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-530871ab-2f7f-461a-bfa3-40f25a7a7b89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:54.144726 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530871ab-2f7f-461a-bfa3-40f25a7a7b89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:54.146148 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530871ab-2f7f-461a-bfa3-40f25a7a7b89 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:54.154674 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1462/2914] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:58:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:58:54.613183 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37561cc6-b47b-45cf-9a95-73e95f1c812d service nova] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:54.627122 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37561cc6-b47b-45cf-9a95-73e95f1c812d service nova] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:54.633503 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ecc7f4-a784-4081-b799-85933eb15246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:54.642261 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ecc7f4-a784-4081-b799-85933eb15246 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:54.642261 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ecc7f4-a784-4081-b799-85933eb15246 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:54.642261 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ecc7f4-a784-4081-b799-85933eb15246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:54.642261 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c4ecc7f4-a784-4081-b799-85933eb15246 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:54.652072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ecc7f4-a784-4081-b799-85933eb15246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:54.655366 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ecc7f4-a784-4081-b799-85933eb15246 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:54.669652 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1453/2915] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:58:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:58:54.771794 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530871ab-2f7f-461a-bfa3-40f25a7a7b89 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:54.785462 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530871ab-2f7f-461a-bfa3-40f25a7a7b89 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:54.791591 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f53c8-380b-4272-9bdf-b0cb0204b9dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:54.792300 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f53c8-380b-4272-9bdf-b0cb0204b9dc service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:54.792711 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f53c8-380b-4272-9bdf-b0cb0204b9dc service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:54.792993 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f53c8-380b-4272-9bdf-b0cb0204b9dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:54.795032 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-995f53c8-380b-4272-9bdf-b0cb0204b9dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:54.808773 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f53c8-380b-4272-9bdf-b0cb0204b9dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:54.810433 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f53c8-380b-4272-9bdf-b0cb0204b9dc service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:54.822049 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1463/2916] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:58:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:58:55.759784 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ecc7f4-a784-4081-b799-85933eb15246 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:58:55.769532 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ecc7f4-a784-4081-b799-85933eb15246 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:58:55.773255 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e899583-f40f-470c-8a57-c9114f1be2e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:58:55.773862 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e899583-f40f-470c-8a57-c9114f1be2e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:58:55.774144 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e899583-f40f-470c-8a57-c9114f1be2e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:58:55.774421 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e899583-f40f-470c-8a57-c9114f1be2e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:58:55.776179 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6e899583-f40f-470c-8a57-c9114f1be2e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:58:55.794324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e899583-f40f-470c-8a57-c9114f1be2e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:58:55.794324 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e899583-f40f-470c-8a57-c9114f1be2e9 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:58:55.803157 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1454/2917] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:58:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:59:04.817544 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=12 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:59:05.798224 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=53 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:59:16.812182 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b952af-e102-4f2f-a9ce-f7299906557d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:59:16.812777 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b952af-e102-4f2f-a9ce-f7299906557d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:59:16.812777 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b952af-e102-4f2f-a9ce-f7299906557d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:59:16.831891 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-75b952af-e102-4f2f-a9ce-f7299906557d None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:59:16.833097 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-75b952af-e102-4f2f-a9ce-f7299906557d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:59:16.841482 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1464/2918] 10.222.0.50 () {58 vars in 1016 bytes} [Sun Sep 11 08:59:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:59:16.862710 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e899583-f40f-470c-8a57-c9114f1be2e9 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:59:16.864193 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6e899583-f40f-470c-8a57-c9114f1be2e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:59:16.878181 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e899583-f40f-470c-8a57-c9114f1be2e9 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:59:16.884592 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f026570-1d91-4d07-814d-01c3f54ecd14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:59:16.885189 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f026570-1d91-4d07-814d-01c3f54ecd14 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:59:16.885467 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f026570-1d91-4d07-814d-01c3f54ecd14 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:59:16.885745 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f026570-1d91-4d07-814d-01c3f54ecd14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:59:16.894018 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f026570-1d91-4d07-814d-01c3f54ecd14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:59:16.895641 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f026570-1d91-4d07-814d-01c3f54ecd14 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:59:16.905778 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1455/2919] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:59:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:59:21.166226 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f1aab-e2d9-41d0-8042-ff588077f9fb None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:59:21.166831 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f1aab-e2d9-41d0-8042-ff588077f9fb None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:59:21.166831 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f1aab-e2d9-41d0-8042-ff588077f9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:59:21.188927 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-1b3f1aab-e2d9-41d0-8042-ff588077f9fb None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:59:21.190154 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1b3f1aab-e2d9-41d0-8042-ff588077f9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:59:21.198425 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1465/2920] 10.222.0.50 () {58 vars in 1016 bytes} [Sun Sep 11 08:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:59:21.224216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f026570-1d91-4d07-814d-01c3f54ecd14 service nova] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:59:21.237136 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f026570-1d91-4d07-814d-01c3f54ecd14 service nova] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:59:21.242695 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af1781-de74-4a42-b78c-10b5bb07572b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:59:21.243326 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af1781-de74-4a42-b78c-10b5bb07572b service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:59:21.243606 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af1781-de74-4a42-b78c-10b5bb07572b service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:59:21.243874 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af1781-de74-4a42-b78c-10b5bb07572b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:59:21.252338 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af1781-de74-4a42-b78c-10b5bb07572b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:59:21.253905 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af1781-de74-4a42-b78c-10b5bb07572b service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:59:21.263306 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1456/2921] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:59:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:59:24.915632 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de306ce1-18f3-4f06-a6aa-443afcf2be83 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:59:24.916249 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de306ce1-18f3-4f06-a6aa-443afcf2be83 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:59:24.916249 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de306ce1-18f3-4f06-a6aa-443afcf2be83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:59:24.939660 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-de306ce1-18f3-4f06-a6aa-443afcf2be83 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:59:24.939660 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-de306ce1-18f3-4f06-a6aa-443afcf2be83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:59:24.944609 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1466/2922] 10.222.0.50 () {58 vars in 1016 bytes} [Sun Sep 11 08:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:59:24.965453 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af1781-de74-4a42-b78c-10b5bb07572b service nova] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:59:24.978389 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af1781-de74-4a42-b78c-10b5bb07572b service nova] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:59:24.984180 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0816892-8344-40a7-b96b-a3bd1e15857a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:59:24.984780 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0816892-8344-40a7-b96b-a3bd1e15857a service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:59:24.985063 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0816892-8344-40a7-b96b-a3bd1e15857a service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:59:24.985338 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0816892-8344-40a7-b96b-a3bd1e15857a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:59:24.993755 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0816892-8344-40a7-b96b-a3bd1e15857a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:59:24.995399 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0816892-8344-40a7-b96b-a3bd1e15857a service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:59:25.005092 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1457/2923] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:59:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:59:28.542564 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dae13-cd4e-4629-90c6-e8faeb035d56 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:59:28.543151 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dae13-cd4e-4629-90c6-e8faeb035d56 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:59:28.543151 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dae13-cd4e-4629-90c6-e8faeb035d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:59:28.563923 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-270dae13-cd4e-4629-90c6-e8faeb035d56 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:59:28.565142 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-270dae13-cd4e-4629-90c6-e8faeb035d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:59:28.576370 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1467/2924] 10.222.0.50 () {58 vars in 1016 bytes} [Sun Sep 11 08:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:59:28.619083 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0816892-8344-40a7-b96b-a3bd1e15857a service nova] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:59:28.630447 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0816892-8344-40a7-b96b-a3bd1e15857a service nova] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:59:28.636860 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413e4f1-8b1a-4b94-9398-15673bf5ef1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:59:28.637491 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413e4f1-8b1a-4b94-9398-15673bf5ef1f service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:59:28.637774 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413e4f1-8b1a-4b94-9398-15673bf5ef1f service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:59:28.638053 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413e4f1-8b1a-4b94-9398-15673bf5ef1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:59:28.647156 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413e4f1-8b1a-4b94-9398-15673bf5ef1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:59:28.648774 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413e4f1-8b1a-4b94-9398-15673bf5ef1f service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:59:28.658353 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1458/2925] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:59:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:59:31.796734 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4e52a-6fae-4f36-992d-b0f7005a1a58 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:59:31.797349 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4e52a-6fae-4f36-992d-b0f7005a1a58 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:59:31.797349 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4e52a-6fae-4f36-992d-b0f7005a1a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:59:31.822414 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-0fa4e52a-6fae-4f36-992d-b0f7005a1a58 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:59:31.823687 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0fa4e52a-6fae-4f36-992d-b0f7005a1a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:59:31.831610 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1468/2926] 10.222.0.50 () {58 vars in 1016 bytes} [Sun Sep 11 08:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 08:59:31.855282 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413e4f1-8b1a-4b94-9398-15673bf5ef1f service nova] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:59:31.867289 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413e4f1-8b1a-4b94-9398-15673bf5ef1f service nova] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:59:31.872922 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebd74c-8088-48a5-b112-858e33dd763d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:59:31.873516 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebd74c-8088-48a5-b112-858e33dd763d service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:59:31.873801 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebd74c-8088-48a5-b112-858e33dd763d service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:59:31.874101 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebd74c-8088-48a5-b112-858e33dd763d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:59:31.884308 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bebd74c-8088-48a5-b112-858e33dd763d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:59:31.885968 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bebd74c-8088-48a5-b112-858e33dd763d service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:59:31.896767 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1459/2927] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:59:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:59:35.009387 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626907b-9650-4641-b608-fd63e9b38e54 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:59:35.009967 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626907b-9650-4641-b608-fd63e9b38e54 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:59:35.009967 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626907b-9650-4641-b608-fd63e9b38e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:59:35.029870 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e626907b-9650-4641-b608-fd63e9b38e54 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:59:35.031081 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e626907b-9650-4641-b608-fd63e9b38e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:59:35.040055 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1469/2928] 10.222.0.50 () {58 vars in 1016 bytes} [Sun Sep 11 08:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 08:59:35.066561 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebd74c-8088-48a5-b112-858e33dd763d service nova] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 08:59:35.077948 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebd74c-8088-48a5-b112-858e33dd763d service nova] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 08:59:35.083622 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cd189-2bb3-414e-924d-8030954d9e83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 08:59:35.084226 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cd189-2bb3-414e-924d-8030954d9e83 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:59:35.084509 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cd189-2bb3-414e-924d-8030954d9e83 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:59:35.084785 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cd189-2bb3-414e-924d-8030954d9e83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:59:35.094080 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1cd189-2bb3-414e-924d-8030954d9e83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 08:59:35.095709 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1cd189-2bb3-414e-924d-8030954d9e83 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 08:59:35.106249 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1460/2929] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 08:59:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 08:59:45.024005 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=18 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:59:45.101099 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=36 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:59:51.416460 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50854e93-907d-42f6-b0b5-2b4664cc69d6 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 08:59:51.416984 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50854e93-907d-42f6-b0b5-2b4664cc69d6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 08:59:51.416984 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50854e93-907d-42f6-b0b5-2b4664cc69d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 08:59:51.437465 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-50854e93-907d-42f6-b0b5-2b4664cc69d6 None None] MFA Rules not processed for user `f4a0d930d12f4bbbb37736d773437017`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 08:59:51.438656 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-50854e93-907d-42f6-b0b5-2b4664cc69d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 08:59:51.445507 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1470/2930] 10.222.0.26 () {58 vars in 958 bytes} [Sun Sep 11 08:59:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 09:00:01.430688 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 09:00:06.689623 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d42e3-327c-4f3b-bfce-6f8ae34a5281 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 09:00:06.690197 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d42e3-327c-4f3b-bfce-6f8ae34a5281 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 09:00:06.690197 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d42e3-327c-4f3b-bfce-6f8ae34a5281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 09:00:06.711083 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-193d42e3-327c-4f3b-bfce-6f8ae34a5281 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 09:00:06.712351 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-193d42e3-327c-4f3b-bfce-6f8ae34a5281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 09:00:06.721531 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1461/2931] 10.222.0.50 () {58 vars in 1016 bytes} [Sun Sep 11 09:00:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 09:00:06.741304 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50854e93-907d-42f6-b0b5-2b4664cc69d6 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 09:00:06.754463 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50854e93-907d-42f6-b0b5-2b4664cc69d6 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 09:00:06.759841 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d2ec6-5283-4365-a8a4-c3d346e45a8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 09:00:06.760443 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d2ec6-5283-4365-a8a4-c3d346e45a8d service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 09:00:06.760718 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d2ec6-5283-4365-a8a4-c3d346e45a8d service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 09:00:06.760985 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d2ec6-5283-4365-a8a4-c3d346e45a8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 09:00:06.769708 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d2ec6-5283-4365-a8a4-c3d346e45a8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 09:00:06.771423 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d2ec6-5283-4365-a8a4-c3d346e45a8d service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 09:00:06.781575 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1471/2932] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 09:00:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 09:00:08.580086 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d42e3-327c-4f3b-bfce-6f8ae34a5281 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 09:00:08.592309 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d42e3-327c-4f3b-bfce-6f8ae34a5281 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 09:00:08.598389 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a13991-b09a-4cfd-a72e-add4f79ee3f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a48c49f7a9f44cef89dd024fecea422f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 09:00:08.599017 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a13991-b09a-4cfd-a72e-add4f79ee3f7 service placement] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 09:00:08.599330 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a13991-b09a-4cfd-a72e-add4f79ee3f7 service placement] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 09:00:08.599610 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a13991-b09a-4cfd-a72e-add4f79ee3f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 09:00:08.601348 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f3a13991-b09a-4cfd-a72e-add4f79ee3f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 09:00:08.613551 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a13991-b09a-4cfd-a72e-add4f79ee3f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 09:00:08.615147 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a13991-b09a-4cfd-a72e-add4f79ee3f7 service placement] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 09:00:08.625335 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1462/2933] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 09:00:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 09:00:10.239633 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbe95a-dcc9-4c26-b98f-64c53362d33e None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 09:00:10.240104 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbe95a-dcc9-4c26-b98f-64c53362d33e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 09:00:10.240251 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbe95a-dcc9-4c26-b98f-64c53362d33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 09:00:10.260636 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-33cbe95a-dcc9-4c26-b98f-64c53362d33e None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 09:00:10.261910 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-33cbe95a-dcc9-4c26-b98f-64c53362d33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 09:00:10.270550 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1472/2934] 10.222.0.50 () {58 vars in 1016 bytes} [Sun Sep 11 09:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 09:00:10.290870 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a13991-b09a-4cfd-a72e-add4f79ee3f7 service placement] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 09:00:10.303964 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a13991-b09a-4cfd-a72e-add4f79ee3f7 service placement] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 09:00:10.309914 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f06396-a659-4077-b550-ade3e12eb0b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 09:00:10.313176 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f06396-a659-4077-b550-ade3e12eb0b3 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 09:00:10.313176 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f06396-a659-4077-b550-ade3e12eb0b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 09:00:10.313176 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f06396-a659-4077-b550-ade3e12eb0b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 09:00:10.319802 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f06396-a659-4077-b550-ade3e12eb0b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 09:00:10.321417 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f06396-a659-4077-b550-ade3e12eb0b3 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 09:00:10.331191 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1463/2935] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 09:00:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 09:00:13.106479 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb85e3-3697-48cd-8bc9-4c392cb18b32 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 09:00:13.107044 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb85e3-3697-48cd-8bc9-4c392cb18b32 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 09:00:13.107044 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb85e3-3697-48cd-8bc9-4c392cb18b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 09:00:13.128312 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-20cb85e3-3697-48cd-8bc9-4c392cb18b32 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 09:00:13.129534 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-20cb85e3-3697-48cd-8bc9-4c392cb18b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 09:00:13.137528 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1473/2936] 10.222.0.50 () {58 vars in 1016 bytes} [Sun Sep 11 09:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 09:00:13.159586 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f06396-a659-4077-b550-ade3e12eb0b3 service nova] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 09:00:13.171030 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f06396-a659-4077-b550-ade3e12eb0b3 service nova] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 09:00:13.177216 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d1b3e-de0f-4cbd-a302-7f9e5894e63a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 09:00:13.177769 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d1b3e-de0f-4cbd-a302-7f9e5894e63a service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 09:00:13.178083 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d1b3e-de0f-4cbd-a302-7f9e5894e63a service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 09:00:13.178432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d1b3e-de0f-4cbd-a302-7f9e5894e63a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 09:00:13.187072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d1b3e-de0f-4cbd-a302-7f9e5894e63a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 09:00:13.189323 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d1b3e-de0f-4cbd-a302-7f9e5894e63a service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 09:00:13.198811 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1464/2937] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 09:00:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 09:00:16.340438 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a00f36-4886-4fb9-a811-e1deab86019a None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 09:00:16.341275 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a00f36-4886-4fb9-a811-e1deab86019a None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 09:00:16.341445 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a00f36-4886-4fb9-a811-e1deab86019a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 09:00:16.362193 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-18a00f36-4886-4fb9-a811-e1deab86019a None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 09:00:16.363440 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-18a00f36-4886-4fb9-a811-e1deab86019a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 09:00:16.371226 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1474/2938] 10.222.0.50 () {58 vars in 1016 bytes} [Sun Sep 11 09:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 09:00:16.394005 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d1b3e-de0f-4cbd-a302-7f9e5894e63a service nova] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 09:00:16.405246 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d1b3e-de0f-4cbd-a302-7f9e5894e63a service nova] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 09:00:16.411562 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20add88a-b90c-49f5-a470-80321f001372 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 09:00:16.412162 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20add88a-b90c-49f5-a470-80321f001372 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 09:00:16.412444 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20add88a-b90c-49f5-a470-80321f001372 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 09:00:16.412716 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20add88a-b90c-49f5-a470-80321f001372 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 09:00:16.421106 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20add88a-b90c-49f5-a470-80321f001372 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 09:00:16.423404 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20add88a-b90c-49f5-a470-80321f001372 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 09:00:16.433011 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1465/2939] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 09:00:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 09:00:19.586253 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d14623-9f68-4255-9dce-194d801163b0 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 09:00:19.586800 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d14623-9f68-4255-9dce-194d801163b0 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 09:00:19.586800 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d14623-9f68-4255-9dce-194d801163b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 09:00:19.607591 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-64d14623-9f68-4255-9dce-194d801163b0 None None] MFA Rules not processed for user `3488db0374224de0980821b4dd705941`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 09:00:19.608796 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-64d14623-9f68-4255-9dce-194d801163b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 09:00:19.616706 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1475/2940] 10.222.0.50 () {58 vars in 1016 bytes} [Sun Sep 11 09:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 09:00:19.638299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20add88a-b90c-49f5-a470-80321f001372 service nova] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 09:00:19.649920 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20add88a-b90c-49f5-a470-80321f001372 service nova] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 09:00:19.655432 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0cc3aa-1a19-4069-bf15-01fb140ea46a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62bb9d2e13649b5af239bb56001ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 09:00:19.656024 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cc3aa-1a19-4069-bf15-01fb140ea46a service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 09:00:19.656299 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cc3aa-1a19-4069-bf15-01fb140ea46a service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 09:00:19.656570 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cc3aa-1a19-4069-bf15-01fb140ea46a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 09:00:19.665176 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0cc3aa-1a19-4069-bf15-01fb140ea46a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 09:00:19.666724 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0cc3aa-1a19-4069-bf15-01fb140ea46a service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 09:00:19.676441 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1466/2941] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 09:00:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 09:00:29.601899 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=18 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 09:00:29.672072 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=33 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 09:00:40.347605 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d14623-9f68-4255-9dce-194d801163b0 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 09:00:40.348964 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-64d14623-9f68-4255-9dce-194d801163b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 09:00:40.361349 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d14623-9f68-4255-9dce-194d801163b0 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 09:00:40.366281 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10289d94-3abd-48f4-b6db-6f192ec7d516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 09:00:40.366911 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10289d94-3abd-48f4-b6db-6f192ec7d516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 09:00:40.367182 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10289d94-3abd-48f4-b6db-6f192ec7d516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 09:00:40.367501 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10289d94-3abd-48f4-b6db-6f192ec7d516 admin admin] PATH_INFO: `/v3/users/ac4cfc2c25c64bf08fed585fac4a94b7` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 09:00:40.368652 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10289d94-3abd-48f4-b6db-6f192ec7d516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac4cfc2c25c64bf08fed585fac4a94b7)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 09:00:40.370614 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10289d94-3abd-48f4-b6db-6f192ec7d516 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 09:00:40.554917 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-10289d94-3abd-48f4-b6db-6f192ec7d516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac4cfc2c25c64bf08fed585fac4a94b7'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 09:00:40.631699 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-10289d94-3abd-48f4-b6db-6f192ec7d516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac4cfc2c25c64bf08fed585fac4a94b7'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 09:00:40.632539 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-10289d94-3abd-48f4-b6db-6f192ec7d516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac4cfc2c25c64bf08fed585fac4a94b7'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 09:00:40.633356 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-10289d94-3abd-48f4-b6db-6f192ec7d516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac4cfc2c25c64bf08fed585fac4a94b7'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 09:00:40.643219 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-10289d94-3abd-48f4-b6db-6f192ec7d516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac4cfc2c25c64bf08fed585fac4a94b7'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 09:00:40.661152 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1476/2942] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 09:00:40 2022] DELETE /identity/v3/users/ac4cfc2c25c64bf08fed585fac4a94b7 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 09:00:40.671109 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0cc3aa-1a19-4069-bf15-01fb140ea46a service nova] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 09:00:40.681049 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0cc3aa-1a19-4069-bf15-01fb140ea46a service nova] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 09:00:40.730422 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf087f3-3999-4d68-bb13-ea2685d8e215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86ca1e378c4042a1807c7a45aaab99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 09:00:40.731060 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf087f3-3999-4d68-bb13-ea2685d8e215 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 09:00:40.731370 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf087f3-3999-4d68-bb13-ea2685d8e215 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 09:00:40.731643 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf087f3-3999-4d68-bb13-ea2685d8e215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 09:00:40.733426 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-abf087f3-3999-4d68-bb13-ea2685d8e215 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 09:00:40.798151 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf087f3-3999-4d68-bb13-ea2685d8e215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 09:00:40.799775 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf087f3-3999-4d68-bb13-ea2685d8e215 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 09:00:40.810956 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1467/2943] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 09:00:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 09:00:41.102647 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10289d94-3abd-48f4-b6db-6f192ec7d516 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 09:00:41.105504 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-10289d94-3abd-48f4-b6db-6f192ec7d516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 09:00:41.118511 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10289d94-3abd-48f4-b6db-6f192ec7d516 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 09:00:41.123494 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8f2f6-ebbd-4882-965b-567572e17d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 09:00:41.124132 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8f2f6-ebbd-4882-965b-567572e17d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 09:00:41.124408 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8f2f6-ebbd-4882-965b-567572e17d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 09:00:41.124865 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8f2f6-ebbd-4882-965b-567572e17d62 admin admin] PATH_INFO: `/v3/projects/f039992e08ee42eda9beb11022c4a31f` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 09:00:41.126005 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8f2f6-ebbd-4882-965b-567572e17d62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f039992e08ee42eda9beb11022c4a31f)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 09:00:41.127993 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8f2f6-ebbd-4882-965b-567572e17d62 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 09:00:41.258234 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a6a8f2f6-ebbd-4882-965b-567572e17d62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f039992e08ee42eda9beb11022c4a31f', 'request_id': 'req-a6a8f2f6-ebbd-4882-965b-567572e17d62'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 09:00:41.265337 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a6a8f2f6-ebbd-4882-965b-567572e17d62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f039992e08ee42eda9beb11022c4a31f', 'request_id': 'req-a6a8f2f6-ebbd-4882-965b-567572e17d62'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 09:00:41.351622 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a6a8f2f6-ebbd-4882-965b-567572e17d62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f039992e08ee42eda9beb11022c4a31f', 'request_id': 'req-a6a8f2f6-ebbd-4882-965b-567572e17d62'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 09:00:41.363933 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a6a8f2f6-ebbd-4882-965b-567572e17d62 admin admin] The token cache is being invalidate because project f039992e08ee42eda9beb11022c4a31f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 09:00:41.364228 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a6a8f2f6-ebbd-4882-965b-567572e17d62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 09:00:41.364908 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a6a8f2f6-ebbd-4882-965b-567572e17d62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 09:00:41.366405 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1477/2944] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 09:00:41 2022] DELETE /identity/v3/projects/f039992e08ee42eda9beb11022c4a31f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 09:00:41.370563 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf087f3-3999-4d68-bb13-ea2685d8e215 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 09:00:41.380664 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf087f3-3999-4d68-bb13-ea2685d8e215 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 09:00:41.444954 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37191b17-3442-4a6c-b7f3-e52e767d05e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 09:00:41.445595 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37191b17-3442-4a6c-b7f3-e52e767d05e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 09:00:41.445877 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37191b17-3442-4a6c-b7f3-e52e767d05e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 09:00:41.446153 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37191b17-3442-4a6c-b7f3-e52e767d05e5 admin admin] PATH_INFO: `/v3/users/ea41d6a276a44cfe9d113d6ee9cf91e8` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 09:00:41.447294 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37191b17-3442-4a6c-b7f3-e52e767d05e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea41d6a276a44cfe9d113d6ee9cf91e8)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 09:00:41.449235 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37191b17-3442-4a6c-b7f3-e52e767d05e5 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 09:00:41.611337 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-37191b17-3442-4a6c-b7f3-e52e767d05e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea41d6a276a44cfe9d113d6ee9cf91e8'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 09:00:41.611917 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-37191b17-3442-4a6c-b7f3-e52e767d05e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea41d6a276a44cfe9d113d6ee9cf91e8'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 09:00:41.616445 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 09:00:41.619403 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-37191b17-3442-4a6c-b7f3-e52e767d05e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea41d6a276a44cfe9d113d6ee9cf91e8'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 09:00:41.620013 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-37191b17-3442-4a6c-b7f3-e52e767d05e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea41d6a276a44cfe9d113d6ee9cf91e8'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 09:00:41.671485 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-37191b17-3442-4a6c-b7f3-e52e767d05e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea41d6a276a44cfe9d113d6ee9cf91e8'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 09:00:41.689955 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1468/2945] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 09:00:41 2022] DELETE /identity/v3/users/ea41d6a276a44cfe9d113d6ee9cf91e8 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 09:00:41.928955 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8f2f6-ebbd-4882-965b-567572e17d62 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 09:00:41.928955 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a6a8f2f6-ebbd-4882-965b-567572e17d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 09:00:41.944086 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8f2f6-ebbd-4882-965b-567572e17d62 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 09:00:42.004250 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 09:00:42.013764 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c551b-55bd-4111-955c-1ce7e114431a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 09:00:42.014399 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c551b-55bd-4111-955c-1ce7e114431a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 09:00:42.014679 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c551b-55bd-4111-955c-1ce7e114431a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 09:00:42.020358 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c551b-55bd-4111-955c-1ce7e114431a admin admin] PATH_INFO: `/v3/projects/c4fec252f004429aa94111b57e8253bd` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 09:00:42.020358 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c551b-55bd-4111-955c-1ce7e114431a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4fec252f004429aa94111b57e8253bd)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 09:00:42.020358 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c551b-55bd-4111-955c-1ce7e114431a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 09:00:42.141389 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-803c551b-55bd-4111-955c-1ce7e114431a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4fec252f004429aa94111b57e8253bd', 'request_id': 'req-803c551b-55bd-4111-955c-1ce7e114431a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 09:00:42.146858 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-803c551b-55bd-4111-955c-1ce7e114431a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4fec252f004429aa94111b57e8253bd', 'request_id': 'req-803c551b-55bd-4111-955c-1ce7e114431a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 09:00:42.232019 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-803c551b-55bd-4111-955c-1ce7e114431a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4fec252f004429aa94111b57e8253bd', 'request_id': 'req-803c551b-55bd-4111-955c-1ce7e114431a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 09:00:42.244507 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-803c551b-55bd-4111-955c-1ce7e114431a admin admin] The token cache is being invalidate because project c4fec252f004429aa94111b57e8253bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 09:00:42.244796 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-803c551b-55bd-4111-955c-1ce7e114431a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 09:00:42.245441 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-803c551b-55bd-4111-955c-1ce7e114431a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 09:00:42.247062 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1478/2946] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 09:00:41 2022] DELETE /identity/v3/projects/c4fec252f004429aa94111b57e8253bd => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 09:00:51.734270 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=10,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 09:00:52.241246 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=26,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 09:00:53.112555 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37191b17-3442-4a6c-b7f3-e52e767d05e5 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 09:00:53.118142 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-37191b17-3442-4a6c-b7f3-e52e767d05e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 09:00:53.128620 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37191b17-3442-4a6c-b7f3-e52e767d05e5 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 09:00:53.185967 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ba8de-1ad8-4ecf-ae92-56b3a0b250de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 09:00:53.186611 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ba8de-1ad8-4ecf-ae92-56b3a0b250de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 09:00:53.186895 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ba8de-1ad8-4ecf-ae92-56b3a0b250de admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 09:00:53.187198 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ba8de-1ad8-4ecf-ae92-56b3a0b250de admin admin] PATH_INFO: `/v3/users/f4a0d930d12f4bbbb37736d773437017` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 09:00:53.188437 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ba8de-1ad8-4ecf-ae92-56b3a0b250de admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4a0d930d12f4bbbb37736d773437017)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 09:00:53.190369 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ba8de-1ad8-4ecf-ae92-56b3a0b250de admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 09:00:53.434472 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1b0ba8de-1ad8-4ecf-ae92-56b3a0b250de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4a0d930d12f4bbbb37736d773437017'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 09:00:53.435120 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1b0ba8de-1ad8-4ecf-ae92-56b3a0b250de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4a0d930d12f4bbbb37736d773437017'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 09:00:53.442251 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1b0ba8de-1ad8-4ecf-ae92-56b3a0b250de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4a0d930d12f4bbbb37736d773437017'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 09:00:53.442890 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1b0ba8de-1ad8-4ecf-ae92-56b3a0b250de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4a0d930d12f4bbbb37736d773437017'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 09:00:53.539594 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1b0ba8de-1ad8-4ecf-ae92-56b3a0b250de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4a0d930d12f4bbbb37736d773437017'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 09:00:53.558732 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1469/2947] 10.222.0.26 () {58 vars in 1224 bytes} [Sun Sep 11 09:00:53 2022] DELETE /identity/v3/users/f4a0d930d12f4bbbb37736d773437017 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 09:00:53.787944 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c551b-55bd-4111-955c-1ce7e114431a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 09:00:53.789377 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-803c551b-55bd-4111-955c-1ce7e114431a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 09:00:53.803183 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c551b-55bd-4111-955c-1ce7e114431a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 09:00:53.862692 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65bb66-ca19-4fad-a241-909eb75b2fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3488db0374224de0980821b4dd705941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a12f84e22947cf95a2bfc7124d42aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 09:00:53.863354 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65bb66-ca19-4fad-a241-909eb75b2fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 09:00:53.863635 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65bb66-ca19-4fad-a241-909eb75b2fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 09:00:53.863908 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65bb66-ca19-4fad-a241-909eb75b2fe1 admin admin] PATH_INFO: `/v3/projects/4205c35f16aa40cc856a68472e82c0b6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 09:00:53.865175 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65bb66-ca19-4fad-a241-909eb75b2fe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4205c35f16aa40cc856a68472e82c0b6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 09:00:53.867510 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65bb66-ca19-4fad-a241-909eb75b2fe1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 09:00:53.968803 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0d65bb66-ca19-4fad-a241-909eb75b2fe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4205c35f16aa40cc856a68472e82c0b6', 'request_id': 'req-0d65bb66-ca19-4fad-a241-909eb75b2fe1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 09:00:53.974378 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0d65bb66-ca19-4fad-a241-909eb75b2fe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4205c35f16aa40cc856a68472e82c0b6', 'request_id': 'req-0d65bb66-ca19-4fad-a241-909eb75b2fe1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 09:00:54.036758 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0d65bb66-ca19-4fad-a241-909eb75b2fe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4205c35f16aa40cc856a68472e82c0b6', 'request_id': 'req-0d65bb66-ca19-4fad-a241-909eb75b2fe1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 09:00:54.048782 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0d65bb66-ca19-4fad-a241-909eb75b2fe1 admin admin] The token cache is being invalidate because project 4205c35f16aa40cc856a68472e82c0b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 09:00:54.049073 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0d65bb66-ca19-4fad-a241-909eb75b2fe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 09:00:54.049715 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0d65bb66-ca19-4fad-a241-909eb75b2fe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 09:00:54.051219 dv-cinder-856941-2-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1479/2948] 10.222.0.26 () {58 vars in 1233 bytes} [Sun Sep 11 09:00:53 2022] DELETE /identity/v3/projects/4205c35f16aa40cc856a68472e82c0b6 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 09:01:03.554541 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 09:01:04.045600 dv-cinder-856941-2-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 09:05:11.858365 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ba8de-1ad8-4ecf-ae92-56b3a0b250de admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 09:05:11.859915 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1b0ba8de-1ad8-4ecf-ae92-56b3a0b250de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 09:05:11.998249 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ba8de-1ad8-4ecf-ae92-56b3a0b250de admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 09:05:12.059553 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97357901-c2d2-429f-a788-861f202c3150 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a48c49f7a9f44cef89dd024fecea422f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6ed5f989f4248d7bab2548eb350fe17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 09:05:12.060155 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97357901-c2d2-429f-a788-861f202c3150 service placement] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 09:05:12.060433 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97357901-c2d2-429f-a788-861f202c3150 service placement] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 09:05:12.060731 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97357901-c2d2-429f-a788-861f202c3150 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 09:05:12.062451 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-97357901-c2d2-429f-a788-861f202c3150 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 09:05:12.073457 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97357901-c2d2-429f-a788-861f202c3150 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 09:05:12.075024 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97357901-c2d2-429f-a788-861f202c3150 service placement] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 09:05:12.085444 dv-cinder-856941-2-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1470/2949] 10.222.0.26 () {60 vars in 1365 bytes} [Sun Sep 11 09:05:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 09:05:22.081079 dv-cinder-856941-2-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}